{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9d2e78f-5987-58df-8979-a74e39ce8944","task_key":"default--validation--12179","task_revision_id":"1","upstream_id":"12179","short_description":"HellaSwag validation 12179","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to measure ring size for men [title] Find a ring size conversion table on the internet. [step] Many online jewelers offer tables that help you convert inches and centimeters into ring sizes. Print the table out, or simply bookmark the page so you can refer to it when you need to.\",\"endings\":\"[\\\"You can also walk into a jeweler's store near you to ask if they offer these tables. [substeps] These tables will have rows and columns that list measurements next to ring sizes so you can easily convert the diameter of your finger to a standard ring size.\\\", '[title] Record the ring\\\\'s diameter on the table in inches or centimeters format. [step] This is especially important for rings that come in 7.5 cm (1/4 \\\") metric dimensions.', '[title] Cut the table into a ring width for your ring size. [step] Measure your ring size appropriately so that it matches your ring size.', 'Make sure the table shows the full size of the ring at the bottom, with no runs, bends, or other differences. [substeps] If the table does not show the full size, take your sample ring and be sure to cut it to the exact size.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}