{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c44b4615-a8da-5c86-80ff-1aa2876ed8a1","task_key":"default--validation--23139","task_revision_id":"1","upstream_id":"23139","short_description":"HellaSwag validation 23139","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear dad hats [title] Try on hats or measure your head to find the best fit. [step] Dad hats typically come as one size fits most, which will fit a head circumference of 22-23.5 inches (56-60 cm). If you're ordering online, use a measuring tape to.\",\"endings\":\"['Leave the measuring tape hanging to check your size. Write this information on a piece of paper and put it in the inside of your back pocket.', '[substeps] You may be able to find dad hats in a conventional sizes. A small size is 21-22 inches (53-56 cm), while a large size is 23.5-24.25 inches (59.7-61.6 cm).', '[substeps] Look for sports-themed hats such as a football hat. [title] Try on hats for a few minutes before making your selection.', 'Always be sure to look for down sizes to avoid purchasing any hat that might fit wrong. An average head can fit up to 15 hats per year, and, depending on what your finds are, you may want to try several hats before settling on your size.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}