{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"86bf1677-dded-582d-9888-7e9dcbbaf042","task_key":"default--validation--39463","task_revision_id":"1","upstream_id":"39463","short_description":"HellaSwag validation 39463","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose an android device for your child [title] Use it for education. [step] Your kid will most likely have to look at the device for hours either for reading lectures or taking down lesson notes. Pick one that has a large screen, enough that it wouldn't strain their eyes even after using it for long periods.\",\"endings\":\"[\\\"[substeps] Android devices like samsung galaxy tabs or google nexus tablets should fit the requirements. If the school required the purchase, then ask the administration if there's any particular unit that you need to buy.\\\", \\\"[substeps] If you're not teaching english, drive your child to a local library. Leave the background information to the regular teachers who are in charge of the device, as mentioned above.\\\", '[substeps] Choose a screen that is at least 8.5 cm by 5 cm (about 4 x 5 inches) in diameter (52 cm-44 cm). Many parents add different colors to their screens.', \\\"For example, allowing your child to sit for a whole day in this device makes them a large screen user. [substeps] It's best not to trade in a device for a child's software, as this sometimes caused chronic problems with formatting.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}