{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fea1ec8a-a7a8-5b01-b3df-68707f19e8ac","task_key":"default--validation--17293","task_revision_id":"1","upstream_id":"17293","short_description":"HellaSwag validation 17293","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your twins to actually take a nap [title] Keep twins on the same sleep schedule. [step] To start, you want to make sure your twins are on roughly the same sleep schedule. If your twins are used to napping around the same time, this decreases the likelihood one twin will disturb the other's rest.\",\"endings\":\"['This will also make things easier on you. You do not want to constantly be tending to one baby or the other.', \\\"Simply so that there isn't any cross-contamination, one twin should be sleeping close to the other and stop once the other has fallen asleep to let them have a chance to stay asleep. [substeps] To help your twins adjust to one another's sleeping schedules, try to sleep earlier.\\\", 'This helps ensure you reduce your chances of the twins napping. [substeps] If one twin sleeps during the day and one will nap at night, make sure both sleep between 8 and 9 p.m.', 'If both twins wake up at roughly the same time each morning, their schedules will switch. Try to keep the same sleeping schedule whenever possible.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}