{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e34ee6ff-336f-5a85-a15c-f9db0575b920","task_key":"default--validation--11135","task_revision_id":"1","upstream_id":"11135","short_description":"HellaSwag validation 11135","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to increase alertness [title] Get enough sleep at night. [step] Good sleep is the single most important factor in increasing alertness. Although the amount each person requires varies, the national sleep foundation suggests 8 to 10 hours a night for teenagers and 7 to 9 hours for adults.\",\"endings\":\"['[substeps] The majority of adults need 13 or more hours a night for a minimum of 13 nights. It is recommended that teens (8 or 9 months) get 11 to 15 hours every night for the first 2 days of the week, in addition to 8 to 12 hours every night for the first four days.', \\\"Young adults under age 65 (or older) should aim for seven to nine hours of quality sleep that's not more than eight hours per night. [substeps] Adults ages 47 or older need 8.5 to 12 hours of sleep each night, and older people over 65 need 9 to 12 hours of quality sleep each night.\\\", \\\"To get better sleep, create healthy sleep habits for yourself, such as not using a mobile device within an hour of bedtime or reading for a little bit before going to sleep every night. [substeps] If you're struggling to get an adequate amount of sleep every night, a power nap can help you recharge during the day.\\\", 'The teen sleeping pattern, the period, and the seven day cycle in which teenagers sleep only 10 to 12 hours a night (5 to 8 hours a day) are considered sleep apnea (sleep paralysis). [substeps] It is recommended that teenagers sleep on a slept-in mattress, in order to improve their quality of sleep.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}