{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0417cdd0-2e1e-545c-83c2-2d15efb962e5","task_key":"default--validation--41950","task_revision_id":"1","upstream_id":"41950","short_description":"HellaSwag validation 41950","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make your children go to bed earlier [title] Begin to slow things down after dinner. [step] Experts suggest that all stimulating activities should be avoided after eating. Children should also avoid eating big meals close to bed time, and they should not have any caffeinated drinks.\",\"endings\":\"['[title] Be especially cautious about giving your child deep sleep. [step] Many nutritionists recommend delaying bedtime.', 'Some research suggests that if kids buy junk food at bedtime, they can experience side effects such as vomiting or dehydration. Coffee, tea, chocolate, and sodas should be avoided during the bedtime.', 'Caffeine is a stimulant that makes it difficult to sleep, and going to bed on a full stomach can be uncomfortable because of acid build up. Eating and drinking right is the first step towards bedtime.', 'They should also avoid eating at too early in the morning and even coming to bed between 4 and 7 pm. The result is that children should also avoid daytime activities that are unusual to them like reading, studying, or surfing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}