{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2535d62-bcc7-5230-ad55-e9c8e1c2adda","task_key":"default--validation--40749","task_revision_id":"1","upstream_id":"40749","short_description":"HellaSwag validation 40749","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get your children to eat their vegetables and fruits [title] Set the right example. [step] Children learn what they live, making it vital that parents set the right example with their own food choices. If parents are routinely eating and snacking on unhealthy foods, how can children be expected to do any differently? Setting the right example to get children to eat right requires parental self-discipline.\",\"endings\":\"['[substeps] Always appreciate the value of helping your children to incorporate healthy meals into their diets. Other parents may view healthy meals as a side dish instead of a part of something fun or attention-grabbing.', 'Parents need to provide loving and firm guidance in making healthy and wise choices regarding food and snacks. [substeps] It is most important to eat plenty of vegetables and fruits yourself.', '[substeps] Make your own food even if you live by the same restaurant. Try to be consistent with what you cook.', \\\"[substeps] Eat with your child's best interests at heart. She's more likely to eat healthily if she doesn't have to worry about restrictions or added calories.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}