{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"51f5947e-2acb-54bf-acf3-47e5c70a2f8f","task_key":"default--validation--29420","task_revision_id":"1","upstream_id":"29420","short_description":"HellaSwag validation 29420","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to eat as a young athlete [title] Make sure carbohydrates comprise 45% to 65% of the athlete's total caloric intake. [step] Carbohydrates are key to a young athlete's performance and health. The body stores glucose in muscles and the liver as glycogen, which is the most readily available source of energy.\",\"endings\":\"['Whole grains, fruits, vegetables, and low-fat dairy products are all good choices. [substeps] Avoid processed carbohydrates like muffins, cookies, and chips.', 'Because of this, when individuals eat too many carbohydrates, they overeat. This leads to soreness throughout the body; the muscles including the stomach are so busy working they are physically incapable of working.', \\\"Carbohydrates are also the heart connectors, which help your body convert glucose, lower blood pressure, and cholesterol into cells and organs. [title] Don't eat yogurt or other processed items.\\\", '[substeps] Realize that carbohydrates are simply fluid, meaning that they remain liquid, not solid. This means that when you are eating carbohydrates, or those which are solid, you need to calculate them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}