{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"90e6a38d-66ad-552d-9bca-16b3d7d44a1f","task_key":"default--validation--40842","task_revision_id":"1","upstream_id":"40842","short_description":"HellaSwag validation 40842","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to calculate fat calories [title] Read the nutrition panel on the food package. [step] The nutrition panel on food packages has all of the information that you will need to calculate calories from fat. The panel is black and white and it should say \\\" nutrition facts \\\" at the top of it.\",\"endings\":\"['[substeps] Food labels often have information about how many calories are in each serving of the food, as well as the percentage of fat added. You may be unsure which group to test the food for, so ask your doctor if you are unsure what group to test.', 'Find this panel and then find the number of fat grams per serving. [substeps] Write down how many grams of fat are in this food.', 'The nutrition facts panel will give you the necessary information. [substeps] Food size: the amount of calories per gram of that food should be measured.', '[title] Classify fat based on just a simple phrase (like, \\\" body weight in kilograms \\\"). [step] In the upper right hand corner of the nutrition panel, you should see a \\\" calculate fat \\\" button or \\\" calculate weights \\\" button.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}