{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"887b0dc0-0a02-541b-8076-a9ad30753df1","task_key":"default--validation--21677","task_revision_id":"1","upstream_id":"21677","short_description":"HellaSwag validation 21677","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to calculate calories burned in a day [title] Calculate your basal metabolic rate. [step] Our bodies are like engines that are constantly running. They're always burning fuel or calories (even during sleep).\",\"endings\":\"['Bmr is the number of calories you burn each day simply by being alive. [substeps] Your basal metabolic rate (bmr) can vary based on your age, sex, size, and genetics.', 'The number of calories we eat each day is written on our bodies. When we are an organ we follow the top number of calories that are consumed as a day.', 'Doing a bmi of 148 and above on a daily basis will have you doing the bmi bmi on most days. [substeps] Knowing your bmi will help you understand when to start and stop consuming unhealthy foods (like fried food), junk food, candy and hot chocolate (which also predominates your sleep cycle).', \\\"Our metabolism, the amount of fuel we consume, and the amount we metabolize during the day are all factors in calculating these calculation. What's more, you can determine your basal metabolic rate based on the amount of calories you burn and your core chemistry (should this become very difficult).\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}