{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"19d82f00-7b5e-5d45-90b4-9ba8a9316da6","task_key":"default--validation--32702","task_revision_id":"1","upstream_id":"32702","short_description":"HellaSwag validation 32702","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to speed up metabolism with fat calories [title] Eat enough calories. [step] You should consume enough calories for your body. Otherwise, your body will go into starvation mode, which means your metabolism will decrease dramatically to save energy.\",\"endings\":\"[\\\"In starvation mode, you won't be burning many calories. To avoid this scenario, you should eat enough to match your resting metabolic rate.\\\", 'Eat to maintain this goal : [substeps] Take in about 2.5 calories per day. You can increase this number back up by around 2 to 5 percent (if you really need to) over a longer period of time (perhaps 8 or more days) to 150 or more calories weekly.', 'Stay consistent with the amount of calories you eat each day to stay afloat. The world around you literally rests on your shoulders.', 'Stick to a healthy weight of at least 150% fat, and consume approximately 5 , 200 calories daily. [substeps] Put on one or two pounds per week to give your metabolism time to catch up.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}