{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bc15d0f4-8e83-58f7-ba07-a0eaa9535b39","task_key":"default--validation--22155--variant-e6ec04a542b9","task_revision_id":"1","upstream_id":"22155--variant-e6ec04a542b9","short_description":"HellaSwag validation 22155","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stay looking young [title] Eat more monounsaturated and polyunsaturated fats. [step] These fats can reduce inflammation, hydrate your skin, and help your body absorb nutrients that will keep your skin looking healthy. Incorporate these healthy fats into your diet so they make up 18-28 percent of the calories you eat every day.\",\"endings\":\"['[substeps] These fats are derived from saturated fats found in fish, tuna, and legumes. Vegetarians should consume only 70 percent of the calories they eat every day.', '[substeps] Foods like these: coconut oil, olive oil, and canola oil are good sources of vitamin b, which will help your skin stay healthy and young-looking. [title] Eat foods high in healthy fats.', '[substeps] Cutting out trans fats and saturated fats will definitely decrease how much your skin looks younger. Reduce your time in the sun as much as possible, and limit your aerobic activity.', 'Some foods that are high in healthy fats are avocados, nuts, olive oil, fish, and corn. [title] Add foods high in lycopene to your diet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}