{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8e1ad0b7-3aaf-5ba1-a47a-bcc3ba15f459","task_key":"default--validation--42518","task_revision_id":"1","upstream_id":"42518","short_description":"HellaSwag validation 42518","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to lose weight by controlling insulin [title] Limit your daily intake of carbohydrates. [step] Your pancreas produces the most insulin when you consume a carbohydrate-rich meal. This is bad, especially when you're aiming to lose abdominal fat.\",\"endings\":\"['Controlling the amount and type of carbohydrates you eat throughout the day can help you manage your insulin levels. [substeps] Carbohydrates are found in the following foods: grains, starchy vegetables, legumes, fruits and dairy products.', 'Eat foods high in carbohydrates so you feel full without sacrificing your good health. [substeps] Reduce the amount of carbohydrates in your food by making a low-sugar, low-salt diet and increasing your consumption of lean foods.', 'Limiting your carbohydrates will help you lose weight. [substeps] Aim to consume 500 or 800 grams of carbohydrates daily.', 'But this can only be avoided through diet, exercise, or eating large quantities of carbohydrates. [substeps] You should eat breakfast every day, just like a typical breakfast.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}