{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"338990ac-7b14-5baf-b7b9-be9eb7b8dd8e","task_key":"default--validation--11497","task_revision_id":"1","upstream_id":"11497","short_description":"HellaSwag validation 11497","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to reduce waist size [title] Reduce calories. [step] It's a fairly obvious point, but if you want to reduce your waist size, you need to reduce the amount of calories you consume. Weight loss is an obvious equation: you need to burn more than you take in, and exercise burns fewer calories than many people think.\",\"endings\":\"[\\\"When you're losing weight, your body responds by burning more calories than you burn. One of the best ways to see the difference between healthy and obese is to diet.\\\", \\\"In fact, your body breaks down calories faster than any other muscles, and your waist size increases, despite these new weight loss options. [substeps] You'll need to eat more than you consume.\\\", '[substeps] It takes a caloric deficit of 3 , 500 to lose a single pound. Many studies have found that if you keep a food diary in which you list what you eat every day, with the number of calories consumed, you will be more likely to eat less.', \\\"Many parents focus on limiting their calorie intake as a way to cater to their children, but you're getting nowhere in this regard. [substeps] Cut out all that fat that diets offer you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}