{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b10db413-e61d-5bee-82fb-a5956ce93a8b","task_key":"default--validation--50149","task_revision_id":"1","upstream_id":"50149","short_description":"HellaSwag validation 50149","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to avoid simple sugars [title] Read the food label. [step] In the us, it's mandatory for food manufacturers to list the amount of sugar and types of sugar in all foods that have a label. Read all food labels and ingredient lists so you're aware of exactly what's in your food.\",\"endings\":\"['This will help prevent the use of simple sugars to flavor or nourish your foods. [title] Stop eating food that contains artificial additives and high levels of calories.', 'Read all health information, as well as the ingredients, so you can have free range of natural fruits and vegetables. [substeps] There are some very popular foods, like iceberg lettuce, table salt, jelly beans, and lentils, that have very few simple sugars.', '[substeps] Review the food label and look for \\\" sugar \\\". You\\\\'ll find it listed underneath the label of \\\" total carbohydrates.', '[substeps] Know your natural sugars versus foods that are naturally sugar-rich. For example, fruits such as apples, peaches, and grapes are naturally sugarless.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}