{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2df8d74a-c476-51bb-96a6-592ea287a4a3","task_key":"default--validation--39705","task_revision_id":"1","upstream_id":"39705","short_description":"HellaSwag validation 39705","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to cut salt from pantry foods [title] Look for \\\" no salt added \\\" canned vegetables. [step] Canned vegetables are generally high in sodium. To cut the salt from these, buy canned vegetables that say \\\" no salt added \\\" on the label.\",\"endings\":\"['That ensures you are getting the vegetable without added salt. [substeps] If you want a little bit of salt to taste, you can add a small amount of salt when you put the food on the plate.', 'Focus on reduced sodium, which means diets have been shown to lower the salt content of these vegetables. [substeps] Many bakeware jars are this size and range in price from a few dollars to hundreds of dollars.', 'Canned vegetables are commonly added to soups and casseroles. About halfway down the grocery aisle, search for \\\" no salt added \\\" in your pantry.', 'Simply place them in a blender, then transfer them to a food processor. Use 1 cup of water for every 2 cups of liquid that you add to the blender.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}