{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d56eba57-f97c-5972-b018-39a57ffeaeee","task_key":"default--validation--1401","task_revision_id":"1","upstream_id":"1401","short_description":"HellaSwag validation 1401","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to let go of unhealthy foods [title] Develop a taste for fresh, healthy food. [step] When you eat sugar, salt and other strong flavors you can train your palate to find food that doesn't contain these items dull. Part of letting go of unhealthy food is learning to embrace what's healthy.\",\"endings\":\"['[substeps] Many people struggle with their sense of taste. If you have an unhealthy sense of taste, it will be difficult to let go of good food.', '[substeps] Popular foods for our palate are fruit, nuts, seeds, fruit juices, fruit sauces, processed foods and milk. Be mindful that your body has a very limited set of biological processes that cause your cells to process whole foods without breaking fats from them.', \\\"Start by getting a taste for what you're eating. Some ways to use these tasting senses are : [substeps] Season your food.\\\", \\\"Find out what's in season where you live, explore new flavors, and try new recipes. You'll soon find you actually enjoy eating healthy food.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}