{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7b3d0432-8a95-58fc-8dad-869c8d696065","task_key":"default--validation--7591","task_revision_id":"1","upstream_id":"7591","short_description":"HellaSwag validation 7591","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to appreciate your life [title] Count your blessings. [step] Start by being grateful for the things you do have. Life for the most part is made up of the mundane and the ordinary.\",\"endings\":\"['You are not the only person with other lives or responsibilities. There are also things you are grateful for.', 'While we all need support from loving ones to discourage the \\\" strike, \\\" there are good things that come with life. People who cultivate and cultivate the sum of the positive things in our life are more likely to be able to appreciate our particular journey.', \\\"Look at your accumulated clothes and possessions, your home, friends, family, job, the food in your cupboards, everything. Maybe there isn't much for you to look at now, but be thankful for the things that you do have.\\\", 'Often we feel as if a season or a month pass by without us being thankful for our surroundings. Instead of focusing on all the things you have, which come in hundreds of colors, categories, and styles, focus on the something being thankful for.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}