{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"268bc45f-8251-52ab-8359-6393ddcb7683","task_key":"default--validation--6023","task_revision_id":"1","upstream_id":"6023","short_description":"HellaSwag validation 6023","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be the best you can be [title] Be aware of the kind of person you strive to be. [step] Know who you want to be and be that person. Make a list of the most important qualities in your personality.\",\"endings\":\"['If you find yourself deviating from those qualities, slow down and regain your composure. [substeps] For example, if you want to be a more patient person, come up with a plan to practice patience in stressful times, such as counting to ten.', '[substeps] Do not compare yourself with everyone else. Instead of focusing on the people in your life who are excellent, focus on your flaws.', 'This will serve as your compass guide when it comes to you being a good person. Include : [substeps] Generosity a bedside manner, style of speech, and attitude are the most important qualities of any person.', 'Be that person, not what some other \\\" me \\\" is pretending to be. [title] Join clubs, go shopping, or get some exercise-just not extreme activity.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}