{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f3e3cef-b825-5789-8378-fd7cfd2d32aa","task_key":"default--validation--18142","task_revision_id":"1","upstream_id":"18142","short_description":"HellaSwag validation 18142","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become successful as a single parent [title] Have a positive outlook on life-this step applies to anyone in any situation. [step] As a single parent you will encounter many challenges, struggles, and joys. Facing and going through these experiences might change your outlook on life, either in a positive or a negative way.\",\"endings\":\"['Keeping a positive attitude is key in becoming a successful single parent. [title] Be patient-patience is the number one rule when it comes to babies and children.', \\\"So don't feel as though you have to hide behind screens all the time. Stand around and look at the sky on a bright day and silently marvel at the gorgeous landscape that views you.\\\", '[substeps] Being successful means living a positive and confident life without worrying about whether you are succeeding or not. Even though this negative attitude is bad news, it is a sure sign that you may actually be very successful.', 'Take some time to gain perspective and know that you are strong and resilient in all aspects of life. Treat us with respect, try to exercise regularly, and take time to nurture our ideas, senses, and attitudes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}