{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e20ecf4-eb30-5315-9567-adfff070de75","task_key":"default--validation--31362","task_revision_id":"1","upstream_id":"31362","short_description":"HellaSwag validation 31362","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to have a balanced life [title] Maintain a schedule. [step] One way to ensure a balanced life is to schedule your time. If you're spending all of your time at work or most of your free time doing one activity, it's hard to maintain balance in all areas of your life.\",\"endings\":\"['If you only do one activity a day or you have to work every day, having a schedule is hard to maintain. Take steps to keep yourself apprised of your schedule.', \\\"What you do in all that time matters just as much as what you do in your daily life. Designate some time for yourself each day, whether you're at work, at home, or while having dinner with friends.\\\", 'A schedule can help you to balance your time in various areas that are important to you. Maintaining a schedule can help you accomplish goals and create balance in how you spend your time.', 'Break out your schedule into two or three main categories: \\\" work \\\" and \\\" life \\\". [substeps] Choose one of the two categories for the day.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}