{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"91cbc5c5-0902-57dc-b40a-5bd7e53741e9","task_key":"default--validation--37849","task_revision_id":"1","upstream_id":"37849","short_description":"HellaSwag validation 37849","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help your kids feel safe [title] Brainstorm the plans you need. [step] Sit down with your kids and talk about what safety plans you need to have in place. This is a good way to help them feel safe because it involves them in the planning process, which may help them remember the plan better.\",\"endings\":\"['Consider including things like : [substeps] Having a coach, too. Having someone to supervise your kids during games and practice.', 'It can also help to discuss ideas with your kids and create pieces for them. [substeps] For example, be sure to give some flexibility about how many people can supervise your children to ensure they will be able to each do the same task at the same time.', \\\"It also shows them that you're thinking about their safety. [substeps] Talk about plans to keep you and your kids safe from danger from other people.\\\", \\\"[substeps] Determine what needs to be in place in advance so that you can get them the safest foods, as well as the safest places to sleep when going to bed. List your kids' needs as well as your own needs so that they can be included in each plan.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}