{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92ca1f50-52fe-551c-bd90-378063be2208","task_key":"default--validation--2244","task_revision_id":"1","upstream_id":"2244","short_description":"HellaSwag validation 2244","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to start a private school [title] Determine the grade levels for your private school. [substeps] How many and which grades will you start with and how many will you eventually grow to include? Many private schools start with fewer and lower grade levels and add upper grades over time. [title] Write a mission statement for the school to focus your reasons for starting a private school.\",\"endings\":\"[\\\"[step] This is a very important column which means it should know about the school's mission statement. [title] Begin to list your own educational goals and goals.\\\", '[substeps] This statement will be the driving philosophy for your educational plans and a way to gather community support. The mission statement should include a rationale for starting your school, your school values, the educational approach, the curriculum focus and goals and planned outcomes for students.', '[step] This will help determine the expectations for the school. For example, some private schools will begin with levels of 5, then 10, then 20.', '[step] Your mission statement should account for all 3, but also include relevant reasons for starting the private school. [substeps] Ask yourself, and what people at the school who might not be doing the same while providing services are doing so.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}