{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f9165f4-5889-5450-99ef-2961928d342c","task_key":"default--validation--30945--variant-c796443146df","task_revision_id":"1","upstream_id":"30945--variant-c796443146df","short_description":"HellaSwag validation 30945","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to write objectives and key results (okrs ) [title] Write objectives that are qualitative in nature. [step] The objectives of your okrs should communicate something that is important to your company's values and overall mission, rather than focus on hard numbers. Leave the quantitative assessment for the key results portion.\",\"endings\":\"['[substeps] The okrs should aim to make specific goals by packing against errors and brainstorming in the form of a concrete timeline. Do not review the tutorial explanation outlined in the tutorial.', 'The next step is to write objectives that have personal significance to you and your company, over which you can develop key results. [step] You can choose to do these objectives together, or have group friends judge them.', '[substeps] \\\" introduce a new social media channel for marketing \\\" is an example of an objective, while \\\" increase social media traffic by 25% \\\" is an example of a key result. The number of objectives you set can vary.', '[title] Fill in all capital letters right away. [step] Once you have chosen your industry and location, start filling in major capital letters, such as \\\" demonstrate, \\\" \\\" clean, \\\" \\\" integrate, \\\" \\\" create a platform, \\\" \\\" establish an okrs platform, \\\" etc.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}