{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d4684f72-8d41-54fe-85bc-811a61a8c432","task_key":"default--validation--31124","task_revision_id":"1","upstream_id":"31124","short_description":"HellaSwag validation 31124","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to write an it strategic plan [title] Outline your corporate strategy. [step] Before you begin defining the strategy within the it department, you must first fully understand the organizations business objectives. This will make sure that your departments strategy will reinforce, rather than combat the corporate strategy.\",\"endings\":\"['[title] Craft a strategy plan that emphasizes strategy rather than regular one-word statements. [step] The strategy plan should be specific to a particular mission or vision, and detail is the key to successfully structure it.', '[substeps] The initial marketing strategy will best provide basic insight that will support your current strategy. The strategic strategy will always present the worst case scenario and will serve to be a productive strategy for each business development strategy.', 'Be sure to address the following areas : [substeps] Company history company description company vision company mission core values company goals financial outlook strategic business objectives [title] Define your it strategy. [step] Once you have a better understanding of how the company identifies itself; where it is and where it would like to be, take a moment to determine how it fits into this model.', '[substeps] For example, consider who is creating the \\\" company strategy \\\". If you own a company, you do not have to outline how you intend to operate the company.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}