{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f439e50c-40b0-5d07-8680-7f756d56abc1","task_key":"default--validation--32716","task_revision_id":"1","upstream_id":"32716","short_description":"HellaSwag validation 32716","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to create an organization chart [title] Look at how your organization makes decisions. [step] Most businesses are generally either arranged horizontally or vertically. Horizontally means the structure of power is spread out among employees.\",\"endings\":\"[\\\"There isn't really enough room to make all of the decisions. If you're part of a bigger, more complex business, the structure of your organization could be extremely different.\\\", 'Vertically means that those who are able to manage a large portion of the business are more clear about which direction each side is heading in. You should examine where each employee is going.', '\\\" divided \\\" means that all employees have a right to a certain part of a business in order to operate it. On the other hand, in a rule-based structure, each employee\\\\'s right to a different part of a business may be limited in one particular way or another, depending on where the president or executive officers live.', 'A vertical structure means that the power in the company is primarily hierarchical, moving from general employees to middle managers and then to top managers. [substeps] In a horizontal system, more employees are empowered to make decisions.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}