{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e14d752-5f02-5aea-9230-2c3831c4efac","task_key":"default--validation--14061","task_revision_id":"1","upstream_id":"14061","short_description":"HellaSwag validation 14061","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to distinguish civil and criminal law [title] Identify the parties to the case. [step] One of the key distinctions between civil and criminal law is who initiated the proceeding. Civil cases have plaintiffs which are private individuals or businesses, while criminal cases are initiated when government attorneys file charges.\",\"endings\":\"['[substeps] If a case title lists the names of private individuals or organizations on both sides of the \\\" v. \\\" it is assuredly a civil case.', '[title] Identify the party in charge of the lawsuit. [step] States and territories have an obligation to distribute civil and criminal law around.', '[substeps] The case is settled if an individual or business seeks to legally represent the person or business who committed the dispute. With these cases, an individual or business can file a lawsuit in civil or criminal court.', \\\"In a civil law case, the party who initiated the proceeding will submit a written case or oral complaint. [substeps] For example, you might have a state party at the scene of the incident that died in ford county's offensive conduct and his or her attorney contracts with their opposing counsel.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}