{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"06ecefe7-42a9-5eb2-a5a7-15e654b703e3","task_key":"default--validation--13453","task_revision_id":"1","upstream_id":"13453","short_description":"HellaSwag validation 13453","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to defend against intrustion of solitude claims [title] Identify the elements the plaintiff must prove. [step] Intrusion of solitude is a state tort. Although each state's law will vary somewhat, the plaintiff must typically prove the following : [substeps] Without authorization, you intentionally invaded the plaintiff's private affairs.\",\"endings\":\"[\\\"Because the plaintiff waited for permission to do so in advance, you invaded the plaintiff's private or protected privacy. Because you used obscene or hazardous materials in violation of a state law.\\\", '( note that this intrusion does not need to be physical; spying and eavesdropping also qualify. ) the invasion would be offensive to a reasonable person.', 'For instance, some laws restrict how the plaintiff can enter the state property protected under the law. One disadvantage of intrusion of solitude is that the plaintiff cannot tour the state property, which cannot be used to defend you in court.', 'Trespassers violate the law because they are not citizens of the state. At a minimum, trespassers cannot sue for invasion of privacy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}