{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e2dea5ea-da8e-5a70-b454-80226fe68d94","task_key":"default--validation--33393","task_revision_id":"1","upstream_id":"33393","short_description":"HellaSwag validation 33393","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to stay on land through adverse possession [title] Possess the land in a \\\" hostile \\\" manner. [step] You have to make a \\\" hostile \\\" claim on the land. This means different things, depending on the state where the land is located.\",\"endings\":\"['For example, \\\" hostile \\\" possession could mean : [substeps] You know you are trespassing. Some states define \\\" hostile \\\" as knowledge that you are trespassing on property.', 'The first step is to bring a lawyer, who will discuss how to proceed. The law has changed in the u.s.', \\\"In florida, for example, you'll have to file your claim in the county where the land is located. You also may go through the state courts.\\\", 'Typically, the \\\" hostile \\\" license is only valid for one state. [substeps] For example, texas usually considers the land a government asset.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}