{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b31ca9a-1284-51bb-b212-fba0d7d53d5f","task_key":"default--validation--1692","task_revision_id":"1","upstream_id":"1692","short_description":"HellaSwag validation 1692","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to find adoption records [title] Read your state law. [step] Each state decides what kind of information it will release and the circumstances under which it will release that information. To access adoption records, the relevant state law is that of the state where the child was adopted.\",\"endings\":\"[\\\"This might not be the state where the child was born or where you currently live. [substeps] Summaries of every state's adoption laws are available at the child welfare information gateway website.\\\", '[substeps] States normally publish adoption records for specific counties or cities. You have the right to access this information even if the extent to which you intend adoption is negotiable.', \\\"[substeps] Even if your state has a registry, you must first read and understand the law in your state. If you follow your state's registry, you may be able to get records from the state in which you adopt the child.\\\", 'To obtain a copy of your state law, visit. [substeps] You should be able to find copies of other laws on your state\\\\'s website, or by searching \\\" your state \\\" on the internet.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}