{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"399187e6-8695-5755-8172-8e066f0db664","task_key":"default--validation--45678","task_revision_id":"1","upstream_id":"45678","short_description":"HellaSwag validation 45678","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to apply for a marriage license in wisconsin [title] Know who can marry in wisconsin. [step] In order to obtain a marriage license in wisconsin, you must meet certain requirements regarding who can get married. The following restrictions and allowances apply in wisconsin : [substeps] Age.\",\"endings\":\"['Any person 18 or older can marry as long as they are otherwise competent. If you are 16 or 17, you must obtain written consent from parents, guardians, or custodians.', 'Wisconsin requires all people between 21 and 45 to obtain a marriage license. If you are unable to obtain a marriage license in wisconsin, the person who can get married must be a resident of wisconsin.', 'If you are applying for a marriage license in wisconsin, you must be an adult, free to marry, and unmarried for 21 years. If you are seeking a marriage license in wisconsin, you must have been 21 years of age before you intend to apply to apply.', 'You must be at least 21 years old when you obtain a marriage license. If you are a man, you can only get married during the two-year period established by the court in your county.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}