{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5d990aa2-7a79-56fe-b8b2-6a8004b99d16","task_key":"default--validation--10359","task_revision_id":"1","upstream_id":"10359","short_description":"HellaSwag validation 10359","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get a marriage license in england [title] Meet the age requirement. [step] You and your partner must both be at least 16 years of age when you give notice at the register office in the area of england where you want to get married. You must be able to produce a birth certificate or other proof of age if asked.\",\"endings\":\"[\\\"[title] Review the requirements to become a british citizen. [step] Each citizen of england's state has different requirements for being a british citizen.\\\", \\\"The typical age requirements for a marriage license are five years and an adult's original license not more than two years old. The residency requirements for a marriage license are three years and a half.\\\", '[substeps] Couples between the ages of 16 and 18 who are from england, wales, and northern ireland will need written permission from parents or guardians. Foreign nationals under the age of 18 are not allowed to get married in england, even with parental consent.', '[substeps] Both parents must have been certified for marriage within the past two years. If you are 18 months old, you must have a valid social security number, a military id, or a photo id.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}