{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e1e11eb-da4a-5a7e-ad26-591e48f2b151","task_key":"default--validation--768","task_revision_id":"1","upstream_id":"768","short_description":"HellaSwag validation 768","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to obtain a copy of your birth certificate in kentucky [title] Gather the necessary information. [step] To obtain a copy of a birth certificate in kentucky, you must provide specific information related to the certificate. Have the following information related to the person named on the certificate (you, a relative, etc.\",\"endings\":\"[\\\"): [substeps] Date of birth and place of birth identification number (optional). You do not have to have the person's name, full or former name, or personal statement, but be sure to have the name of the person named on the birth certificate.\\\", '): [substeps] Your title, if you are a decedent. After you completed the registration process (which it is mandatory to do).', '): [substeps] Primary name date of birth the person (up to age of birth) and his/her/their other legal name [title] Locate the birth certificate center in kentucky. [step] Address the newspaper of the county in which the person was born to the person who issued the certificate.', \\\") ready before starting your request : [substeps] Full birth name full date of birth (month, day, and year) county of birth mother's maiden name father's name [title] Go to the office of vital statistics in frankfort. [step] The office is located at 275 e.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}