{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"198dc50e-0869-5895-acad-10f4f06df455","task_key":"default--validation--43465","task_revision_id":"1","upstream_id":"43465","short_description":"HellaSwag validation 43465","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to obtain a copy of your birth certificate in north carolina [title] Prepare your documentation. [step] You will need proper documentation to submit to the north carolina office of vital records to ensure that there aren't any delays in obtaining the birth certificate. [substeps] You need to have a completed application form to get a copy of a north carolina birth certificate.\",\"endings\":\"['Also, you must have an original and available for security purposes. You also need to have a copy of a valid birth certificate issued by your county registrant or the department of vital records at the time of publication.', \\\"If you are applying for a copy of your own birth certificate, you need to provide a copy of your official photo id. For example, you can provide your driver's license, u.s.\\\", 'You need to submit the application online, at the department of vital records (pcss) website. You also must download and print out an application.', 'The application asks for the following information: your name, address, zip code, and a copy of your birth certificate before you can download the application. Visit https: // vitalchek.com/clerk-designation to apply.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}