{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"40c8b955-55de-530c-bd93-86dccb5e9a7a","task_key":"default--validation--2656","task_revision_id":"1","upstream_id":"2656","short_description":"HellaSwag validation 2656","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to vote in uk elections [title] Find out if you are eligible to vote (you have to be aged eighteen or over, and either a british, irish, maltese or cypriot national. [title] Register to vote. [title] You can go to www.aboutmyvote. Co. Uk and fill out the online registration form.\",\"endings\":\"['[title] Get a summary of all the vote holders for the uk elections. [title] Contact the elections office and tell them that you are a member of the british electorate.', '[title] Put your name into the form, as well as your registration address and the names of your friends. [title] Indicate your voting place in the uk.', '[title] You can wait for the annual canvass which is between august and november when a form will be sent to your house. [title] You can contact your local registry office who will then guide you through the process.', '[step] This form asks for a series of questions about voting, including basic information like your country of residency, your social security number, and your legal name. You will also need to prove your financial status, as well as specific disclosures such as cancelled checks or bank accounts.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}