{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a69e015e-1dbc-5a03-bd68-cbf6e2f82377","task_key":"default--validation--48184","task_revision_id":"1","upstream_id":"48184","short_description":"HellaSwag validation 48184","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to visit old gravesites for research purposes [title] Find out where your ancestors are buried : [substeps] Ask relatives or friends if they know where family members are buried. Look through old family papers and photos for copies of obituaries, funeral records, or other records that might give you a clue about where to start read back issues of newspapers searching obituaries or funeral notices. They often list the cemetery name and location.\",\"endings\":\"['[title] Determine where your ancestors took their digging bodies. [substeps] Contact books-many have searches there, many of which include lost and found bodies.', \\\"If you know where relatives are buried, find out what the location of the cemetery is. Often, you'll find out by scanning genealogs in your area.\\\", '[title] Research previous headstones and graves in old churches. [step] Check the cemetery information page of a couple of churches with the history of ancient churches.', 'Funeral home records may also provide information on burial sites. Sometimes the records of funeral homes no longer in existence have been preserved at a local museum or library.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}