{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c974c32d-0d6c-5f86-b7f0-20898ed44ac2","task_key":"default--validation--33638","task_revision_id":"1","upstream_id":"33638","short_description":"HellaSwag validation 33638","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find the origin of your last name [title] Look at the prefix in your surname. [step] The prefix is the first two or three letters of your surname. The prefix was often added to notate if the head of your family was the \\\" son of \\\" or the \\\" daughter of \\\" the head of their family.\",\"endings\":\"['This prefix should be easily found under the name \\\" * \\\" or from your mother-just like lamilos. [title] Look at the social media profiles of other lps in your family.', 'It is important to find the prefix in your surname, as it may help confirm your parentage or determine the source of your name. [substeps] To look up the prefix, say \\\" michael drake.', 'Certain prefixes come from specific places and cultures, such as gaelic, irish, and english. Your surname may have prefixes like : [substeps] \\\" mac \\\" or \\\" mc, \\\" such as \\\" macdonald \\\" or \\\" mccloud.', 'Look at the second and third letters of your surname. [substeps] Look for the prefix above the suffix \\\" k \\\" on their last name (e.g.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}