{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"97108754-8582-5dc1-af72-b7945837d529","task_key":"default--validation--24855","task_revision_id":"1","upstream_id":"24855","short_description":"HellaSwag validation 24855","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to memorise the periodic table [title] Identify the different parts of each element. [step] Generally, to learn the periodic table, you will need to know the element's name, symbol, atomic number, and occasionally the atomic weight. These are all contained within the element's square on the table.\",\"endings\":\"['[substeps] The element name is the word associated with the element. It usually appears in small letters under the symbol.', \\\"Some basic pieces of information will help you remember the element's element. [substeps] The element's constellation is the rise, setting on which it is due to rise.\\\", '[substeps] In the periodic table, you are looking for primary and secondary elements that group together. You may find the element information connected to the atomic weight during math check-ups, or you may find the element information later in a spreadsheet.', '[substeps] The periodic table will depict the 4 elements related to atoms in the atom, from which atoms exist. Moles will be divided into uniform bases, which should be level even though the atomic weight is not indicated.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}