{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4497ee3-5147-59d5-a94c-c5c0b04aa1eb","task_key":"default--validation--16813","task_revision_id":"1","upstream_id":"16813","short_description":"HellaSwag validation 16813","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to learn chinese pinyin quickly [title] The way to know how to speak chinese is by learning the phonetic or pinyin system. [substeps] Over the years, many different romanization systems have been devised to pronounce chinese characters. The most commonly used romanization system for speaking chinese is pinyin.\",\"endings\":\"['As much as possible, consider incorporating one of the following in your vocabulary: pinyin/followed by gi/shown, hakashi and eechi bind words together in syntax, so that they form a single word. Pinyin/followed by gi/picture, bezobi, meaning \\\" checked \\\".', 'Pinyin is a very complex system that requires a considerable amount of practice, and a relatively small number of people are proficient at it. This is because pinyin is often understood in chinese people as it incorporates various mandarin characters rather than singular characters, and thus introduces new characters frequently.', '[title] Know the pinyin system, remember each vowel/consonant, and master the sounds by heart. [substeps] Spend enough time on practicing until you can memorize and pronounce each sound properly.', \\\"Pinyin's characters are 82 , 82 and 273 characters. Hakakio is also used by chinese nikamen.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}