{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f89a13e3-f1b8-5969-b07d-e5c55c2c2ed0","task_key":"default--validation--1567","task_revision_id":"1","upstream_id":"1567","short_description":"HellaSwag validation 1567","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to understand qi gong [title] Learn what qigong is. [step] The word qi (pronounced \\\" chee \\\") means \\\" energy \\\" and the word gong (pronounced \\\" gung \\\") means \\\" exercise \\\" or \\\" practice. \\\" it is a system that involves static postures, dynamic movements, meditation, and focus on breathing in order to learn to balance the qi flowing through your body.\",\"endings\":\"[\\\"[substeps] Not only does qigong cause lung blocks, it's also difficult to move too quickly. You can't activate qi gong with the simple concept of rem (long drawn out breath) breathing.\\\", \\\"[substeps] Ta'an is a universal balancing of energy between energy and what is called qi gong. It is a council for the three classes of qi gong, lead by mom, nightna, and kali.\\\", \\\"[substeps] Qigong is a form of physical expression in which qi gong is passed through the body. The chinese word for qi gong is' tambourine'.\\\", '[substeps] Qigong believes in gathering \\\" life force \\\" through these different methods. It also believes that this vital life force is all around us, but that we must learn how to use it effectively.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}