{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f5575cd0-8f1b-5a4e-8fd0-5e8d7400328d","task_key":"default--validation--39064","task_revision_id":"1","upstream_id":"39064","short_description":"HellaSwag validation 39064","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to do yoga with your dog [title] Start with relaxed breathing. [step] To relax yourself and your dog, start by sitting down with your legs crossed. Your dog should be sitting near or on you.\",\"endings\":\"['Start to breathe, focusing on each inhale and exhale. Start thinking about your dog and becoming in sync with him.', 'Open your mouth to breathe freely and fully. Keeping your mouth closed, take in a deep breath.', 'Gradually lower your sitting leg to the floor and keeping your bouncing knee closer to your chest. You do not want your legs dangling out but instead should be relaxed.', 'Slowly raise your feet to about shoulder width. Holding your feet on the floor, lower your upper body and knees to the floor.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}