{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e336fbe8-447b-59a2-b3d0-a2ec578c37a1","task_key":"default--validation--18650","task_revision_id":"1","upstream_id":"18650","short_description":"HellaSwag validation 18650","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to find the causes of tinnitus [title] Consider potential environmental triggers. [step] Environmental factors are influences you experience from the world around you. Prolonged exposure to loud noises is the most common cause of tinnitus.\",\"endings\":\"['You may experience hearing loss at hearing-close your eyes if you can avoid interference. Doing this will also help to reduce signs of tinnitus and make any nearby problems easier to identify.', 'The amount of noise you hear can contribute to the effects of tinnitus. Begin by recognizing that there is an imbalance of noise in your environment.', '[substeps] Environmental triggers are often established through a medical diagnosis. For example, the presence of storms is a viral or offensive cause of tinnitus.', 'Repeated exposure to loud noises, such as amplified music, gunshots, aircrafts, and heavy construction, damage the tiny hairs in the cochlea that send electrical impulses to the auditory nerve if sound waves are detected. When these hairs are bent or broken, they send electrical impulses to the auditory nerve even though no sound waves are detected.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}