{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a58d47aa-7ad7-5733-893f-e174e5a57557","task_key":"default--validation--23329","task_revision_id":"1","upstream_id":"23329","short_description":"HellaSwag validation 23329","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to overcome trypophobia [title] Understand trypophobia. [step] People who have trypophobia suffer from an irrational fear of clusters of holes. Some examples of triggers include bubbles, lotus flowers, and aerated chocolate.\",\"endings\":\"['Each individual may feel more anxious on the first day of middle school if they know that people in their classes will think about them all day long. Some people may panic or end up having a panic attack at the first signs of anxiety.', \\\"Trypophobes report nausea, trembling, and severe anxiety when confronted with their triggers. Unlike some phobias that may dominate people's thoughts, trypophobia seems only to affect sufferers when they see holes.\\\", 'Common triggers include : [substeps] Birds overhead branches telephone poles workplace work unexpectedly [title] Recognize symptoms of hypophobia. [step] Anxiety triggers are persons experiencing negative thoughts and feelings during certain activities.', \\\"This fear is usually about exponential equations and can influence your choices. If you're trying to overcome a phobia of clumps, you must build up an courage-based phobia.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}