{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c6abf03c-9ffa-52f2-9e12-b9be6d07e44c","task_key":"default--validation--37542","task_revision_id":"1","upstream_id":"37542","short_description":"HellaSwag validation 37542","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to spot the difference between normal anxiety and anxiety disorder [title] Identify the timing of the anxiety. [step] Normal levels of anxiety may occur right before or during an event. You may feel stressed out or anxious because of the situation, and this is often normal.\",\"endings\":\"['However, if you have an anxiety disorder, then you may be anxious for days or weeks leading up to an event. The time you spend feeling anxious may be much greater than the situation warrants.', \\\"If it's something relatively minor, sometimes normal anxiety might occur spontaneously. Other times, it may happen immediately after an event, and often more frequently throughout the course of a day or holiday.\\\", 'However, anxiety can occur near major events, as well. If someone has both of these symptoms, that person may be under stress.', 'However, anxiety may also occur while going on a date, seeing a friend, or going to a social event. [substeps] To recognize the timing of your anxiety disorder, take notes of when you felt anxious the prior to your date.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}