{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"05eac588-3059-53a9-8404-51e8ade205ff","task_key":"default--validation--3858","task_revision_id":"1","upstream_id":"3858","short_description":"HellaSwag validation 3858","config":"default","split":"validation","body":"{\"activity_label\":\"Uncategorized\",\"ctx\":\"[header] How to tell the difference between a pulled muscle or lung pain [title] Consider the duration and type of pain. [step] The onset of muscle pain is usually very different from lung pain. Moderate-to-severe muscle pulls tend to hurt right away, whereas mild strains can take a day or so to become sore.\",\"endings\":\"['Instead of soreness and immediate pain, the pain develops gradually over time. [title] Do not attempt to diagnose the person unless the person indicates they need medical treatment.', 'Describe your symptoms to a doctor, or consult an anatomist or lifter when you describe them. [substeps] Mild symptoms are usually a result of the liposuction, and moderate-to-severe strains can be caused by the liposuction, contracting the muscles, or by insufficient stretching.', 'Acute acute pain usually starts about three to four days after surgery and is often heavier than mild muscle pulls. [substeps] Chronic acute pain begins for three to four days after surgery, and usually lasts up to a week or longer.', \\\"Muscle pain is almost always associated with overexertion or some type of trauma, so the cause tends to be obvious. Furthermore, lung pain usually can't be pinpointed to any moment in time or event and tends to be more constant.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}