{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fb279ad1-aed1-587f-bb8e-8dcd67f1cda1","task_key":"default--validation--26409","task_revision_id":"1","upstream_id":"26409","short_description":"HellaSwag validation 26409","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to test for parkinson's disease [title] Watch for tremors in your hands and/or fingers. [step] One of the first complaints presented to doctors by many later diagnosed with parkinson's disease is an involuntary tremor or shaking of the hands, fingers, arms, legs, jaw, and face. [substeps] There are many causes of tremors.\",\"endings\":\"[\\\"Parkinson's disease is one of the most common causes, and tremors are often the first sign of the disease. The tremor and other symptoms may initially appear only on one side of the body, or may appear worse on one side than the other.\\\", 'There is no scientific proof for their physical symptoms. However, in most cases, the shakes can be the result of poor nutrition, poor sleep, poor exercise, and very low sleep on the day of your appointment.', 'If you have too many to look for, go online to find the newest symptoms. Certain instances of tremors may be a sign of another disorder.', \\\"They include illness, financial activity, or injury. Parkinson's disease does not always cause tremors.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}