{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74191c17-8a00-5913-9890-a73c891271b0","task_key":"default--validation--8367--variant-fcbdcca2b2f7","task_revision_id":"1","upstream_id":"8367--variant-fcbdcca2b2f7","short_description":"HellaSwag validation 8367","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to quickly get rid of laryngitis [title] Know the causes of laryngitis. [step] Laryngitis is typically caused by a viral infection such as a cold or bronchitis, and it tends to go away by itself in adults. [substeps] In children, however, laryngitis can cause complications that may lead to croup, a respiratory condition.\",\"endings\":\"['In some cases, a bacterial or fungal infection causes laryngitis. Exposure to a chemical irritant can also lead to laryngitis.', 'For instance, your child might develop a fever, painful abdominal cramps, or neurological problems. These complications often happen between the ages of eight-12 weeks and several months after infection.', 'Stomach flu or meningitis can also cause laryngitis. A large number of immunodeficiency virus infections cause laryngitis.', 'Children also may have abdominal constipation due to the spreading of laryngitis. Adults also experience heartburn due to inadequate vitamins and nutrients, and stomachaches due to food in the environment.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}