{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69a3985c-39b4-5d28-b1ae-2b4d7659e13d","task_key":"default--validation--20278","task_revision_id":"1","upstream_id":"20278","short_description":"HellaSwag validation 20278","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to diagnose septic arthritis [title] Recognize risk factors. [step] Individuals of any age can develop septic arthritis. However, some people may be more susceptible to this condition.\",\"endings\":\"['Children, older adults, and illegal drug users are more likely to have septic arthritis. Other risk factors include : [substeps] Having existing joint problems such as gout or lupus.', 'Schedule an appointment with your healthcare provider to learn more about the risk factors associated with septic arthritis. [substeps] People who use a wheelchair often experience a more frequent flare up.', 'If you suspect your younger child might be likely to develop septic arthritis, make sure you take him or her to an emergency care facility in the future. Knowing what risk factors your child may face can help you rule out other risk factors as well.', \\\"When the disease spreads, it's at risk of getting worse. Potential causes of septic arthritis include cirrhosis, viral or bacterial infections, strokes, and mono-physiological attacks.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}