{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"da507c65-238d-5596-9662-61722548d2a6","task_key":"default--validation--37498","task_revision_id":"1","upstream_id":"37498","short_description":"HellaSwag validation 37498","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to treat a sinus infection for a toddler [title] Recognize the symptoms of a sinus infection. [step] Sinus infections in children are characterized by persistent cold-like symptoms. Sinusitis can be caused by a bacterial, fungal, or viral infection.\",\"endings\":\"['Sinus infections are most common in children between the ages of 10 and 14. [substeps] Infections are usually recurring for only a short period of time.', \\\"The infection may enter the body through your child's mouth and veins. Symptoms of a sinus infection in pregnant women and children include : [substeps] A fever that is debilitating a swollen nose fever fever cough swelling of your skin lymph nodes or lower cloaca [title] Seek medical attention.\\\", '[substeps] Cold-like symptoms of sinus infections include persistent sneezing, coughing, and congestion that lasts for two weeks or more. In addition, your toddler may have green nasal discharge and sore throat.', 'It can also be a sinus condition, like dropsy or measles, that can cause sinus irritation and a sinus infection. [substeps] Excessive inflammation of the sinuses can lead to a weakened immune system.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}