{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b61cf965-8508-5175-975e-fff3024261ed","task_key":"default--validation--47884--variant-6bc4d003a507","task_revision_id":"1","upstream_id":"47884--variant-6bc4d003a507","short_description":"HellaSwag validation 47884","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to tell a cold from flu in toddlers [title] Look for signs of the common cold. [step] Although runny nose, dry throat, and mild body aches are also signs of the flu, your child might show distinctive signs of a cold. You might notice your toddler sneezing or coughing more.\",\"endings\":\"['Their eyes may also water if they have a cold. [substeps] It can be hard to determine, but if your child has mild headaches, they may have the common cold.', 'Some babies are naturally immune from each disease, so he or she might show only mild cold symptoms. [substeps] Give your child a home health alert on the flu if he or she displays unusual symptoms.', 'Be sure to check for these signs before and during visiting them. [substeps] If your child has a sore throat or runny nose, go see your pediatrician if you suspect the possibility of a flu.', '[substeps] For instance, your child might have thick mucus than normal and a strong nose. Something like a stuffy nose or dry mouth might not indicate a cold.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}