{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"382b0b37-0984-5ec9-a5fc-84e00fbdef56","task_key":"default--validation--24010","task_revision_id":"1","upstream_id":"24010","short_description":"HellaSwag validation 24010","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to interact with children [title] Communicate through touch or cuddling. [step] Infants and toddlers (children under the age of 3) may be unable to speak to you, but this doesn't stop them from communicating. Most communication will be done through direct touch.\",\"endings\":\"[\\\"Touch your baby's arm or shoulder. Put your baby's head between your shoulder and the front of your shirt.\\\", \\\"Let children know that you're nearby when they need help, and you'll be there on their behalf when they're ready to talk. [title] Talk with your children when you are worried about them.\\\", 'Whenever you notice a baby or toddler crying or yelling, try holding or cuddling them to reassure them. [substeps] Babies will learn through their sense of touch, what they see and what they hear.', 'A touch on the back or shoulder can convey concern or joy. It is much easier to talk to babies and toddlers if we touch them in this sort of way when they are awake.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}