{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72ad4376-858f-5701-8b35-25aafb61ae22","task_key":"default--validation--28523","task_revision_id":"1","upstream_id":"28523","short_description":"HellaSwag validation 28523","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to handle your baby's stranger anxiety [title] Notice signs of anxiety. [step] Signs of stranger anxiety can begin as early as four months. Some babies may go quiet or look at the stranger with fear.\",\"endings\":\"['Others may have nervous signals or shake their heads from time to time. You may notice that the stranger is always looking around or doodling on a book.', 'Others may start talking quietly at night and ignore the baby. [substeps] Babies may have a hard time recognizing even the most seemingly innocuous things.', 'You can help deal with this by observing how your baby fills her head with fear. [substeps] The child may also start acting out, starting biting her nails or looking at strangers quietly.', 'Others may become clingy or bury themselves in you. Some children begin to cry, scream, or become fussy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}