{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c3da01c0-55b0-570a-9c0d-dec35c9d8ae9","task_key":"default--validation--13119","task_revision_id":"1","upstream_id":"13119","short_description":"HellaSwag validation 13119","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help a child who stutters [title] Initiate conversations with your child frequently. [step] You can have your child practice proper word formation at a time when you think fit. Try to pick a time that your child is calm and not too distracted.\",\"endings\":\"['Chat in a calm fashion with your child, and let your child get distracted while you talk. [substeps] Do not force your child to talk in front of another child or noisy space.', 'Patiently and calmly allow your child time to complete their sentences and let them talk without any interruptions. [substeps] Dinner is a great time for family conversations.', \\\"Perhaps another time of day when the child is relaxed and can be quite attentive is probably good. [substeps] Don't wait until the child is extremely busy first.\\\", '[substeps] Schedule group-time after dinner when your children are not stressing about their early morning run. Spending more time in the evening or at a time you know your child is likely to be calm will also keep your child from quickly becoming impatient.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}