{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f28b2a54-455e-5725-a7eb-aaecb5d4b142","task_key":"default--validation--22201","task_revision_id":"1","upstream_id":"22201","short_description":"HellaSwag validation 22201","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to keep children from waking up too early [title] Identify possible reasons for your toddler's early wake time. [step] Many children wake up early in the morning due to noise, hunger, or light. Try to keep a record of your child's sleeping habits for one to two weeks.\",\"endings\":\"['This will help you provide a good, continuous record of his up-to-the-minute habits. [substeps] You might record breakfast, lunch, and snack times.', '[substeps] For instance, if your child wakes up about an hour before naptime, have them break out his ready-made lunch so they can have enough time to eat before naptime. If your child usually wakes up hours before naptime, try a more gradual recording of their wake time.', \\\"Note what time your child goes to bed, what time they wake up, and any naps they take during the day. You should try to identify any patterns in your child's sleep, and if noise, hunger, light or too many naps during the day are causing the early wake time.\\\", \\\"[substeps] Look on your child's waking times and things they engage in during the day and other times they wake up. You might note bedtimes, work/school times, break-ins, or other times that your child felt awake immediately.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}