{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"35d72aa1-89bd-5f2f-9da1-25994693fb3c","task_key":"default--validation--30064","task_revision_id":"1","upstream_id":"30064","short_description":"HellaSwag validation 30064","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get baby to sleep on back [title] Feed your baby. [step] Hunger can make it hard for your baby to fall asleep, so feeding your baby near bedtime may help him fall asleep. Try feeding your baby about a half hour before you lay him down.\",\"endings\":\"['However, think of some ideas, as your baby can be a big support during his daytime sleep. [title] Hold your baby when he is relaxed.', '[substeps] Provide him a quarter cup of milk at 8.5 am on the weekends. If your baby gets the sweet taste in the milk before bedtime, pause feeding the baby to allow your baby to adjust to his environment.', \\\"[substeps] Make sure to avoid your baby's eyes opening until 6 a.m. and stay awake for about an hour before you put him back down.\\\", \\\"[substeps] Do not let your baby to have a bottle in bed because this can cause the bottle to become a security item and make it hard for your baby to sleep without it. It can also increase your child's risk of dental problems, including cavities.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}