{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c4dd451b-e219-5948-8b9e-51969a69a9b7","task_key":"default--validation--32214","task_revision_id":"1","upstream_id":"32214","short_description":"HellaSwag validation 32214","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to care for a baby [title] Feed your little one. [step] Nutrition is one of the key parts of having a happy and thriving baby. Feed your little one according to a set schedule and their age, which can help them grow and keep them active and happy.\",\"endings\":\"['[substeps] You should create a space in your house for them to sleep, hunt and explore, eat and drink. There are a number of ways you can provide your baby with food.', '[substeps] Choose to breast or bottle feed newborns and infants. Breastfeeding is recommended because it offers the most benefits for your baby.', 'Aim to feed them 11 to 14 hours a day at a time. Start giving them about 2 tablespoons of formula or 3 tablespoons of water just before bedtime for nighttime feedings.', \\\"[substeps] Preparing and feeding as your baby gets older can also affect the health of your child's body and will cause them to develop a weak immune system. [title] Give your baby foods that are rich in vegetables.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}