{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4975ad62-529d-5f94-9d7f-9b73a7f5744c","task_key":"default--validation--43753","task_revision_id":"1","upstream_id":"43753","short_description":"HellaSwag validation 43753","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach your baby to walk [title] Have your baby bounce on your lap with their feet on your legs. [step] This will strengthen their leg muscles, especially if they are still crawling or just starting to pull themselves up. [substeps] You should also show them how to bend their knees and have them practice bending their knees so they develop the motor skills to stand up and sit down.\",\"endings\":\"[\\\"[title] Take a piece of cardboard, a piece of paper or a book, and put it underneath your baby's grasp. [step] Having your child on your lap holding the cardboard is not easy.\\\", 'You can also supervise your baby while they learn to walk. You can sit on their lap with your arm wrapped around their head.', \\\"Make sure that your baby isn't leaning too far forward or tightly against your chest as they experience physical strain. [title] Have your baby hold their hands up in the air.\\\", '[title] Get your baby a bouncy chair. [step] At around 5 to 6 months of age, provide your baby with a bouncy chair that will help them to start building their leg muscles.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}