{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"79fe0c1a-a4a3-58cf-8aa2-c5f905d0ce87","task_key":"default--validation--28225","task_revision_id":"1","upstream_id":"28225","short_description":"HellaSwag validation 28225","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to introduce toddlers to music [title] Play music throughout the day. [step] Many people use tvs as a way of calming down or entertaining a child, but you can use music for the same purpose instead. Whether you're at home or in the car, chances are you have access to music.\",\"endings\":\"['Find music they can enjoy and play it throughout the day. [substeps] Try playing music that your toddler can relate to, such as bright tunes, books, exercise music, or radio.', 'If you find that you tend to stay up later on weekends, purchase a large, portable high-volume volume stereo system so that you can play music in the hours the kids spend playing. Speakers require lots of batteries, and will fill up if toddlers, themselves, play instruments.', \\\"You might even find that you can plug in your headphones and play music at the same time, which can distract you and keep your toddler occupied while you're on the road. Playing music rather than simply listening to it can keep your toddler from becoming impatient.\\\", 'Simply let it play in the background while you two go about your daily business and your child will be automatically immersed. [substeps] You do not necessarily need to purchase any new music in order to introduce your child to music.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}