{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3700a588-c867-545f-8e10-b48a9d29a975","task_key":"default--validation--8008","task_revision_id":"1","upstream_id":"8008","short_description":"HellaSwag validation 8008","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to encourage your baby to build finger muscles [title] Recognize fine motor skills milestones. [step] From birth, your newborn will have a reflexive ability called the palmar hand reflex. This means that when you put an object into your newborn's palm, it will instinctively wrap its fingers around that object.\",\"endings\":\"['However, after about three to four months, those reflexes go away. You can help encourage your child to develop a palmar hand grasp as the palmar reflex disappears.', \\\"This reflex will help to recognize your baby's abilities during active play, which can include playing in front of the tv or learning to move objects. [substeps] This action is now known as twitch.\\\", 'Using this reflexive ability, your baby has the ability to get things right. [title] Understand that good experimentation is key to developing finger muscles.', \\\"[substeps] You may also notice that your baby's hands move together as well. This is a sign of enhanced motor skills because they will be able to shape the object.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}