{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4daaabed-5108-55bd-9991-3abcf3a3ed4e","task_key":"default--validation--42805","task_revision_id":"1","upstream_id":"42805","short_description":"HellaSwag validation 42805","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to care for your new baby [title] Support your baby's head. [step] When you pick your baby up, be sure that you are supporting the head and neck. Babies have little muscle development in this area and if they do not have support when lifted, they can become seriously injured.\",\"endings\":\"['[substeps] Give your baby plenty of support so that they can stand and walk. Encourage them to keep their head bent and not awkwardly relax their neck and shoulders.', 'Your baby will never be perfect and they could easily injure themselves if they are not supported all the time. [substeps] You will need to support their head and neck by gently placing their head and neck on a small flat surface.', \\\"[substeps] Pick up your baby by their hips and arms and place them on your lap so they can't nip at your legs or nose. If your baby is lying on their side, it's probably a good idea to sit near their head to monitor their development and so reduce friction.\\\", \\\"Lift them delicately and cradle their head as you do so. [title] Don't worry too much about the soft spot.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}