{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1cf1cebf-e76b-549c-825c-6068a6e00a7f","task_key":"default--validation--29891","task_revision_id":"1","upstream_id":"29891","short_description":"HellaSwag validation 29891","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to introduce a baby to a pool [title] Start with baths. [step] Before you introduce your baby to the pool, you can familiarize them with water through baths. While they bathe, fill a cup with water and slowly pour it over their head.\",\"endings\":\"['The water will help to relieve pressure and relax their muscles. [substeps] If you are using a washcloth or some other soft material, place it over their head so that the water goes directly over their genital area.', 'This will make sure they know they can enter and exit the water without drowning. [title] Place the bath in a safe place.', 'This will teach your child what it is like to be wet. Always supervise your child while they are in the bath.', 'This should loosen their hair a little, allowing them to dip into the water to get a taste. You can also ask a nursery staff to assist you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}