{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"969fd983-af00-5977-9249-b89a8b440731","task_key":"default--validation--2829","task_revision_id":"1","upstream_id":"2829","short_description":"HellaSwag validation 2829","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to increase your baby's chances of being smart from womb to birth [title] Give your baby a name as soon as you know the sex of your baby. [step] This will help you to communicate with your beloved baby. [title] Stay active.\",\"endings\":\"['[step] This means swimming, playing fetch, swimming, breastfeeding, or picking up your baby. Keep your baby on his feet with his back turned.', \\\"[step] During labor, your baby's body learns to regulate its temperature very quickly. So, when your baby is first born, it needs to be active, hence increasing its chances of being able to use heat.\\\", \\\"[step] While you are taking care of your baby, don't be discouraged by laziness. At the core of being smart is being active: take about 30 minutes daily to walk, play, and talk to your baby.\\\", '[step] As your pregnancy progresses, your fetus will acquire more skills. He/she will be able to kick, move, see, hear, suck his/her thumb, have some taste selections for music and even food.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}