{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"753237ca-2672-5366-a68d-3116d53ce479","task_key":"default--validation--35583","task_revision_id":"1","upstream_id":"35583","short_description":"HellaSwag validation 35583","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to have fun with your toddler [title] Have fun with your child by playing active games. [step] At this stage, you need to first provide a safe play environment for exploration. Incorporate activities that give your child the opportunity to choose between things.\",\"endings\":\"['For example, you can play hide and seek or fetch if your child finds that playing fetch is an enjoyable activity. You can also play tag or a blanket catch if your child finds that clicking can help them find something fun.', \\\"For example, you can play fetch, call the monkey, fetch, or go and get milk, just like you would with a real game. [substeps] Don't stop for every level or the child may become frightened and just too immature to play.\\\", \\\"For example, if your toddler loves the eiffel tower, you could use a real tower. But, if your toddler loves photography, you could try children's shows or even earthenware picture frames.\\\", 'You should also try to incorporate physical activities such as throwing and catching a ball, chasing after bubbles, skipping and hopping while singing to her favorite song. [substeps] One creative thing you can do is give your child an empty box.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}