{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8d30d9ea-009e-511b-b748-89a6f62f8cee","task_key":"default--validation--7140","task_revision_id":"1","upstream_id":"7140","short_description":"HellaSwag validation 7140","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to make your toddler laugh [title] Play peekaboo. [step] Babies and toddlers typically enjoy and find humor in being surprised. When you are playing with your child, take your hands and place them over your eyes and then remove your hands and say' boo! ' you can even encourage your child to play too by having them place their hands over their own eyes instead.\",\"endings\":\"['[substeps] You may find that your toddler prefers a peeking child version of peekaboo. You can then play peekaboo while your child is sleeping or snoozing.', '[substeps] Pretend to laugh while your hands are over your eyes. Your toddler will likely be amazed at how silly you look when they learn that their hands are not touching your face.', '[substeps] This works particularly well when you are physically very close to your child or they are seated in your lap. Try not to hide your face for too long, or else you might stress out the child.', 'This also works best if your toddler feels like he or she has been swiftly told to play peekaboo. [title] Find some treats for your toddler.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}