{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a9253ad6-02b1-5282-9725-495b757e8a85","task_key":"default--validation--37690","task_revision_id":"1","upstream_id":"37690","short_description":"HellaSwag validation 37690","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop kids from being afraid of monsters [title] Search for monsters. [step] Ask your child where she thinks the monsters are-under the bed, in the closet, and so on. Then look for the monsters together, and show your child they don't exist.\",\"endings\":\"['[substeps] You don\\\\'t want to just say, \\\" there\\\\'s nothing there; go to sleep, \\\" nor do you want to encourage the fear by pretending the monsters are there and you can remove them. The best way to tackle the fear is to actually show your child that the monsters aren\\\\'t real and they have nothing to fear.', \\\"Obviously it's easier said than done, but you are bound to be surprised at how many creatures there are. [title] Make room for horror that your child hasn't ever seen.\\\", 'If some kids are scared of monsters, look for them too, to have fun with them. [substeps] You can draw pictures of the monsters for your child to draw as she watches it all.', '[substeps] Give your child suggestions so they think about what to look for. Something from your own childhood can help teach your child exactly where monsters are.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}