{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"61855b99-dd3f-5b68-9bbb-d260ba902cad","task_key":"default--validation--16956","task_revision_id":"1","upstream_id":"16956","short_description":"HellaSwag validation 16956","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to change your toddler's clothes without a tantrum [title] Let your child know that she will need to change soon. [step] Toddlers can get wrapped up in their play and having to stop in order to change their clothes can lead to a tantrum. In order to avoid suddenly making your child stop her play, warn your child about the impending change.\",\"endings\":\"['[substeps] Say things like, \\\" no, you\\\\'re not allowed to play anymore yet. \\\" or, \\\" please don\\\\'t play with her right now.', 'A good time to tell your child is around the first day of school. You could have your child sit down and put a magazine or fruit in her lap.', 'Giving your child a warning can help to make her feel like she is in control. [substeps] However, avoid giving your child a time constraint that actually involves minutes.', '[substeps] Be aware that young toddlers may demand help from others. One good trick you can give your toddler is to calmly let her know that you will make your way back into the living room to change into clothes.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}