{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92142ff6-0b91-5ce9-9229-f7f2229370b9","task_key":"default--validation--21610","task_revision_id":"1","upstream_id":"21610","short_description":"HellaSwag validation 21610","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to help kids grieving the death of their dog [title] Prepare your child beforehand if you can. [step] While you may want to tell the child as soon as you know about the death, you should wait for an appropriate time. Do not tell the child about the dog's death right before they have to go to school or to bed.\",\"endings\":\"[\\\"[title] Prepare your child's bedtime. [step] Make sure that you prepare your child's bedtime how they'd like it to be.\\\", 'This may cause them to have trouble concentrating or sleeping. After they return home from school is a good time to tell them.', 'Let the child know about the death ahead of time. The news could have a negative impact on the child, too.', 'Tell them that they will meet with their teachers about the death and that someone will tell them. If you have a partner, you can also be there for the child so they are not alone with the dog.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}