{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"508ba9cb-5e45-507b-b55d-0f6698321bae","task_key":"default--validation--39312","task_revision_id":"1","upstream_id":"39312","short_description":"HellaSwag validation 39312","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discipline someone else's child [title] Ask about special challenges. [step] Before having a playdate or inviting another child over, ask the parent if there are any challenges you might anticipate. The child might have food allergies, take a nap at a certain time, or have problems sharing toys.\",\"endings\":\"['Tell the parent exactly how you envision challenges they might face, and encourage the child to ask them. This will help guide the child in developing skills, and could help your child become more aware of difficult situations.', 'Briefly ask the parent ahead of time if there are any considerations or challenges you might face or your child might experience. [substeps] Say, \\\" are there any things i should be aware of for your child\\\\'s diet or behavior? \\\" [title] Inquire about their home discipline.', \\\"[substeps] Make sure the child takes individualized precautions to enforce the rules. At first, let the parents know if it's okay to punish the child since they'll be watching the kid through the entire outing.\\\", 'Also, you might not want to completely ignore what happens to the child. Even if he plays with his toys, the parent might still treat him with pride.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}