{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc45fb07-1c72-5c2e-a4ab-797874afb2c2","task_key":"default--validation--24351","task_revision_id":"1","upstream_id":"24351","short_description":"HellaSwag validation 24351","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to set boundaries for your kids [title] Set clear rules and boundaries. [step] Make sure your kids know what the rules and boundaries are and that you will enforce rules you set. [substeps] Start giving kids rules at a young age.\",\"endings\":\"['Start with the rule of \\\" no alcohol \\\" and \\\" no playing video games. \\\" when you enforce these rules you are more likely to be caught off guard with the consequences and avoid seeing consequences.', 'Let your kids make their own expectations about boundaries, and make sure that they follow through on them! Continue to have a conversation about boundaries and community goals. Request permissible explanations when your kids are bothering their parents and make sure they understand your expectations.', 'This could include going to different movies and going out on dates. Ask your kids about what rules can be violated.', 'Have a clear bedtime that is non-negotiable when they are young. Once they can understand rules, make it clear that your rules must be obeyed.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}