{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"00475c2b-3015-52ca-aba8-a7770cc01ba8","task_key":"default--validation--26746","task_revision_id":"1","upstream_id":"26746","short_description":"HellaSwag validation 26746","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to stop older kids from being bad influences on younger siblings [title] Set household expectations. [step] Perhaps the first and most important step in ending any negative influencing is to set household expectations of your children. This will include any rules and regulations that you might expect them to abide by when they are in your home.\",\"endings\":\"['Children need a great deal of structure in order to understand appropriate behavior so give that to them by clarifying the rules. [substeps] Set up a chore schedule for them so they know when and what they are required to do.', 'Be prepared to be a example as you influence your child about basic household expectations. [substeps] For example, your family may need to see you pulling their hair or having them play with their toys more often.', '[substeps] For example, maybe your childhood child has their bedroom in a different part of the house, but still holds a rigid, fixed curfew. Or perhaps you still have a variety of privileges in your daily life that would be too much for the younger child to live up to.', 'Remind yourself that your expectations are allowing you to take your children to school, work, and housework when they are old enough. [substeps] If you already have strict rules, if there are specific conditions that you want to enforce, set boundaries for children to abide by.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}