{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7b52552e-eba8-5005-9e01-cee360670824","task_key":"default--validation--10344","task_revision_id":"1","upstream_id":"10344","short_description":"HellaSwag validation 10344","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to raise your children to be helpers [title] Call them helpers when you ask for things. [step] Instead of asking for help, ask your child to \\\" be a helper. \\\" all people, children included, are more motivated when their identity is in play.\",\"endings\":\"['When you call your child helpers, describe what they do and what they need to be helped for. [substeps] You could say, \\\" i need you to help dad during his lunch break at work.', 'You can start doing this with your children as early as two years old. [substeps] You might say, \\\" jayden, can you be a helper and clean your bedroom before grandma comes over? \\\" or \\\" please be a helper and stay quiet while your sister naps.', \\\"Call them when you need them for help or for monetary help. [substeps] For example, if you need help with something you don't know how to do, let your child know you're excited to help with this.\\\", 'If you ask your child for things they have access to, it encourages them to put more effort into making things happen. [substeps] To make sure they understand exactly what\\\\'s expected of them, you could try saying, \\\" i\\\\'m looking for helpers who can be helpers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}