{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3034924e-5bea-5ee2-81a0-fb7b9e5bd0b2","task_key":"default--validation--14712","task_revision_id":"1","upstream_id":"14712","short_description":"HellaSwag validation 14712","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to teach kids to learn from failure [title] Redefine failure as a \\\" learning opportunity. [step] \\\" change the meaning of the word failure in your family's vocabulary. Describe such situations as learning opportunities instead.\",\"endings\":\"['You could teach them that the world and your home are similar, but that they had bad days instead of lessons. [substeps] Try mixing a positive perspective with a positive one for small children.', 'This helps you use setbacks as teachable moments. Over time, your child will stop viewing failure negatively and look for the lesson.', 'For example, \\\" five times i told you something i didn\\\\'t mean (and i wasn\\\\'t able to do it correctly), you didn\\\\'t back me up. \\\" this might be the case, but do not overlook failures like this.', \\\"Remind your family that failure and successes aren't caused by bad behavior, but rather by lessons they're learned from. Praise young children for teaching you lessons instead of lectures or disagreements in a school setting.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}