{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d20525f8-4c7a-5738-885b-430f649ac5e5","task_key":"default--validation--2792","task_revision_id":"1","upstream_id":"2792","short_description":"HellaSwag validation 2792","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to improve your children's sibling relationships [title] Treat your kids fairly and be consistent. [step] If you're lavishing praise and gifts on one child but not the other, the neglected child will feel sad and/or angry. Similar feelings might occur if you're constantly punishing one child but not the other for the same offense.\",\"endings\":\"['Instead, you should treat your kids like you would anyone else. For instance, instead of saying, \\\" whatever you did at your brother\\\\'s party, congratulate him on that accomplishment! \\\" your kids may want to please you.', \\\"Good example: every time your child reaches for their older sibling's food while another child gets the same coveted item at the same time. Often, this child feels suffocated by jealousy and wants to make you feel bad for the sibling's actions.\\\", 'This is because much of the fault and neglect of those children really comes from them as well. If there is the same child in every relationship, that child becomes dependent on the love and attention the children give them.', \\\"The anger might be directed at the sibling, at you, or at both of you. From the child's perspective, you and the favored sibling are in cahoots against them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}