{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f56b6d6-469a-51ce-9936-342f40dbbc8f","task_key":"default--validation--47965","task_revision_id":"1","upstream_id":"47965","short_description":"HellaSwag validation 47965","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to avoid sibling rivalry [title] Treat your children as individuals. [step] At a certain point, children want to feel separate from their siblings. They will develop their own interests, skills, and talents to develop their sense of self.\",\"endings\":\"[\\\"One way to help avoid this occurs by treating your children as individual individuals. [substeps] If you child feels smothered and isolated by your sibling, that's also a sign of sibling rivalry.\\\", 'This will have a negative effect on your household and your children as well. Try not to treat siblings in a milder manner, and instead try to respect their differences and develop new interests.', 'Encourage this by treating each of your children as an individual. This will help your child form a healthy identity separate from his or her sibling.', \\\"Your children will likely develop their own ideas about what they should do as children. Respond to your children's tendency to act like siblings in regard to things you do.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}