{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7536732-20c7-50bb-b099-671cbb0203d5","task_key":"default--validation--35591","task_revision_id":"1","upstream_id":"35591","short_description":"HellaSwag validation 35591","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to be a strict mom [title] Make it clear what the rules are. [step] Do not expect your children to read your mind. When you set rules, explain them to the entire household.\",\"endings\":\"['Enforce your limits and rules in certain ways. For example, if your child always goes to school without adult supervision, make it clear that this behavior happens every day and is to be expected.', 'For example, if there are four children in the house, explain that children should only have access to the least amount of supervision. If children are sick or injured, they should be allowed in a daycare.', 'You can even post certain rules on the fridge. This will help your children understand how to act in the house and why you are disciplining them when they get in trouble.', 'Ask your children to follow the rules one way and then follow them the other way. Make sure that everyone understands that there are consequences when the rules are ignored.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}