{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a59460bd-30b8-5f00-9deb-1f0572e10036","task_key":"default--validation--23119","task_revision_id":"1","upstream_id":"23119","short_description":"HellaSwag validation 23119","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to discipline a 4 year old [title] Set up your home to prevent the need to discipline. [step] You can create an environment in your home that saves you and your child from the needing to work on discipline unless it is necessary. By setting your home up so that it is safe and child-friendly, you will prevent having to create too many rules or say \\\" no \\\" too often throughout the day.\",\"endings\":\"[\\\"Keep factors like the household, what school and daycare your child attends, and any other perks in mind. [title] Pay attention to your child's environment.\\\", '[substeps] Set up different cleaning schedules for your home. Maintain separate times for grocery shopping or daily cleanings.', \\\"[substeps] Use child-proofing devices to keep cupboards closed. Close doors to rooms where young children won't be safe if they are on their own.\\\", 'Here are some suggestions : [substeps] Have a designated area in your home that is private and away from the reach of children. Make the room light out as the child is sleeping so you can see better.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}