{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5e1a8a64-6465-5d70-b4f6-01a0aca77c48","task_key":"default--validation--33714","task_revision_id":"1","upstream_id":"33714","short_description":"HellaSwag validation 33714","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to balance work and parenting as a single parent [title] Set a schedule for the kids. [step] You'll find that caring for your children will be a whole lot easier if you get them on a schedule. Have a set dinner time where you all eat together and discuss your day.\",\"endings\":\"[\\\"Make bedtime routine for them and make sure they're in bed at the same time each night. [substeps] Include extracurriculars like soccer and dance class in this schedule, as well.\\\", 'You could also spend a friday or saturday afternoon together. This will break stress down into small steps, which can make it easier for your kids to go to school on time.', 'Set aside time to do chores on the weekends with the kids. Set up a family night out where each member treats the other as family.', 'Plan some time for activities in the evening, like other days, and a little time for quality time with the kids. [substeps] Be early to dinner as this will help cut down on the need to cook or clean up on the weekends.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}