{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef115622-4dd0-5bd2-8c42-f5d69f9821a4","task_key":"default--validation--21915","task_revision_id":"1","upstream_id":"21915","short_description":"HellaSwag validation 21915","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to declutter when you have kids [title] Do one room at a time. [step] Toys and children's things seem to make their way into every corner of the house. To prevent yourself from feeling overwhelmed, choose one room at a time to declutter.\",\"endings\":\"[\\\"For example, if you have five shelves with children's toys or books : [substeps] Put all five shelves back. Label them one by one to create an area free from clutter.\\\", 'Instead of trying to go through closets, break down room items into ten piles; in no time at all you will have broken down each pile into 25-50 different piles. [substeps] Start by cleaning only your closet shelves.', 'Many people do this only occasionally, but if you do come across items that you no longer need, go through it one more time. [substeps] Start by scattering a few toys, games, books, and any other accessories at your disposal in the room where you have your kid.', \\\"If you're up for a challenge, sort through your child's bedroom or playroom first. Or if you'd like to start small, choose a room that happens to have some of your kids' things, like your bedroom or the bathroom.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}