{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2db73ee2-a8b1-5e98-88db-457d516a8b99","task_key":"default--validation--6122","task_revision_id":"1","upstream_id":"6122","short_description":"HellaSwag validation 6122","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to choose healthy snacks for your toddler [title] Serve fruit. [step] Fruit is one of the best snacks you can provide your toddler. Not only does fruit contain many vitamins that your toddler needs to grow healthy, but they contain fiber.\",\"endings\":\"['Toys like bananas and strawberries are also good options. [substeps] Another good option to ensure that your toddler has healthy snacks is nuts and seeds.', \\\"Ultimately, by serving your toddler fruit, you'll be creating the foundation of healthy nutrition habits for the rest of their life. [substeps] Provide fresh fruits like apples, peaches, pears, bananas, grapes, strawberries, and oranges.\\\", \\\"Here's how to help your toddler choose healthy snacks : [substeps] Toddlers generally need a variety of fruits and vegetables each day. There is no point in eating more than you are able to consume.\\\", 'Fruit also contains a lot of nutrients, including fiber. Giving your toddler healthy snacks will also improve their overall health; offer fruits for baking, coffee, breakfast, and veggies.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}