{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"92ecb4c8-cd66-5ed0-ac1e-f5c8042e2a18","task_key":"default--validation--24754","task_revision_id":"1","upstream_id":"24754","short_description":"HellaSwag validation 24754","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to improve your toddler's eating habits [title] Continue offering new foods. [step] Your child will probably not like a food the first time they eat it. Your child may be resistant to new, unfamiliar foods.\",\"endings\":\"[\\\"As well, a child may not notice if you're just making new food for them. Feed your toddler new treats, new proteins, and more, gradually increasing your offer.\\\", 'Each day you can help address these issues by praising your child and offering to continue offering new foods. [substeps] Be consistent, as your toddler needs to have new and exciting foods.', 'They may also refuse access to new foods. You need to be gentle, empathetic, and loving with your child by making food choices that will keep them interested.', \\\"Sometimes, toddlers get into a pattern in which they want the same thing every day for every meal. This doesn't mean you give up teaching your child to eat new foods.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}