{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f1ba57a-8a91-54fd-89ac-a5edcad5fca8","task_key":"default--validation--46289","task_revision_id":"1","upstream_id":"46289","short_description":"HellaSwag validation 46289","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to fix a toddler's chapped lips [title] Apply an oil-based product to your toddler's lips. [step] There are a number of ointments and oils that might fix your toddler's chapped lips. For instance, you could wipe a thin layer of petroleum jelly, olive oil, or vegetable oil over your child's lips.\",\"endings\":\"['[substeps] You can purchase or make your own ointments at your local supermarket or pharmacy. Most ointments and oils are acrylic, though some may be biodegradable.', \\\"Don't use it too much though, because you don't want to draw blood. [substeps] Go over your child's lips with a brush before applying your product.\\\", \\\"[title] Moisten your toddler's lips. [step] If your toddler is very dry, there are products designed to help ensure your toddler's lips don't dry out.\\\", \\\"You could also pierce a vitamin e capsule with a pin and squeeze a bit of the oil inside onto their lips. [title] Apply lip balm to your child's chapped lips when they go out in cold, dry weather.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}