{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0aebbfa6-e138-58a0-988c-55366bd44942","task_key":"default--validation--27137","task_revision_id":"1","upstream_id":"27137","short_description":"HellaSwag validation 27137","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to limit your toddler's sugar intake [title] Remove junk food from the house. [step] One way to limit the amount of sugar your toddler eats is to keep all junk food out of the house. Your child won't have access to them, so eventually they will be less likely to ask for them if they are not around and they don't see them.\",\"endings\":\"[\\\"Focus on limiting their junk foods, and raising your child as a parent. [substeps] Keep cookies, cakes, and cupcakes out of your toddler's room during the day.\\\", '[substeps] When the sugar dish is full, ask your child why it is being served in the house. And try to put it into the refrigerator as soon as possible.', \\\"It can be helpful to keep the refrigerator full of your child's favorites. Just make sure the containers are in a neat and secure location.\\\", '[substeps] Designate a cheat day for your toddler, where they get treats they like. This can be a weekend day, like a saturday, or an after dinner treat.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}