{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d8f83901-0954-5b1b-a2fe-ddc12c2b1dee","task_key":"default--validation--38748","task_revision_id":"1","upstream_id":"38748","short_description":"HellaSwag validation 38748","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to get a toddler to wear winter clothes [title] Avoid bulky outfits. [step] Winter clothes should be about more than just keeping your child warm and dry. The outfit also has to fit your child well enough that your active toddler can run around unhindered.\",\"endings\":\"[\\\"Wearing a coat can be a great option if your child prefers a light jacket over a parka. [substeps] Make sure you don't put too much emphasis on this topic.\\\", \\\"[title] Scoop off as much or as little as possible. [step] This depends on your toddler's activity level.\\\", 'In particular, try to pick out winter clothes that are easy to put on and take off, especially if your little one has a tendency to need to go \\\" potty \\\" right after you have put his winter clothes on. [substeps] Steer clear of heavy and bulky winter clothes because these winter garments can make it very difficult for toddlers to move around.', \\\"[substeps] A long-sleeved and bulky coat is appropriate for winters where it's cold weather. The front zip on your child's coat will help for baby's blankets.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}