{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a3a8c42f-d320-5d94-ac2d-e3409a13b6c2","task_key":"default--validation--5682","task_revision_id":"1","upstream_id":"5682","short_description":"HellaSwag validation 5682","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to bathe a toddler [title] Run the bath until it is about 15 centimeter (5.9 in) high (half a ruler), then turn the taps off and dip your elbow in. [step] If it's nice and hot to you, add a little cold. If it feels just a little bit too cold for your usual bath, it's the right temperature.\",\"endings\":\"['[title] Soak your child in the bath. [step] That is, if you and your toddler are in a large tub, try squirling some warm water over your child.', '[title] Place your shower head in the water first and submerge your toddler in it. [step] It helps to soak your toddler in the water, but make sure they can see it and will not be ruined.', \\\"Add some bubble bath and bath toys for your child if you'd like. [title] Undress the toddler and lift them in.\\\", 'You can use a misting thermometer in the bath to see how long it should be. [title] Gently lower your toddler into the tub or bathtub, holding a hand towel in front of them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}