{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"479df2c6-599c-584d-b90e-8363adff59c3","task_key":"default--validation--23540","task_revision_id":"1","upstream_id":"23540","short_description":"HellaSwag validation 23540","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to massage a baby [title] Make the baby comfortable. [step] Plan to do the massage in a warm room with dim lighting. It's important to make sure the temperature isn't too cold, since the baby's clothes will be removed during the massage.\",\"endings\":\"[\\\"The heat may also irritate the baby's skin, leading to further irritation. Make sure the temperature is warm-not too hot to be comfortable, but not too low enough to get the baby's legs, arms, face, chest and feet all hot.\\\", \\\"Lay out a sheet, blanket, or old piece of fabric that's not too hot, so it may help keep your baby warm even while you massage him or her. [substeps] If you're watching the baby or going for a walk, make sure you wear socks so the baby doesn't want to splash water on your skin.\\\", \\\"You should also make sure the area isn't too hot. You can either bath bathe the baby or lay them on their back, or you can perform the massage in an oil-based tub.\\\", 'Lay the baby on her back on a soft towel or blanket placed on the floor or a safe flat surface. Put on some soft music if you wish.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}