{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"abc491d8-174b-5e5a-8314-1b31eb9cb20e","task_key":"default--validation--5539","task_revision_id":"1","upstream_id":"5539","short_description":"HellaSwag validation 5539","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to run in high heels [title] Choose comfortable shoes with low, wide heels. [step] The wider the heel, the better your balance will be. Make sure they're the right fit for your foot and won't chafe or pinch.\",\"endings\":\"[\\\"Support your heel with both hands to steady yourself as you walk. In high heels, you might go for a fuller stride with a wide heel that doesn't swing to the side.\\\", \\\"[title] Measure with a tape measure if you want to find your heels 10 to 12 inches (25 to 30 cm) wide. [step] In some cases, the shoe's heel measurement will be the same, while in other cases, it's the opposite.\\\", \\\"[substeps] Shoes with zippers or laces (such as boots) will stay on your feet more securely while you run. If you can kick them off easily without using your hands, they're probably not secure enough to run in.\\\", 'Feel for comfort so you can push yourself up and down as you run. [title] Pick flats that pull smoothly on your foot.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}