{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbb896be-d595-5b38-9a2c-561e9f92b816","task_key":"default--validation--13982","task_revision_id":"1","upstream_id":"13982","short_description":"HellaSwag validation 13982","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to do shin hugs [title] Start with reclining shin hugs. [step] In yoga practice, you may hear reclining shin hugs referred to as reclining knee-to-chest pose. This is an easy way to start releasing tension in your back and opening up your hips without having to worry about balance.\",\"endings\":\"['[substeps] Get into this pose by lying on the floor on your back with your arms and legs extended straight out. On an exhale, bend your right knee towards your chest and clasp your hands around your shin.', '[substeps] To do this pose, get into a sitting position with your feet firmly planted on the ground. Keep your knees up and your hips toward the sky.', \\\"Sit on the mat and with your backside firmly held, your legs splayed, try to extend your leg out so that it's straight as though it were a straight line from your toes to your back. Keep your arms in a natural position straight out in front of you.\\\", 'Your back should be straight and your abdominal muscles tight. [title] Get into reclining shin hugs while sitting in a chair and with your back straight.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}