{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9fc152c2-7373-5e5c-999a-a6140ad49b95","task_key":"default--validation--22186","task_revision_id":"1","upstream_id":"22186","short_description":"HellaSwag validation 22186","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to use yoga mudra for thyroid conditions [title] Find a time and place to practice. [step] Mudras can be done anywhere, anytime. However, you'll need to keep your hands still throughout the practice.\",\"endings\":\"[\\\"Sit in a chair, and get in a comfortable position to begin practicing. [substeps] When you're ready, you can start performing the mudra.\\\", '[substeps] Watching tv or listening to the radio are great things to do while practicing a mudra. The length of the show can help you keep track of the time you spend in the mudra.', \\\"You don't want to be distracted when you're moving an object, and you don't want to disrupt any visible movements you need to take. Get loud in the room, and look for an open place or a space that will work.\\\", \\\"You'll also need to pay attention to your breathing during the practice. Take a weekend trip to a yoga retreat.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}