{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4442ea81-1e95-55f2-88c7-958ca9bded6b","task_key":"default--validation--38402","task_revision_id":"1","upstream_id":"38402","short_description":"HellaSwag validation 38402","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to deal with a fear of surgery [title] Learn about your procedure. [step] The unknown often causes fear. Educating yourself about your procedure is an important first step in overcoming your fear of surgery.\",\"endings\":\"['Finding the right person to encourage you to do it for a reason can be a rewarding experience for you and will increase your confidence when the time comes. Even for a small surgery, it is safe to think about it.', 'Remember that most people have their doctor determine their md status. [substeps] Do not assume that you always have surgery on your legs.', \\\"You can do this by reading relevant material from reputable sources both on and offline, and-most importantly-talking with your surgeon about your specific surgical procedure. You could also talk to others who have had similar or identical surgeries as the one you'll have.\\\", \\\"[substeps] Learn everything you can about your procedure (about the operation procedure and other types of surgery). If you don't already know, some types of family members, patients or hospitals may understand you better if you do more research.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}