{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb6d887e-df37-5b46-966c-1de9ae43e9b4","task_key":"default--validation--48849","task_revision_id":"1","upstream_id":"48849","short_description":"HellaSwag validation 48849","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to prepare for scoliosis surgery [title] Find out everything you can about the procedure. [step] As stated above, spinal fusion surgery is not an easy thing to go through. You need to prepare yourself mentally as well as physically.\",\"endings\":\"['Knowing everything you can about the procedure helps tremendously. Ask your doctor as many questions as you can think of, read up about it online, and try to get in contact with someone who actually has undergone the procedure.', 'You may be nervous about your surgery and even manifest symptoms that will come up after the procedure. You may undergo aspiration, a procedure where a syringe is inserted through the vagina and into the bladder.', \\\"It's important to prepare what you're going to do during your surgery, as well as mentally. Talk to your family, friends, and loved ones to see what they do and don't know.\\\", \\\"If you don't understand a part of a skill, you could experience pain and pain as it is applied to the area. Do what you can to become prepared and get yourself involved with the process.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}