{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4551c166-b696-5c3c-9ee5-b52951a66d7d","task_key":"default--validation--30595","task_revision_id":"1","upstream_id":"30595","short_description":"HellaSwag validation 30595","config":"default","split":"validation","body":"{\"activity_label\":\"Home and Garden\",\"ctx\":\"[header] How to reduce your fall risk with exercise [title] Talk to your doctor and a physical therapist. [step] When you are deciding to start an exercise program, you should talk to your doctor and/or a physical therapist about your plans. This is particularly important if you have mobility issues or trouble with physical activity, as your doctor can help you determine what is safe for you.\",\"endings\":\"['No matter what your physical fitness level is, you can be more active and get on a program to strengthen your body. A physical therapist can help you come up with an exercise plan to help reduce your risk of falling.', '[substeps] Your physical therapist may also be able to suggest other exercise programs that you could try. If you want to start a new exercise program, discuss the options the therapist has expressed with you.', 'You may also want to consider home safety measures before starting the program. Taking steps to make sure your home is not subjected to any hazards can be a great way to improve your health and minimize the risk of falling at any point in your exercising regimen.', '[substeps] The therapist can help you define your fitness goals and form a plan that will be convenient for you while you exercise. The physical therapist can help you describe your exercises to her and other physical therapists so that they can give you guidance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}