{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef49a45e-04c3-5a59-9a0d-afdb2c1e5d4e","task_key":"default--validation--16472--variant-17b4da1c940b","task_revision_id":"1","upstream_id":"16472--variant-17b4da1c940b","short_description":"HellaSwag validation 16472","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to participate in clinical trials [title] Talk to your doctor. [step] If you have a chronic illness or medical condition, your primary treatment provider is your best source for clinical trials that might benefit you. Let your doctor know that you are interested in exploring the possibilities.\",\"endings\":\"['[substeps] Bring your ob/gyn, a professional, with all of your medical information if you are not sure where to begin. Either ask, \\\" what would be the best treatment program for me? \\\" or \\\" do you know of any facilities near me that might benefit me? \\\" [title] Educate others.', \\\"Make sure that your medical provider knows exactly what sort of information you'll want to explore and will be able to help you find the materials you want to explore. [substeps] Even if you don't get infected with lupus, know that you are still a patient for one year, and you will experience no symptoms over time.\\\", \\\"[substeps] If you hear of a trial on your own, bring it up to your doctor and let them know you'd like to participate. They can advise you on whether they think you would benefit from the drug or treatment being studied.\\\", 'If possible, contact your doctor for more information. [substeps] Keep in mind that clinical trials are usually subsidized by a state or federal government agency and some states will not approve conditions they deemed appropriate for clinical trials.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}