{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2276cb5e-7355-5772-a52f-d01d9b6e6c34","task_key":"default--validation--32554","task_revision_id":"1","upstream_id":"32554","short_description":"HellaSwag validation 32554","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get tested for stds without letting your parents know [title] Find out if your clinic of choice accepts walk-ins. [step] At some clinics you can just drop in for an appointment, and at other clinics you may have to make an appointment. Call ahead or visit their website and make an appointment if necessary.\",\"endings\":\"['[title] Go to https: // www.clinicalfrontwe.com /. [step] This is the easiest way to ask if your primary care care clinic accepts walk-ins.', '[title] Know that your doctor and clinic may be private. [step] Talk to your parents about this carefully.', 'Provide as much detail as you can about your concerns. You want the health professionals to be able to help to the best of their ability.', \\\"There are typically free or discounted walk-ins, at which point you can apply at one in your area that will allow you to work with multiple patients. [substeps] You may also find a good opportunity to ask about the clinic's nightly test prices.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}