{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8ce963ce-3941-5dce-a9cc-83f7bbb2afe1","task_key":"default--validation--34876","task_revision_id":"1","upstream_id":"34876","short_description":"HellaSwag validation 34876","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to take viagra [title] Talk to your doctor. [step] You may be a good candidate for viagra (sildenafil) if you are suffering from erectile disfunction, or the inability to hold an erection long enough to engage in sexual activity. It's important to discuss the medication with your doctor to make sure the drug is a healthy choice for you.\",\"endings\":\"[\\\"If you're having trouble with your erections, the doctor may decide to increase the dose or even alter the dosage. [substeps] Look for symptoms of erectal dysfunction and penis dysfunction if you have talk to your doctor.\\\", '[substeps] Talk to your doctor about your options. [substeps] You may want to discuss the dosage and dose of viagra.', '[substeps] Typically, you will need to have \\\" normal \\\" sexual activity with no side effects. For example, you may have a period but experience an erection once you get into the habit.', \\\"[substeps] Inform your doctor if you're allergic to any drugs, so that he or she can determine whether you may be allergic to viagra. Let your doctor know what other medications you're taking, including herbal supplements.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}