{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14df1240-a0cc-5911-a10c-d30d6fa97a82","task_key":"default--validation--11663","task_revision_id":"1","upstream_id":"11663","short_description":"HellaSwag validation 11663","config":"default","split":"validation","body":"{\"activity_label\":\"Pets and Animals\",\"ctx\":\"[header] How to administer shots to dogs [title] Review the release forms. [step] When you purchase vaccinations or other medicines from a veterinarian to administer yourself, you will have to sign a release form. Read this form carefully.\",\"endings\":\"['Make sure to identify the type of medication, whether or not it is nonprescription, and the dosage you are giving your dog. [substeps] The release form should contain the names of high dose doses (2 to 5 ml) or between 15 to 30 mg/kg tablets.', \\\"These forms include important information about your pet's health history, including when the vaccine began and where it was administered. You will also have to sign your medical papers.\\\", 'It will tell you exactly what kind of medication to give and if you will need any special treatment. The form can include things like vaccinations, shots for engagement with particular breeds, or antibiotics or corticosteroids and medicine for poor quality or high quality dogs.', \\\"Not only does it provide valuable information, it helps you understand your responsibilities when you decide to administer shots yourself. [substeps] By signing the release form, you accept full responsibility for your pet's injection and any reactions or accident that might occur.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}