{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef296acb-da78-565a-ad47-be563e6ca3b2","task_key":"default--validation--13065","task_revision_id":"1","upstream_id":"13065","short_description":"HellaSwag validation 13065","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to donate blood [title] Determine whether you're an eligible donor. [step] To give blood, you must be at least 17 years of age and a healthy weight, usually 110 pounds or heavier. In some places, you can donate blood as young as 16, provided you can show proof of parental consent.\",\"endings\":\"['Call your local blood center ask about what they look for in a donor. [substeps] A few factors that may disqualify you from donating blood include having a cold or the flu, pregnancy, sexually transmitted diseases, and organ transplants.', \\\"It is vital to know your parents' consent prior to collecting the blood. Though you may be eligible for donation directly from your parents, it is usually in your best interest to do so.\\\", 'Keep in mind that in most places you can give blood, most people are eligible for social security disability, but not everyone is eligible. For example, many places only allow anyone 18 years of age to donate blood.', 'Individuals unable to consent to donate blood must provide proof that the recipient is an eligible donor. The person is not connected to state or federal agencies or voluntary government organizations that may conduct this process, which may simplify the process.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}