{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fdfc2ac3-c422-5cf0-8878-cd5189310e9c","task_key":"default--validation--37379","task_revision_id":"1","upstream_id":"37379","short_description":"HellaSwag validation 37379","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to obtain hospitalization insurance [title] Take a look at your current health insurance. [step] Pay attention to what costs are covered if you need surgery or a lengthy hospital stay. This will prepare you for the type of hospitalization insurance you need.\",\"endings\":\"['[substeps] Generally, these are insurance costs which will be covered by your insurance plan as you recover from carpal tunnel syndrome. With carpal tunnel syndrome, benefits from hospital stay are minimal and medical care is minimal.', '[title] Review plans available from your own health insurer and other insurance companies. [step] You may be able to add additional hospitalization insurance to your current health plan, if you have one.', '[title] Ask about the exact coverage you would like to have. [step] The health insurance information sheets section of your yellow pages will give you a breakdown of how much coverage you can require over a specific geographical area.', '[substeps] Illness, physical and emotional health is usually covered in these hospitals, but for health premiums you will need to consider additional health treatment programs. Also look at the cost statement or surcharge you receive as well as your payment history.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}