{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c38713ce-7499-51fd-b284-0782fc358e75","task_key":"default--validation--44198","task_revision_id":"1","upstream_id":"44198","short_description":"HellaSwag validation 44198","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to pay for ivf treatment [title] Inform yourself on state laws. [step] In the us, fifteen states have laws that require insurance coverage for infertility treatments. For information on each states' respective laws, see.\",\"endings\":\"['If you live in any of the following states, you can pay for ivf at least in part with insurance : [substeps] Arkansas california connecticut hawaii illinois louisiana maryland massachusetts montana new jersey new york ohio rhode island texas west virginia [title] Contact your insurance company. [step] If you carry an insurance policy and are considering ivf, call or visit your insurance company as soon as possible.', '[title] Check the number of infertility clinics in your area. [step] The number of infertility clinics in a given area vary greatly.', '[title] Know what contact information for your donor. [step] Even though you might be making ivf treatments for your child, such as money that you no longer can give to your donor, the process is still in place.', '[substeps] You should be aware of the laws. Generally, you need to be covered if you have eggs, are over thirty, do not have other sexually transmitted diseases, have another custodial sex drive, or have already been diagnosed with infertility.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}