{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74a81689-6e81-5556-8ad8-3a0a58d04442","task_key":"default--validation--29210","task_revision_id":"1","upstream_id":"29210","short_description":"HellaSwag validation 29210","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to get free diabetes supplies [title] Obtain insurance. [step] If you do not have insurance already, you should enroll in an insurance program. Insurance can provide free or discounted diabetes supplies under basic coverage.\",\"endings\":\"['[substeps] Shop for free food, easy-to-ensure services, and health items at your local supermarket. Shop for supplies according to your needs and budget.', 'Oftentimes, you may not be able to make health counseling every day, but you can buy the right supply of help. Talk to your insurance provider to find out if they have insurance.', '[substeps] You can enroll in an insurance program through healthcare. Gov, a public database provided under the affordable care act.', \\\"These goods, however, must be covered by your business and cannot be purchased without a sponsor. [substeps] Diabetes insurance is not covered in cases where you can't purchase the equipment you need.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}