{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b669e070-06c3-5963-a701-78191f53f4df","task_key":"default--validation--32643--variant-396de1786c04","task_revision_id":"1","upstream_id":"32643--variant-396de1786c04","short_description":"HellaSwag validation 32643","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to sell to hospitals [title] Learn about hospital regulations and standards. [step] For a vendor, the products and services offered need to be good enough to fit the hospital's mandatory standards for purchase. Read up on medical regulations in your state or area and make sure that your wares comply.\",\"endings\":\"['[title] Find out what kinds of services you need. [step] Every hospital should be outfitted with an array of medical equipment.', \\\"[substeps] Standards for hospitals are usually determined regionally or by state. Different states may have different regulations, so it's important to know the standards for the state you're selling in.\\\", \\\"[title] Learn about the hospital's language, practices, dress code, and fee structure. [step] There are many variations that can cause illness, so learn from a reputable vendor.\\\", \\\"[title] Set up an account through the department of hospital. [step] Look online or in a certain database like the hospital's website for information on vendors in that area.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}