{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"13f9b611-742d-5460-b871-5b3032bfb486","task_key":"default--validation--47766","task_revision_id":"1","upstream_id":"47766","short_description":"HellaSwag validation 47766","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to evaluate a nursing home [title] Look for nursing homes online. [step] Start by doing an online search for nursing homes in your area to get an idea of what your options are. Great resources for finding services include eldercare locator, aging and disability resource centers (adrcs), centers for independent living (cils) and medicare offices.\",\"endings\":\"['Doing basic preliminary research will give you a sense of what is available for your family member. Look on the websites of nursing homes in your area to see which nursing homes offer the medical services and attention that your family member needs.', \\\"Some of the largest nursing homes in the world are in the united states. [substeps] Every state has a website that displays your state's nursing home directory.\\\", \\\"With access to these resources, you can narrow down your options from there. Visit your state's health office or their website and inquire about nursing homes available.\\\", 'Once you have a list available, focus on approaching your nursing home in person to begin. [substeps] Visit these centers for your insights into what services they provide.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}