{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0c48778e-2461-5126-b653-36a961def36a","task_key":"default--validation--7862","task_revision_id":"1","upstream_id":"7862","short_description":"HellaSwag validation 7862","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to find out how your spouse is doing in rehab [title] Check the facility's rules. [step] Each rehab facility has its own rules regarding when and how often patients may communicate with family and friends, and what methods of communication can be used. [substeps] Typically there is a blackout period during the first few days your spouse enters treatment.\",\"endings\":\"['After this period, your spouse or caregiver will stay outside of the facility for 1 hour minimum. That period may vary depending on where your spouse lives, but is usually 7 to 10 hours maximum for doctors visits and visitors.', \\\"You won't be able to communicate with them at all during that time. After that period is over, most facilities have specific, limited times during which patients can make phone calls.\\\", \\\"This indicates that you are concerned for your spouse's well-being as treatment approaches. In addition to this, social media websites are often shared with the patient.\\\", \\\"Every two weeks, your spouse will request that you contact the facility. You may limit the time you visit after your spouse embarks on treatment by keeping an eye on the facility's social media accounts.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}