{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"32305638-0677-54a3-9abd-9db61fe0f30a","task_key":"default--validation--24156","task_revision_id":"1","upstream_id":"24156","short_description":"HellaSwag validation 24156","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to arrange a funeral [title] Notify the authorities of the death if they don't know yet. [step] Alert the deceased's medical provider or the emergency response service in your area. They'll legally declare that the deceased has passed, which is needed when obtaining the death certificate.\",\"endings\":\"['[substeps] You can preserve the death certificate for later. It will be preserved when you file an official claim and keep it with the funeral home in case your claim resolves.', \\\"[title] Arrange for a private funeral company to transport the deceased body or transfer him to a place of mass when it's time to transport the body. [step] Cremation is highly restricted in this case, so it's better to get the death certificate and burial by private transport.\\\", '[substeps] Additionally, tell any friends or relatives that may be involved in or taking more part in the death process. It might be handy to have a few dozen funeral directors on hand so that you can touch base with them at another time regarding the vital records for the deceased.', '[substeps] If this happened in a hospital or another facility, the staff will take care of this for you. [title] Call or visit a funeral director to begin planning.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}