{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4a85be90-3954-5826-8571-3c34282679d3","task_key":"default--validation--9505","task_revision_id":"1","upstream_id":"9505","short_description":"HellaSwag validation 9505","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to witness a will [title] Ask if you are receiving anything in the will. [step] You might be greatly honored to serve as a witness. However, you shouldn't witness a will if you will receive anything in it.\",\"endings\":\"[\\\"Also, under the law, you have to receive something in the will even if it's an executor's will. [substeps] You should ask if the will was handwritten.\\\", 'The court is unlikely to grant permission to you to witness the will. Nevertheless, you could be somewhat responsible for copying what you wrote in the will.', 'Instead, you should find out if there is anything that the beneficiaries want to preserve. What things do they want to preserve? What do they want to preserve? You should get a list of your assets.', \\\"In many jurisdictions, it's against the law for you to serve as a witness in this situation. [substeps] In some jurisdictions, such as massachusetts and california jurisdictions, you can witness a will even if you are an interested beneficiary of it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}