{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7b32b68-01a1-5677-8ba2-61cd854205d2","task_key":"default--validation--8355","task_revision_id":"1","upstream_id":"8355","short_description":"HellaSwag validation 8355","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to spot fraud [title] Understand that money does not come free--unless you win the lottery--and that you will have to work for it. [step] So if you are offered free money for no reason, you are being scammed. Oftentimes, free money scams come in the format of an email from someone stating that they need to transfer a large amount of money into an account.\",\"endings\":\"['You will have to be an active investor in this scam. [substeps] If you were offered free money, you would never have been this scammed.', \\\"They will pay you a percentage for your time, or course, but you just need to send your bank details. Don't ever send your bank details, or any other personal information, to a complete stranger.\\\", '[title] First you need to be able to present proof that the money you are paying for is free. [step] You need to show the cashier that the money you are paying for is free.', 'When you are offered free money, you are offered it immediately to cash in. Knowing your limits increases your chances for being scammed.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}