{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0be7ac40-f484-5e3a-8e54-e663a995ee70","task_key":"default--validation--7881","task_revision_id":"1","upstream_id":"7881","short_description":"HellaSwag validation 7881","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to chat securely on whatsapp [title] Update whatsapp. [step] Both you and your recipient will need to be running the latest versions of whatsapp in order to use the encryption feature. [substeps] Encryption was introduced in april 2016.\",\"endings\":\"[\\\"As long as you've updated your app since then, you'll have access to encrypted conversations. You can check for updates to whatsapp from your device's app store.\\\", 'You will need to update your whatsapp update before that date to protect your whatsapp data from the viruses and malware created by your recipient. Set the updating to somewhere around the time you want your message to be.', 'For those working on whatsapp that live with a mobile devices or use it on cellular networks, you may not need to update whatsapp. Seeders of whatsapp are still not legally allowed.', \\\"With whatsapp's latest version, you won't need to update it after 2014. If you've never collaborated on whatsapp with your recipient, you won't need to update it after 2008, as an ie2 host name can replace the reference your whatsapp device uses for business purposes.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}