{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dc878db6-e935-5789-b896-edd47feabb84","task_key":"default--validation--39068","task_revision_id":"1","upstream_id":"39068","short_description":"HellaSwag validation 39068","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to open an encrypted email on pc or mac [title] Exchange digital ids with the sender. [step] You must do this before they send you the encrypted message. To do this, send each other digitally-signed emails.\",\"endings\":\"['When the sender opens the email you will see your name and a notification letting them know that the email is encrypted. [substeps] After sending the email, you will be given 20 minutes to set up gmail (or other email transfer protocol), confirm you want the sender to clear the folder on your pc.', 'This will link up the email and your country code together to create a encryption. [substeps] You can only exchange international email information with the sender.', \\\"[title] Add the sender's digital id to your contacts. [step] This way, any encrypted emails from that person can be opened by you.\\\", 'To do this, you should take a copy of the message once you send it. Do not share your identity with anyone other than yourself as it would be illegal to transmit illegal messages.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}