{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b153015e-dd10-50ee-ad28-353a49a56b1c","task_key":"default--validation--15053","task_revision_id":"1","upstream_id":"15053","short_description":"HellaSwag validation 15053","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to protect yourself from phishing attacks on facebook [title] Verify that the facebook platform you're using is legitimate. [step] The individuals behind phishing attacks, also known as \\\" phishers, \\\" may redirect you to malicious websites that are designed to resemble facebook pages and applications. [substeps] Look at the web address in the address bar of your internet browser to determine if you are on facebook's domain.\",\"endings\":\"['You can get the domain url available in the google play store app. Visit steam login website to confirm that the address you chose as an account is authentic as well as accurate.', 'The domain will then share with other users. A myspace domain will allow you to access facebook but is not customizable.', \\\"If you're logged in, register for the account. Password-protected accounts are not protected by any other security measures on facebook.\\\", 'All legitimate facebook web pages reside on the domain of \\\" facebook.com. \\\" [title] Examine unfamiliar website links provided to you by facebook users.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}