{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"83308673-cbc5-58a4-ad9b-a173fe9b62bb","task_key":"default--validation--43933","task_revision_id":"1","upstream_id":"43933","short_description":"HellaSwag validation 43933","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to protect your writing against plagiarism [title] Avoid publishing online. [step] When you publish something online, you give the entire world access to your work. People can and will steal from you.\",\"endings\":\"['If you are worried about plagiarism, then you should avoid publishing your work online. [substeps] Unfortunately, refusing to share online can also limit your ability to reach readers.', \\\"[substeps] Keep your website private, and don't tell anyone you report bifiably by email. However, if you want the people to suspect that you publish, it is best to do so carefully.\\\", 'Finding the right audience for your work may prevent that. [substeps] Magazines and newspapers are one thing, but trade publication can also be problematic.', 'Most of those people will commit to anonymity. Do not read your work and, more importantly, do not accuse other people of plagiarism.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}