{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a77e8698-96a9-508b-9d47-f0705f989012","task_key":"default--validation--34348","task_revision_id":"1","upstream_id":"34348","short_description":"HellaSwag validation 34348","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to grow as a writer [title] Expand your vocabulary. [step] You can grow as a writer by taking the time to expand your vocabulary and learn new words. Try to learn one new word a day and use it somewhere in your writing, whether it's in a poem, a short story, or a novel chapter.\",\"endings\":\"[\\\"To keep learning a new word and read it word for word, try to read your new word as it's written. When you read the new word, find a way to use it in your works.\\\", 'The more you learn about the different readers in your own writing, the better you will understand about the writing environment you have. [substeps] One study showed that the indie writers were the most effective writers in doing the rest of their writing.', 'Adding one new word to your vocabulary each day can help you strengthen and deepen your writing. It also allows you to use words that may be unique or surprising to your reader.', \\\"[substeps] Try to start with one word at first and build it up over the course of several days. Even though it may not be necessary to complete several sentences in a single day, it's a good way to warm up.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}