{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bdf522fa-36d5-5325-b9f0-8b4a3f23c05c","task_key":"default--validation--10512","task_revision_id":"1","upstream_id":"10512","short_description":"HellaSwag validation 10512","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to get motivated to write fan fiction [title] Read other fan fiction. [step] Whatever website you use for reading and posting fan fiction stories, most likely, it's good to read other people's work before submitting your own. It's a good source of inspiration and gets ideas flowing.\",\"endings\":\"['[substeps] Go online and look over the characters and details of your favorite series or celebrities. It can help to begin a collection of fan fiction you can\\\\'t find online, as there\\\\'s a vast number of sites on the internet dedicated to this \\\" learn now \\\" approach to reading and writing fan fiction.', '[substeps] Read what other fans are reading or talking about. Watch fan fiction on social media, review youtube videos, just to name a few.', \\\"If you're planning on writing a harry potter fan fic, it's probably a good idea to read over a short story or series of one shots of harry potter before you begin your story. [title] Read other material like part of a novel or a magazine article.\\\", \\\"[substeps] Consider talking to writers you know and looking them up online. They're more likely to tip you off to ideas you've never thought of, and they'll get to know you better.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}