{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"afb7e7bb-c963-5cca-8e0c-0fec9b7681b7","task_key":"default--validation--39731","task_revision_id":"1","upstream_id":"39731","short_description":"HellaSwag validation 39731","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to write historical fiction [title] Recognize the characteristics of historical fiction. [step] In historical fiction, you are using historical fact to create a fictional world. The world of the story should be well-researched and rooted in a real historical time period, with characters who are somehow based on historical figures.\",\"endings\":\"['[substeps] Historical fiction is not the method of creating a fictional world. Even if the book describes fictional people, plots, and events in a real world, it is inadequately supported by the basic facts for your imaginary world.', 'However, you can deviate from historical fact in your fiction and lean on historical fact, as you see fit. [substeps] Good historical fiction writers will have a love for research and history.', 'Being aware of the characteristics can help you create historical fiction. [substeps] Historical fiction does not usually have a structural outline.', 'There are several types of historical fiction : [substeps] The constantly changing world reduces the environment and religion of the world. Unlike fictional fiction, there is little constant change in culture, geography, and history.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}