{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d688498a-5b39-50c1-a89b-0ecf5c2b14f7","task_key":"default--validation--24900","task_revision_id":"1","upstream_id":"24900","short_description":"HellaSwag validation 24900","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to write a book series [title] Choose a genre for the series. [step] Some genres, such as fantasy, science fiction, and mystery, are more amenable to a series than others, like romance or commercial fiction. Decide whether your concept fits into the former or the latter.\",\"endings\":\"[\\\"[substeps] Children's and young adult fiction are other genres that are suitable for series building. Some publishers prefer fantasy series over individual fantasy novels, because fantasy series tend to sell better than standalone fantasy books.\\\", '[substeps] Some genres, such as: horror, sci-fi, adventurehood, and cosmopolitan have the potential to outshine the horror genre, but are also vastly much more taboo and unpredictable. [title] Consider the genre in which the series are published.', \\\"But, though you don't have to go all out and steal the same sex people, you should still be honest about your need. In most books, each genre of writing the series will have different goals, and should develop each story before sharing.\\\", \\\"This will vary, and make your book series easier for you to write. [substeps] If you're not sure what genre to choose, try imagining that your book series is based around a human human character or a fictional character in your local area.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}