{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4f0d9868-17d8-50fa-af04-876cdb6279fa","task_key":"default--validation--29175","task_revision_id":"1","upstream_id":"29175","short_description":"HellaSwag validation 29175","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be curious [title] Read widely. [step] Choosing something you are already interested in makes it easy to start becoming more curious. Reading is one of the best ways to widen your knowledge base.\",\"endings\":\"['There are books and articles written on every conceivable topic, from politics, to cooking, to gardening. Think about your interests, and choose one to start learning about.', '[substeps] If you are not already old enough to read the human food market, read blogs, books, and magazine articles. You can decide which articles are good for you.', 'Learn as much as you can about math, science, and technology. If you have a lot of free time, you can learn things like physics, world history, and geography! [title] Enjoy the learning.', \\\"You can check out blogs, magazines, newsletters, and even online opinions to increase your curiosity. Find a way to build learning skills, however, and you may discover that curiosity isn't all about the world.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}