{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cfef830a-23d4-5b5c-b2e3-44eeb54f3ddc","task_key":"default--validation--21938","task_revision_id":"1","upstream_id":"21938","short_description":"HellaSwag validation 21938","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become a forest ranger [title] Discover what a forest ranger does. [step] Learning more about the details of the position can help you to learn if the role of forest ranger is right for you. Understanding as much as you can before you pursue the position will also help you best direct your efforts if you do decide to become a forest ranger.\",\"endings\":\"['[substeps] The main role of the forest ranger is to protect and preserve publicly owned lands. Forest rangers will work with and educate the public about conservation of the wilds.', '[substeps] Forest rangers work with different levels of the forest, but are typically hired to help animals such as frogs, lizards, and small aquatic creatures. Forest rangers must have training that includes hiking, stealth, and field-based training.', '[substeps] In order to become a forest ranger, you must be aware of the training and knowledge required to get in college or even passing the geogram exam. Most forest rangers do not offer training or knowledge to students with a significant degree in the field.', '[substeps] The description the forest ranger performs during the course of its teaching works. This represents what they do in the classroom, as well as what their two jobs (for both students and families) are and whether they are courteous and respectful of others.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}