{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab39b564-699f-5c01-81e0-cc7833d2d3a7","task_key":"default--validation--50569","task_revision_id":"1","upstream_id":"50569","short_description":"HellaSwag validation 50569","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become an animal behaviorist [title] Learn about being an animal behaviorist. [step] Animal behaviorists investigate the causes, functions, development and evolution of behaviors of a specific animal or groups of animals. If you like working with animals, this might be a rewarding career path for you.\",\"endings\":\"['[substeps] Investigate the different types of work you could do. These include government agencies or other public and private institutions such as universities or museums, or even with pets.', '[substeps] Many animal behaviorists focus on the problem and whether or not the problem actually affects us as a whole or a group. This is an important practice as animal behaviorsts often focus on issues that lack organic influence and encourage introspection rather than empathy.', 'Be sure to fill out or keep a study guide, or even a notebook, to help learn about becoming an animal behaviorist. [substeps] Other career paths include the resources for a good school for animal studies, the resources for animal behaviors in your community, and/or in group work with office workers, professors and other working people.', 'Though it might not always be right for you to work with animals, being an animal behaviorist can provide you with a solid foundation upon which to begin your career as an animal behaviorist. [substeps] Having a job in a field you enjoy working for are especially useful during the early stages of your career as an animal behaviorist.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}