{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"58273aec-22d3-5ab8-8daf-ef5324754d0c","task_key":"default--validation--16419","task_revision_id":"1","upstream_id":"16419","short_description":"HellaSwag validation 16419","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to become a marketing researcher [title] Get a bachelor's degree. [step] The education requirements for becoming a market researcher can vary, but you need at least a bachelor's degree. [title] Choose your major depending on your interests.\",\"endings\":\"[\\\"[step] Different majors require different approaches to market and employees, so your bachelor's degree may not be a good choice. For example, if you love to write video games or design, look for a major that focuses on science or technology.\\\", '[step] To be a market researcher you can major in many fields. Common majors are marketing, economics, market research, math, statistics, and computer science.', \\\"[step] The field to which you want to work may depend on the field that you are applying to, the potential employers who you would like to work in, or your particular research specialty. You'll also need to present to every prospective employer a picture of your prior experience in the field that will make your application more appealing.\\\", \\\"[step] In general, there are nine major majors that you need to be well versed in to become a successful marketing researcher: marketing, sales, journalism, and laboratory research. [title] Pursue a business degree that's relevant to your specific field.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}