{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"644157fc-3488-5ef7-bd9e-c490e1fbe34e","task_key":"default--validation--10430","task_revision_id":"1","upstream_id":"10430","short_description":"HellaSwag validation 10430","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to find a job in healthcare administration [title] Research jobs. [step] One of the best ways to get your job search started is to do some research. Use career search databases to find out what types of healthcare administration jobs are available in your area (or in areas you would like to live).\",\"endings\":\"['A list of career fields will help you figure out what speciality jobs are being offered and when you might eventually start working at a local health care office. [substeps] Keep in mind that all job possibilities will depend on the number of healthcare administration jobs you look at and your level of experience.', 'Even if your degree is not in healthcare administration, finding online job listings can be a good way to locate a job in your specific area. [substeps] Many professional organizations and the national association of healthcare administrators put in ads on the internet about the job hunting process.', 'As you conduct your research, think about which jobs match up with your qualifications. Save jobs that are appealing to you and make notes about which ones you like best and why.', '[substeps] The united states department of health and human services has a database of all sorts of jobs available to us in healthcare administration. It is available in the following locations: the u.s.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}