{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a63d0104-7b2d-5a2f-9852-c6b53f852661","task_key":"default--validation--37145","task_revision_id":"1","upstream_id":"37145","short_description":"HellaSwag validation 37145","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to work the front desk at a hotel [title] Search for job openings. [step] Search the websites of hotels in your area for job openings. Make sure to search popular job listing sites as well, since many hotels use these systems to post openings.\",\"endings\":\"[\\\"[substeps] If you're unsure if a particular hotel is hiring, reach out to the clerk of the hotel's register office who will tell you whether a new receptionist will start working. Some hotels may not have individual hiring systems, so keep an open mind as you search.\\\", 'Additionally, contact your local chamber of commerce and tourism boards to find out when job fairs are being held for hotel positions. [substeps] Plan on attending job fairs to find out about new positions, as well as insights on the industry.', '[substeps] There are several companies offering jobs at hotels in the u.s. [title] Apply for an entry-level position at another hotel.', 'Once you find an advertised job, apply to fill that role. [substeps] Look for positions that are listed in the hotel bar tab.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}