{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bcec3e2a-39f7-58dd-8e9c-3a64f1d0cd77","task_key":"default--validation--41230","task_revision_id":"1","upstream_id":"41230","short_description":"HellaSwag validation 41230","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to find administrative assistant jobs [title] Search online. [step] There are many career websites that advertise administrative assistant jobs in every area and every industry. [substeps] Check out the major sites, including careerbuilder.com and monster.com.\",\"endings\":\"['Put your city and state into the search fields to narrow job listings to your area. There are also sites such as indeed.com and simply hired.com, which collect job openings from all online sites and provide you with those listings.', 'Most of these sites allow applicant applicants to easily work out of various departments. Look at the search engine to find jobs.', 'Many of these websites are looking for administrative assistant jobs. [title] Ask a current job agent for a recommendation.', 'As long as you like the websites and have a good understanding of keywords used in the job search, you can often improve your chances at finding the perfect job. You can also work out general search engine optimization and keyword analytics, either by looking for job sites through searches on google or by talking to some guides online.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}