{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9f8f1ce3-7e87-568d-b678-738fe6a6600f","task_key":"default--validation--10206","task_revision_id":"1","upstream_id":"10206","short_description":"HellaSwag validation 10206","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become a house sitter [title] Start your resume with a strong headline. [step] The headline should be unique and attention-grabbing (but professional) and should highlight what you feel are your strongest assets. For example, a good headline would read something like, \\\" compulsively clean pet lover seeking an opportunity to house sit in santa barbara.\",\"endings\":\"['\\\" [substeps] Keep a competitive tone, however, so that readers don\\\\'t feel like they should dive in for the kill. In the case of a new customer, you probably might use a strong headline featuring your unique work resources.', '\\\" [substeps] In general, the more descriptive the headline, the more attractive it will be to prospective house sitters. Don\\\\'t explicitly put your personal contact information (such as address or fax number) at the top of the page.', '\\\" [title] Explain why you want to be a house sitter. [step] Briefly describe what attracts you to the idea of house sitting as well as what qualities you have that make you think you would be a good fit for the job.', '\\\" [substeps] Make your topic specific to your particular niche and where you live, and use it to set the tone for the experience and job you are interested in. A large-print but informative text headline should take the attention away from the mundane and onward.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}