{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b7d4da5f-8ed7-5802-be0f-616f6b2f1183","task_key":"default--validation--12637","task_revision_id":"1","upstream_id":"12637","short_description":"HellaSwag validation 12637","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to write a request letter [title] Find the company you want to work for. [step] Search job postings to see if anyone is hiring your skill set, but sometimes it can be difficult finding jobs that are out and actively recruiting. There are times when it is best to inquire directly with a desired company as to whether they have any room for your unique set of skills.\",\"endings\":\"['[substeps] In canada, this process traditionally follows an 11 day survey (i). By examining job titles and grade level, you will learn about your desired future employer.', 'Here are some place to start : [substeps] Each \\\" that \\\" is a website that is looking for additional skills. For example, ask about being a 10 year associate on a government working committee.', '[substeps] Gather the contact information for any placement you want to apply for on their website. Some companies may have special applicants completing specific letters of recommendation, often referred to by letters of recommendation.', 'Figure out which one you are writing the letter for. [substeps] Do research on the company so you can know exactly what it is they do, stand for, and could be looking for in a new employee.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}