{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69953d5a-68f9-5566-999c-7c25b7e8df46","task_key":"default--validation--49045--variant-816efb386eef","task_revision_id":"1","upstream_id":"49045--variant-816efb386eef","short_description":"HellaSwag validation 49045","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to write a corporate profile [title] Keep your corporate profile concise. [step] Make your corporate profile interesting and easy to read by keeping it as simple and brief as you can. Many readers will simply scan the document, digesting key phrases and concepts.\",\"endings\":\"['Information relevant to your company should be stated as clearly and concise as possible. [substeps] The operations and management section of your corporate profile should include as much data about your company and your particular industry as possible.', 'Instead, stick to one or two main points which you can relate directly to the main concepts in your corporate profile. [title] Make the work well-paced and timely.', 'However, they will usually need to understand how your company is run and how it is organized. Keeping your corporate profile concise can also help you to maintain your relationships with the company, which will signal to potential employers that you value their services.', \\\"Corporate profiles can be just a few paragraphs or over 30 pages long, but think about what information is really important before you choose a long-form profile. [substeps] If you're creating your corporate profile online, keep it short by linking to more detailed information on separate pages.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}