{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c407c189-f5a5-5ddc-a76c-8466e4336a48","task_key":"default--validation--41322","task_revision_id":"1","upstream_id":"41322","short_description":"HellaSwag validation 41322","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to start your own business in the travel industry [title] Understand the travel industry. [step] First you need to familiarize yourself with different aspects of travel industry. Get as much information as possible about air travel, rail travel, cruises, hotels and vacation destinations.\",\"endings\":\"['[substeps] You will need a passport of any residency level you plan to enter and basic college education in the field of travel as well as what you intend to do in the travel industry. Contact travel websites such as myspace.com.', '[substeps] Also take advantage of new contacts, like colleges and universities, in order to better understand their business and how they grow. Have your professors or landlords refer you to an airline agent or a cruise agent to help you learn more about traveling.', 'Also, go online and sites like airways, airfare and facilities companies to see how active they are in these areas. [substeps] Understand that airlines can have access to updated data resources including news, phone numbers, mail, and the like.', 'Also learn about what type of travel packages are popular among customers and so on. [substeps] You can search the internet or find books at the local library to help you research the many facets of the travel industry.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}