{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"add81491-e893-56fa-a62c-39227d06abd3","task_key":"default--validation--13664","task_revision_id":"1","upstream_id":"13664","short_description":"HellaSwag validation 13664","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to cancel a real estate contract [title] Recognize the difference between buyers and sellers. [step] If you are in the market to buy a house, it should be easy to break off an arrangement with a real estate agent. As a seller, however, you will find that your agent has invested considerable money toward advertising your property and might be disinclined to let you go.\",\"endings\":\"['To maintain a good record of customer service, most will allow you to end the relationship, but you could encounter some difficulties. [title] Look for an opt-out clause.', 'If this is the case, you will have to agree to the terms of the contract as well as pay out of pocket. [title] Obtain one loan from a seller who can offer you good credit.', '[substeps] By selling your home, you bring in that money. Although it is not part of your total purchase price, it certainly gives you and your agent considerable leverage in selling your home.', 'You must identify and address the person you wish to cancel your contract with a reasonable degree of respect and professional demeanor. [substeps] They may be able to provide you additional information or suggest some alternatives to make the matter easier.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}