{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d21995d-1643-5136-ad48-6562eb5f74ef","task_key":"default--validation--21011","task_revision_id":"1","upstream_id":"21011","short_description":"HellaSwag validation 21011","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to negotiate an interest rate on a lease buy out car loan [title] Consider simply ending your lease. [step] A buy out is just one of your options at the end of a lease. You can also just end the lease by making your final payment and returning the car.\",\"endings\":\"['However, it is not usually enough to end the lease. [substeps] To end a lease with a car rental company, you have to provide that company with a check, a buyer receipt, and some proof that you have saved.', \\\"If you are ready to move on or don't like the car any more, this is a perfectly reasonable way to end the lease. However, you may also choose to buy the vehicle at the end of your lease.\\\", 'The first requirement for an out of control down payment is not to end the lease at all; this is defined as exactly how you intend to end the lease if you fail to make payments during the lease term. [substeps] An out of control down payment happens as soon as you use the loan to get the car out.', 'This also does not require high interest rates and will improve your chances of getting the loan faster and more effectively. If you do decide to end your lease, call your creditor or similar agency to let them know you want to end the lease.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}