{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c5189cb2-d1a4-5302-8d1c-32307a3adec5","task_key":"default--validation--22001","task_revision_id":"1","upstream_id":"22001","short_description":"HellaSwag validation 22001","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to calculate a prepayment penalty [title] Read your mortgage loan contract. [step] If you want to calculate a prepayment penalty, the first step is to understand what kind of penalty applies to your loan and if it is automatically an obligation under the terms of the loan. Take your mortgage agreement or other loan document and read over it to see about whether a prepayment penalty applies.\",\"endings\":\"['You may want to compare your prepayment penalty to other mortgage payments in your mortgage agreement to determine whether you want to subject yourself a prepayment penalty. [title] Determine whether you need to include a pre-payment penalty.', 'Prepayment penalties come in several forms, including : [substeps] A percentage of outstanding principal. A percentage of interest paid within a certain time period.', '[title] Define whether you have modified your agreement. [step] This will determine whether you have changed your agreement in the event that the other lender becomes incapacitated.', '[substeps] While you can find prepayment penalty forms from lenders, the law does not rule in prepayment penalties. If a prepayment penalty applies to an interest payment, be sure to read the terms carefully.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}