{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"349b1955-b08e-5e42-b222-3864e9de6a52","task_key":"default--validation--35387","task_revision_id":"1","upstream_id":"35387","short_description":"HellaSwag validation 35387","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to stay out of credit card trouble [title] Pay your credit card balances off in full every month. [substeps] It's far too easy to spend more than you thought when using credit cards instead of cash. Combat this by tracking your credit card purchases in a checkbook ledger as if they were debit card purchases instead.\",\"endings\":\"['Repeat this process periodically for the first few months if you are asking for credit card money more than once a year. [title] Pay not only for delinquent credit cards, but for other, less risky ways of paying your bills and/or other expenses.', \\\"Take this extra cost into account when looking to avoid paying cash in full at the risk of paying interest. It's just as easy to get caught up in your work, but has the added benefit of reducing the costs you have to pay through credit card purchases.\\\", 'Take credit card reward offers with a grain of salt. If you have enough self-control to keep track of purchases and pay your balance off in full every month while piling up rewards, great.', 'Compare the total balance in your account regularly to determine how you spend it each month, perhaps using a regular checkbook ledger. If you are not using a checkbook ledger, see https: // www.consumer.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}