{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"122290bb-05c1-58fa-9def-64663f4586ca","task_key":"default--validation--25408","task_revision_id":"1","upstream_id":"25408","short_description":"HellaSwag validation 25408","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to transform debt into wealth [title] Take time to sit down and evaluate your current financial situation. [step] Determine what you have in credit card debt, what loans you have to pay off, and what you have in savings. You also want to get a good idea of what you pay every month in regular bills.\",\"endings\":\"['With all this information, you need to decipher what you need every month to pay off your bills. You can do this by adding up your monthly bills, multiplying that by 12 to get your annual amount, and then divide that by 52 to get your weekly obligation.', 'Start with 401 (k) or iras. [title] Assess the amount of debt you already have.', 'Make a list of all of these changes and how they might improve your income over time. [substeps] Make a list that includes the different assets and what exactly you will be using to help you pay off debt.', \\\"[substeps] Visit your bank's website at https: // irs.gov/alta /. Make sure the terms are similar to each other on this page.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}