{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"12157c40-f432-5b81-b887-b62ceb44f0ce","task_key":"default--validation--7966","task_revision_id":"1","upstream_id":"7966","short_description":"HellaSwag validation 7966","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to stop living from paycheck to paycheck [title] Create a budget. [step] The only way to stop living paycheck to paycheck is to get your spending under control. You'll need to create a budget so that your income exceeds your expenses.\",\"endings\":\"['[substeps] You will need to have saved enough to satisfy your needs every month. Consider working with an accountability software company that specializes in stockholders.', \\\"Not only will you need to pay off the debt, but you'll also have to get rid of any expenses you don't need or which may be for the future. [substeps] For instance, there are certain expenses you will pay on a rent payment every month.\\\", \\\"[substeps] Don't waste money by splurging on equipment that cannot be worked off until you have enough to start selling. A budget works as best as a budget, since goals are met in specific settings.\\\", 'Sit down and crunch the following numbers : [substeps] Income. What do you bring in every month? Count your paycheck, as well as any retirement benefits, unemployment benefits, disability payments, child support, etc.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}