{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be52493c-e5d3-596d-9b91-55b87f926c7d","task_key":"default--validation--37533","task_revision_id":"1","upstream_id":"37533","short_description":"HellaSwag validation 37533","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to survive on a small income [title] Analyze your spending. [step] If you find you're having trouble getting by on the amount of money you bring in, start by getting a sense for where that money is going. Jot down a list of your known monthly expenses, like rent, utilities, transportation, etc.\",\"endings\":\"[\\\"How much you're spending on things, and how much you want to exceed that. [substeps] For example, you may not have very much bank account at all to begin with.\\\", 'Then use your three most recent months of credit card and bank statements to categorize your other spending into food, household necessities, healthcare, entertainment, or other. Figure out on average how much you spend each month in each category, and use this as a baseline.', \\\"When you can review these, you may be able to even start thinking about how you are going to live. [substeps] You can monitor how others are spending your spending and see if you are using something you don't use.\\\", 'Then ask yourself why that amount is causing you to feel such low monthly goals. [substeps] Consider how your family income is affecting your housing and lifestyle in your lifetime, and determine if your income is contributing to your problem.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}