{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b1c15292-ab2d-5207-8762-66c06f19a04d","task_key":"default--validation--40530","task_revision_id":"1","upstream_id":"40530","short_description":"HellaSwag validation 40530","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to be financially disciplined [title] Organize all your financial documents. [step] Create a file folder or a cabinet or box with sections for all your expenses, insurance, assets, income and liabilities. You could label the folders this way : [substeps] House/apartment income insurance medical vehicle utilities taxes [title] In each folder put everything associated with the category.\",\"endings\":\"['[step] List all your use, co-pay, net income and any monthly expenses. [title] Click the \\\" get started \\\" button.', '[step] Make sure they are easy to access, accessible and organized. [substeps] For example, are bills and health plans on your bed when you get up in the morning? Any essential information you will want to put together, such as dates from the last month.', '[step] If the category interests, it might be in the category folder. If it is not, it might be relating to the category.', '[step] For example, under \\\" house/apartment \\\" you would keep mortgage or lease/rent documents. Under \\\" utilities \\\" you\\\\'d file gas/electricity, water, sewage, tv/internet, and phone bills.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}