{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"fe0edc21-3eac-5492-be36-9f13b97a370b","task_key":"default--validation--14411","task_revision_id":"1","upstream_id":"14411","short_description":"HellaSwag validation 14411","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to create a business budget [title] Familiarize yourself with budgets. [step] A budget can be seen as a roadmap for your business-it provides an overview of what you will be spending and making over a future time period. A proper budget will include educated estimates as to what you will make (revenues), and a precise plan for your spending.\",\"endings\":\"['[title] Figure out how fast you need to reduce your portion of your expenses. [step] Getting a business plan for your expenses will be considerably easier, as will figuring out how much to spend to start your business.', '[substeps] Talk to your employee about whether or not they will be expected to spend their money. If they do not, have them estimate.', 'Budgeting is a key aspect of developing a business as a whole, especially in the early stages. [substeps] Figure out what income you will need for starting a business.', 'Following your budget successfully can ensure your business is profitable and achieves its goals. [substeps] For example, assume your business is planning for next year.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}