{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"42c72d93-3f53-5947-be47-8b5ae47a376c","task_key":"default--validation--17099","task_revision_id":"1","upstream_id":"17099","short_description":"HellaSwag validation 17099","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to start your own lawn care business [title] Get fully licensed and certified. [step] In general, the legal hurdles to starting a lawn care business are low compared to other industries. Some cities have municipal permits.\",\"endings\":\"['Other levels of government may also have requirements when it comes to the regulation of things like pesticides. Consult a local lawyer to ensure that you are in full compliance.', \\\"These permits are excellent substitutes for starting one of the other types of professional lawn care businesses. Once you become licensed, you'll be able to spend money on your own business.\\\", \\\"If you do not make any money running your own home, you probably can't legally open a lawn care business. To start your own lawn care business, you must obtain a license from the dmv.\\\", 'You are required to adhere to all necessary building codes before you start your own lawn care business. You may need to file for a permit before you ever open your lawn care business.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}