{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cf21f2b7-c910-5bfe-8e6c-4b68a168b21c","task_key":"default--validation--11243","task_revision_id":"1","upstream_id":"11243","short_description":"HellaSwag validation 11243","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to get new patients for a dental practice [title] Start by researching your competitive market. [substeps] Look at how large the practices are around you and what they offer their patients. Use this information to carve out a niche for your business.\",\"endings\":\"['Research the types of dental practice your business has so you know what services are in line with your needs. [title] Research the pay models you already have.', 'You may specialise in a different trade or only offer veneers. [title] Collect references, referrals, rankings and graphs from your clients.', 'The ideal dental practice is two or three times larger than other working clinical practices, many of which includes specialty dentists. Research the salaries of particular dentists before selecting a career path that benefits your customers.', \\\"See what advertising of theirs catches your eye. Ask yourself if any of those dentists' marketing techniques will fit your business.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}