{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b331624e-8415-5801-baed-715d3c9c749f","task_key":"default--validation--38088","task_revision_id":"1","upstream_id":"38088","short_description":"HellaSwag validation 38088","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to make the most of your customer relationships [title] Focus on your competitive advantage. [step] The best way to earn loyal customers and business is to offer them something that your competitors don't offer. Some businesses focus on high-quality products, while others may focus on fast turn-around times or cheap pricing.\",\"endings\":\"['Refine your offerings constantly, making sure that they are as competitive as possible in your area of advantage. Keeping that competitive edge will lead to more recommendations, repeat sales, and brand loyalty than any other strategy.', 'Making a difference, no matter how small, can help attract your customers to your business. [substeps] For example, buy a juicer if you know you have customers over 70.', \\\"[substeps] For example, your mexican creamer, a half-lime juice bottle with a lid, doesn't just add quality of flavor to your products. Instead, you may experience some customers who may like the flavor or the selection you have produced.\\\", \\\"Gain some advantage by diversifying your clientele and offering new customers or services at a time when you don't need them. [substeps] Understand the maneuverability of your customers.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}