{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c908ed0a-0c51-5c29-97b1-9f53f454f1ee","task_key":"default--validation--42370","task_revision_id":"1","upstream_id":"42370","short_description":"HellaSwag validation 42370","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to bring in and keep customers [title] Start with noticeable and recognizable signage. [step] You want your drive-by traffic to know who you are and what your business does. [title] Make any day an excuse for an event.\",\"endings\":\"['[step] Be it a sale, an anniversary, or an open house, celebrate by promoting an event and opening your doors to the general public. [title] Offer an incentive to visit or refer your business.', '[step] Attract pay stations, electronic signage, and specific customers to come visit and talk about your business with you if it seems like a normal event. For example, you might simply stand by the door, open your back door when customers have come over, or let them check the mail before they arrive.', '[step] Instead of just telling your customers, \\\" i\\\\'m closing the bars at 6, but one of my friends moved to spain earlier and met us there, and i just can\\\\'t wait for her there. \\\" try to use these times to share your journey with customers so they can build respect.', '[step] Avoid logos and slogans, baseball cards, \\\" do what i tell you \\\", \\\" get the views \\\", and anything that could be copyrighted or shared with other customers. Be sure to try not to look as though you\\\\'re putting on a front by leaving out greasy products in highly visible places, like public bathrooms and coffee shops.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}