{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2bc23139-5855-56ce-9fbf-2a08e661f677","task_key":"default--validation--32583","task_revision_id":"1","upstream_id":"32583","short_description":"HellaSwag validation 32583","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to give great customer service using e mail [title] Give each customer a personal response. [step] When a customer sits down to e-mail your company, it's because he needs help. He chooses e-mail because it's quick, but his request still warrants a satisfying and personal response! Companies eager to save time and money often take automation too far in their customer support.\",\"endings\":\"['[substeps] Send e-mail addresses directly to customer addresses, while providing regular e-mail addresses to customers. Then, build up customer support across the entire q&a web page.', \\\"A customer who won't respond to a quick e-mail will obviously be upset and it's time to back off. [substeps] Respond the customer directly if you have a question or comment he needs to make right away.\\\", 'Each customer has a unique question, and deserves a unique answer. Even if you save time by copying and pasting stock replies, change the opening and closing to make the message sound less robotic.', 'Therefore, this process is less effective than regular e-mail letters. Resume communications with company representatives to increase your customer service ency.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}