{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9523d099-07a2-5918-b289-a8f8d294120b","task_key":"default--validation--50104","task_revision_id":"1","upstream_id":"50104","short_description":"HellaSwag validation 50104","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to know if you should work in customer service [title] Determine if you have patience. [step] Perhaps one of the most important personality traits for customer service representatives is patience. Patience, which is defined as the ability to deal with delay and complications without problem, is critical for customer service representatives.\",\"endings\":\"['Patience is important for a number of reasons. Consider if you could handle : [substeps] Staying on the phone for long periods of time.', 'This means that you should work patiently, giving your undivided attention to your customers and staying on task when others need you. When you are more engaged in the work of your customer service representatives, you are more receptive to the help and guidance that comes your way.', 'Knowing if you are patient and attentive will significantly eliminate your fear and help you understand the work in front of you. [substeps] If you are a dedicated customer service representative, you should encourage the people in your organization, too, to have patience.', 'Though it is a positive trait, people can express a lack of patience when pressed for time. It is necessary to be punctual and assure your employees that they can communicate with you without interruption.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}