{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"46c03dc4-93c3-5889-84f6-34c1bf8dd0f5","task_key":"default--validation--4314","task_revision_id":"1","upstream_id":"4314","short_description":"HellaSwag validation 4314","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to get a job in a call center [title] Practice patience. [step] One of the stressful aspects of call center work is that people you talk with often do not want to be on the phone with you. If they are calling because they have a problem, they want it resolved quickly.\",\"endings\":\"[\\\"By practicing patience and listening carefully and responding without interruption, you can keep your voice up. Long distance calls are common with many busy phones, so it's better to start practicing when you're in a public place.\\\", 'When your contact calls, do your best to be patient and answer their questions as calmly as possible. Talking quickly gives them a feel for how you are feeling, so they can better assist you.', 'If you called them, they may feel intruded upon. So to prepare for call center work, you must learn to be exceptionally patient even with the most difficult people.', '[substeps] Call center jobs can be difficult because of the multiple clients who have passed away. Although it is understandable that call centers try to get clients right away, it can cost thousands of dollars.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}