{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"18d5d4f5-cfd6-53bb-a693-5e47a9542064","task_key":"default--validation--4353","task_revision_id":"1","upstream_id":"4353","short_description":"HellaSwag validation 4353","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to choose a trustworthy logistics company to work with [title] Check the reputation of the company. [step] You don't want to work with a logistic company that is known for providing a terrible brand of service. Unfortunately, there are companies that have \\\" crazy \\\" delivery personnel who literally dumped parcels at their clients' front door.\",\"endings\":\"['Their past is still visible today and they are often not able to win clients on top of their bad reputation. It takes a very emotional load off the equation before an irresponsible company will ever believe that they can possibly deliver the goods/services to needs needing for the company.', 'Because of this, they may have very poor communication skills. Contact companies with a lot of information to help you report their misspellings.', 'This is perhaps one of the biggest signs of a bad start. [substeps] Every company has a reputation of following a pattern of bad management.', 'Some have been known to steal valuable items. To avoid such problems and ensure that your business does not compromise its reputation and lose customers, make sure that the logistics company you hire has a clean record.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}