{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7aff0818-e42a-5633-b3cf-f69dc02e5ee1","task_key":"default--validation--10075","task_revision_id":"1","upstream_id":"10075","short_description":"HellaSwag validation 10075","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to make changes to a western union money transfer [title] Open the western union website. [step] This site will provide you with the most up to date information concerning your money transfer. You will want to go here to chat with a customer care representative.\",\"endings\":\"[\\\"You will need to provide information about your assets (liabilities), mortgages (income), your personal assets (savings , 401 (k), and other investments), and inventory (value). You can gain stock in western union by using this site's website :.\\\", 'They will have the authority to make the changes you need or provide alternative instructions where necessary. [title] Click \\\" contact us \\\" at the very bottom of the webpage.', '[substeps] Click on \\\" register \\\" to create your username and password on the site and click \\\" join \\\" to create your account and begin registering your money. An automated registration procedure can take as long as 15 to 30 minutes depending on your transaction instructions.', '[title] Click the\\\\' process \\\" link at the top of your company\\\\'s official online portal. [step] This link will redirect you to your credit card carrier\\\\'s information page.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}