{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5552816b-06cc-5929-86eb-9bcacb63a4e5","task_key":"default--validation--19911","task_revision_id":"1","upstream_id":"19911","short_description":"HellaSwag validation 19911","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to transfer super funds [title] Check if your transfer qualifies to go through the ato. [step] Although the ato makes it easy to manage your accounts, not all plans can be transferred using their form. Before filling out the form, it's best to check with your provider to make sure your fund is eligible.\",\"endings\":\"['Your account will either be linked to your ato or a form exists that you can file. [substeps] Any transfer that is tax deductible through ato usually works.', \\\"This typically only applies to revolving transfers as discussed above. [substeps] If you don't sign up for ato's form, you may have to wait until after your transfer is approved.\\\", '[title] Follow the instructions for transferring your money. [step] On the form, you must explain how long you are transferring your money.', 'Most plans will be, but there are some restrictions : [substeps] You must transfer your entire balance. You must use a special form to transfer your money to a smsf.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}