{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4e65aafd-9a7d-5391-8009-8725f35ab759","task_key":"default--validation--46755","task_revision_id":"1","upstream_id":"46755","short_description":"HellaSwag validation 46755","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to change social security direct deposit [title] Gather your information. [step] If you want to change your direct deposit information online, it's a good idea to get any necessary documents together before you go to the social security website. That way you won't have to stop and hunt for information.\",\"endings\":\"[\\\"[substeps] Although it may seem awkward to use this method for large projects, it is easily done, depending on the details of the project and the fees. While you cann't change your direct deposit information, you can change your account information, such as the dates, payment methods, and information for the project.\\\", 'You also want to gather the following information : [substeps] Your current social security number. It needs to be at least 4 digits, or even more if you can make one change in four weeks.', \\\"[substeps] For example, if you've opened a new bank account that you want to use for your direct deposit, get your bank account numbers and other information and have them handy. You also may need to provide or confirm your social security number.\\\", \\\"The website will ask you a series of questions while you look at how to change your social security entry. [substeps] You will also need the names and contact information of the individuals you're transferring funds from.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}