{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0f5e8811-4b08-5bca-af23-baf32ee35aaf","task_key":"default--validation--15682","task_revision_id":"1","upstream_id":"15682","short_description":"HellaSwag validation 15682","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to retire in the republic of panama [title] Show financial ability to support yourself. [step] Prove that you have $1 , 000 for a single person (or $1 , 250.00 for a couple) of income per month. [substeps] This can be social security, retirement funds or other.\",\"endings\":\"['Let this addition to your gross household determine your net income and housing expenses. However, do not only have you the money, but also realize how healthy you are overall.', 'Make sure your savings account works with that of your main bank. There are usually some deductions for self-employment purposes, and they can change depending on your financial situation.', \\\"However, act as a member and provide means to buy and control certain group as well as raise funds. To make bringing material people who aren't working together easier, demonstrate that you can promise both in staying in the rented panama enterprise facility program.\\\", 'You can also demonstrate that you are a person of means. This is defined as having $100 , 000.00 or more in funds and will meet the financial requirement.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}