{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ab23e088-fe2d-5209-bbe5-154175d803e6","task_key":"default--validation--44304","task_revision_id":"1","upstream_id":"44304","short_description":"HellaSwag validation 44304","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to choose a 529 account [title] Check your state's plan. [step] Many states offer a state-sponsored 529 plan for college investment. Each state determines the structure and options that go along with its own plan.\",\"endings\":\"['This plan is part of the reason the 401 (k) account is opened in the first place. The states schedule vacations outside of state governments.', 'Talk to your adviser or environmental resolution department about how many states (county and state) of interest are allowed to extend the plan. [substeps] If you plan to use this plan, make sure that you know what you are paying the expenses for, how much you cover, and the exact amount that you can afford.', \\\"Some states offer matching grants and other benefits to in-state residents who buy into the state-sponsored 529 plan. Some of the benefits of investing in your own state's sponsored 529 plan are : [substeps] State tax deductions matching grants scholarship opportunities protection from creditors exemption from state financial aid calculations [title] Consider plans from other states.\\\", \\\"Some states allow different plans, especially in different areas of the state. Go into the states' websites and see what will and will not work for you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}