{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d3a1c083-f3cf-558b-a5cc-ab990d143381","task_key":"default--validation--27247","task_revision_id":"1","upstream_id":"27247","short_description":"HellaSwag validation 27247","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to invest small amounts of money wisely [title] Ensure investing is right for you. [step] Investing in the stock market involves risk, and this includes the risk of permanently losing money. Before investing, always ensure you have your basic financial needs taken care of in the event of a job loss or catastrophic event.\",\"endings\":\"['[substeps] Make sure you have 3 to 6 months of your income readily available in a savings account. This ensures that if you quickly need money, you will not need to rely on selling your stocks.', 'You should also secure funding that will help you achieve goals. [substeps] There are a wide variety of investments available in the stock market, including stocks and bonds and debt-to-equity funds, which are primarily used for your lifestyle (e.g., housing).', '[substeps] Start a savings account with your bank or purchase a second one online. Wait for possible cash flows to subside before investing.', '[substeps] Know that you are (or may be) involved in organizing funds. You may be responsible for moving, buying, reselling, or selling stocks.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}