{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b9d12b79-3e2c-5761-a92a-02a41fcc2830","task_key":"default--validation--8362","task_revision_id":"1","upstream_id":"8362","short_description":"HellaSwag validation 8362","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to retire in your 30s [title] Calculate how much you need to save for retirement. [step] The myth of early retirement savings is you need to save somewhere between $5-$10 million dollars to never have to work again. But this is a general number that may not apply to your financial situation or your lifestyle.\",\"endings\":\"[\\\"Learn what works best for you and/or your lifestyle. It shouldn't be a concern if your living expenses are low or if the unexpected death of a loved one found out you are retiring.\\\", \\\"[substeps] Start with this figure in mind as you plan your retirement money. If you don't already know exactly how much you need to save for retirement, don't be surprised if there are some negative results after calculating it.\\\", 'A more accurate formula is to take your annual spending and multiply it by somewhere between 20 and 50. The large range allows you determine how much you need to save, based on your particular lifestyle.', 'Additionally, if you are still in need of a means to live but are not at the health and running stage of retirement, save $10 million dollars. But only if you are under 10 years old and are qualified enough to retire fully at age 60.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}