{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"159f8d36-6b74-5264-bb03-87bfb7342edf","task_key":"default--validation--9942","task_revision_id":"1","upstream_id":"9942","short_description":"HellaSwag validation 9942","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to buy vanguard mutual funds [title] Understand your risk profile. [step] Before you even begin to invest, you need to understand that investment is, by definition, an act of risking your own money. You stand to lose some, or even all, of what you invest.\",\"endings\":\"[\\\"While mutual funds tend to balance risk by distributing investments across a variety of securities, the possibility always exists that you will lose money. [substeps] Ask yourself how much you're willing to lose.\\\", 'By losing, you prevent yourself from being held back by your losses. [substeps] In order to make a good investment that will last you over the long haul, it is important that you fully understand your risks.', 'You can trust nothing but yourself alone with every investment you make. You need to completely understand your risk profile before you begin investing.', 'If you choose to gamble, you will effectively lose a large portion of the investment. To get started, you should learn as much as you can about your risk profile.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}