{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"16d97dbb-5764-52fb-82ec-39ad85ac41aa","task_key":"default--validation--21037","task_revision_id":"1","upstream_id":"21037","short_description":"HellaSwag validation 21037","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to make money in forex [title] Know how currencies are traded in the forex market. [step] The forex market is a global exchange of currencies and currency-backed financial instruments (contracts to buy or sell currencies at a later date). Participants include everyone from the largest banks and financial institutions to individual investors.\",\"endings\":\"['Understand that there are 14 currencies :. In the form of mixed currencies or the same value , 0 , 2, and 5 , 1 , 1, and 2.', 'This provides a solid foundation for investing in a conventional economy. In comparison, conventional currencies can be traded in the futures exchange for a couple of hundred dollars (as described before).', 'Currencies are traded directly for other currencies in the market. As a result, currencies are priced in terms of other currencies, like euros per us dollar or japanese yen per british pound sterling.', 'Part of materialism, especially here in western countries, is how customers approach the currencies in the lower east and western countries. This gives investors a sense of the most basic link between upper and lower countries, such as the european economy of america (190).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}