{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f6b69857-c7c9-5bf4-9602-bd5fa5b23a90","task_key":"default--validation--31551","task_revision_id":"1","upstream_id":"31551","short_description":"HellaSwag validation 31551","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to buy a copier [title] Purchase a desktop model for home offices. [step] If you are buying a copier for home use, or for a business that makes fewer than 700 copies per month, purchase a desktop model. These are much cheaper and simpler than a large, standing device.\",\"endings\":\"['[substeps] Copiers come in front of desks. They range from cheap, mid-range devices like tablets and smartphones to large glass or metal operating systems like televisions.', '[substeps] If you buy a desktop model, you will need to buy internet access, whether you have a wireless connection or fixed internet connection. If you do not want to pay the cost to rent or purchase a desktop model, buy small pieces of furniture or save time using your computer to divide your copier time.', '[substeps] Start off buying a desktop model in an office room in your home, then pay cash for the quality of the models and the strength of their compartments. Small or slender models such as a closed-and-had will often help cover the costs you incur while you take your copier.', 'The rest of the information in this article focuses on the needs of larger offices. [substeps] A laser copier/printer/scanner typically costs between $150 usd (black and white only) and $500 usd (fast, quality color).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}