{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c31cf79c-1445-558a-9d42-2527a2ad26e1","task_key":"default--validation--1794","task_revision_id":"1","upstream_id":"1794","short_description":"HellaSwag validation 1794","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to use ableton live [title] Install ableton live on your computer. [step] Use the provided disc or other means to install the program and get it fully functional on your computer and operating system. [substeps] Look at all system requirements for ableton live.\",\"endings\":\"['Like many other modern sound programs, this program may include requirements for an advanced sound card, graphics display card or other piece of hardware, as well as requirements for minimum memory or processing speed. Make sure that your computer has what it takes to effectively run ableton live.', 'Most operating systems require that you access basic operating systems, but some systems, such as windows or macos, require the installation of the software on a physical cd or dvd through a system drive. This method can take up to two months.', \\\"That's just the nature of the program: it should also have 1 or more power requirements. Are you operating the program from a desktop computer? If so, take your computer to the computer store as this will determine software needs and install requirements.\\\", 'Identifying the relevant expiration date on your system can save time and expense. [title] Access the system application to which you need to install ableton live.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}