{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f688668-176e-5fb5-94c7-2fc23d8d68c8","task_key":"default--validation--36610","task_revision_id":"1","upstream_id":"36610","short_description":"HellaSwag validation 36610","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to conserve battery on a windows computer [title] Get to know the basic options. [step] There are generally two power plans in windows. One is the balanced power plan and the other is the power saver plan.\",\"endings\":\"[\\\"A balanced power plan will deliver power to only one controller on one computer and the rest holds your computer's entire resources. Each switch is different for each computer, so it is something to be aware of.\\\", 'Both select available battery for the computer and then click on the power feature to save the plan. This is usually found on the front side of the screen after you have entered the power plans.', 'The latter plan is designed so that the battery is happy. [substeps] You can make it switch between either power options with active input.', 'In addition to this, the user has an option to also create their own power plan based on the requirements. [substeps] The balanced power plan is generally selected as the default power plan in windows.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}