{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b4db63f5-a89a-5320-af3b-e42afb3a73da","task_key":"default--validation--6049","task_revision_id":"1","upstream_id":"6049","short_description":"HellaSwag validation 6049","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to clean printer rollers [title] Locate the printer rollers. [step] On inkjet printers, the printer rollers are typically located on the underneath side. You can usually find them if you remove the paper tray and look right above where the paper tray used to be.\",\"endings\":\"['[substeps] The rollers should rotate manually when you apply pressure to them. If not, you will need to use the \\\" feed paper \\\" option on your printer to rotate them.', 'There are also mounting racks or trays for printer rollers that can be found at your local office supply store. [title] Wash the rollers with soap and water.', 'You can also use a sharp file to remove any hard to see parts. [title] Spray a small amount of hot water onto the rollers.', '[title] Spray the roller with a non-flammable oil. [step] Lubricate the metal part of the roller rollers with a metal lubricant like wd-40 or a brush.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}