{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0e1e6424-68a6-515f-bdf3-a308a0e2ee76","task_key":"default--validation--19101","task_revision_id":"1","upstream_id":"19101","short_description":"HellaSwag validation 19101","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to use cayenne for back pain [title] Purchase capsicum plasters. [step] \\\" capsicum plasters \\\" are essentially patches that contain capsaicin. These patches can be purchased at most pharmacies or online.\",\"endings\":\"['Capsicum plasters come in a wide range of sizes and flavors, and they are usually sold with your prescription. The size of the capsicum latex is very variable; however, chilean latex is usually sized to be the most common.', 'They are adhesive on one side, and are applied to the skin in order to relieve back pain. These plasters are often sold in packages of three.', 'They take the pressure off your back and reduce itching. These may also help your dermatologist figure out whether you have back aches.', '[substeps] Capsicum plasters should be applied immediately after a bowel movement. Capsicum plasters may also use \\\" semper \\\" as an additive.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}