{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c6a937d5-e877-5d2b-bbd5-03f0f31e4a6a","task_key":"default--validation--42651","task_revision_id":"1","upstream_id":"42651","short_description":"HellaSwag validation 42651","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to care for a tattoo [title] Leave the bandage on for 2 to 24 hours. [step] Any reputable tattoo artist will cover your tattoo with some form of bandage immediately after finishing it. There are varying opinions about how long this bandage should be left on, though.\",\"endings\":\"['[substeps] Ask the tattoo artist responsible for your new ink for his or her recommendation. A thick, absorbent, non-stick dressing can usually be left on overnight, or for as long as 24 hours.', 'Most artists recommend no more than 2 to 3 days or so to give the tattoo time to heal. [title] Apply a thick, soothing vaseline.', 'Some tattoo artists repeatedly leave the bandage on. Other artists just put a tiny dab of antibiotic cream on the bandages for greater protection.', \\\"Keep in mind that the longer you leave it on, the better it's protection. During this time, you'll be able to remove any ink stains and bleeding at the site of the tattoo.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}