{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"803690fb-8652-5d89-bfb8-640916ca83ac","task_key":"default--validation--36338","task_revision_id":"1","upstream_id":"36338","short_description":"HellaSwag validation 36338","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat chicken pox scars [title] Get a punch excision. [step] If you want to get rid of chickenpox scars, see your dermatologist and ask about a punch excision. This is a method where scars are removed by a doctor cutting into the skin surrounding a scar and removing it.\",\"endings\":\"['[substeps] In a punch, the doctor punches out the area, usually by boiling the area for 10 minutes in water. After soaking the scar, the doctor will remove the scar tissue and let it air dry.', '[substeps] The doctor will use a round, sharp-edged tool to remove the skin surrounding the scar. Then, she will close up the skin surrounding the wound.', 'This procedure is generally painless and will cause no pain. Make sure you see a dermatologist about a punch excision if you have chickenpox scars on your face or arms.', 'A punch excision will remove the surrounding scar tissue, killing off the bacteria that build up. [substeps] To punch, the arm extends straight out and outward.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}