{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"14ea13da-9890-59df-afe0-bb331dcf9e7b","task_key":"default--validation--10969","task_revision_id":"1","upstream_id":"10969","short_description":"HellaSwag validation 10969","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to choose shampoo for scalp psoriasis [title] Know if you need coal tar shampoo. [step] Coal tar is the oldest treatment for scalp psoriasis. However, when it is used alone, it's only as effective as a mild to mid-potency topical corticosteroid.\",\"endings\":\"[\\\"They are effective as additions to combination therapy, though. It can help slow the growth of the flaky skin cells on your scalp and help restore your skin's health.\\\", 'You may need to consult a doctor or dermatologist, particularly if you have skin psoriasis. [title] Look for a shampoo with a non-comedogenic texture.', '[title] Look for a shampoo that concentrates on 80% beta-carotene. [step] This percentage should be clearly represented in the label at the bottom of the shampoo bottle.', '[substeps] Coal tar is located in the outer layer of the scalp and hair around the wrinkles. At home, a scraping tool such as a dull razor blade and toothbrush will suffice.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}