{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c9ce151a-ce8c-58c0-838f-3a5e04ff2555","task_key":"default--validation--6980","task_revision_id":"1","upstream_id":"6980","short_description":"HellaSwag validation 6980","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tan when it's cloudy [title] Exfoliate your skin one to two days prior to tanning. [step] Rub an exfoliating gel, which you can buy at most drugs stores, into your skin to remove dead skin cells a day or two prior to tanning. Regardless of the weather, exfoliation is important as it removes dead skin cells that can block the sun's rays.\",\"endings\":\"['[substeps] If you plan to use the sunscreen at night, exfoliate before you go to bed. This is especially important during the hottest hours of the day.', 'This can result in an uneven, patchy tan. [substeps] Scrub lightly if you already have some color, as harsh scrubbing can remove tanned skin.', \\\"[substeps] Exfoliating scrubs are available at drug stores and can be applied to your skin once the sun's rays strike. Facial scrubs will be applied between 7 and 10 hours prior to tanning.\\\", '[substeps] When you exfoliate your skin, use both hands to gently scrub the treatments in. Then, move on to your whole body.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}