{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbceecab-5963-5b8b-a292-0a356f819a2f","task_key":"default--validation--43750","task_revision_id":"1","upstream_id":"43750","short_description":"HellaSwag validation 43750","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have soft skin [title] Exfoliate weekly. [step] Exfoliation makes your skin softer by removing dirt, oil, and dead skin cells. You can scrub your face with coffee grounds mixed with some mild soap, or a store-bought exfoliation product.\",\"endings\":\"[\\\"Exfoliating is ideal if you have dry skin or if you have sensitive skin. [substeps] Exfoliating once every day will help ensure that you don't get dry skin overnight, since the scrubs will remove dead skin cells and reconstitute fine skin underneath.\\\", '[substeps] Exfoliating daily will restore your skin to healthy firmness. Not every exfoliant is safe for use on sensitive skin.', 'You can exfoliate your face anytime. Exfoliating your face once daily can help break down bacteria.', 'For relief of redness as well, look for something that contains green tea extracts and glycolic acid. [substeps] Avoid exfoliating more than once or twice a week, as exfoliating too often can cause skin irritation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}