{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b23fa20c-e0dd-5820-a852-d50733e59f7b","task_key":"default--validation--8803","task_revision_id":"1","upstream_id":"8803","short_description":"HellaSwag validation 8803","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to moisturize your scalp [title] Choose a moisturizing shampoo. [step] You don't want a harsh shampoo that strips oils from your hair and skin. Choose one formulated to moisturize your scalp and hair, such as a formula that includes hyaluronic acid or argan or tea tree oil.\",\"endings\":\"['The shampoo is water-based and contains juicers which help keep moisture in the scalp. [substeps] Steer clear of shampoos and gels with chlorine as these can strip shine from your hair and make it look oily.', 'Avoid ingredients with exfoliating compounds, especially those labeled as \\\" sulfates. \\\" these are only to be applied to your scalp.', '[title] Shampoo your hair only twice or three times per week. [step] Shampooing your hair too often can strip the oil from your scalp and leave your skin and hair dry.', 'After you use the shampoo, dampen a soft washcloth with water and apply to your hair, paying extra attention to your scalp. [substeps] Avoid using shampoo that contains perlite or bicarbonate.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}