{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4dde807-56cd-5fcd-bbd2-3785a50a2fcf","task_key":"default--validation--24071","task_revision_id":"1","upstream_id":"24071","short_description":"HellaSwag validation 24071","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get your skin silky, smooth, soft, shining and healthy [title] Start each day with dry brushing. [step] Dry brushing is an ancient exfoliation technique designed to slough off dead skin and stimulate your body's circulation. Dry brushing every day immediately makes your skin look brighter, and if you keep up the routine your skin will begin to glow.\",\"endings\":\"[\\\"[substeps] Choose a dry brush made from natural fibers, rather than plastic bristles. Natural bristles aren't as rough on your skin.\\\", '[substeps] When brushing your hair, use gentle, circular motions rather than a thick brush. Doing too much brush can result in excessive bleaching and staining.', '[substeps] To begin with, sit on the bathroom floor with a damp cloth or towel ready. Squeeze a dollop of olive oil onto the cloth.', '[substeps] You can take a shower or go for a walk. If you need to do something else but eat, go for it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}