{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6c1ad9c1-e7ce-5a08-a604-518b6d6d0c5d","task_key":"default--validation--42772","task_revision_id":"1","upstream_id":"42772","short_description":"HellaSwag validation 42772","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to stop peeling fingernail polish off [title] Remind yourself you want healthy nails. [step] One of the worst things you can do to your nail bed is peel the polish off of it. The reason behind this is simple: you peel off a layer of your nail along with the polish.\",\"endings\":\"[\\\"If you can peel it off, you've put too much pressure on your fingernail polish. Removing it will not make any difference on your nail's color, and it may ruin the soft, waxy shape your nail was left with.\\\", 'And if you peel it off, then the stain will fade and your nail will become a different shape. A more gradual approach has been introduced to some nail beds because of adult supervision.', 'While peeling it off is harmless, as it burns off, peeling it off could lead to cracks, cuts, and ingrown nails. You can create new, healthy polish if you keep it on your nails longer, but be aware that it could cause scarring.', \\\"If you're wearing gel polish, you can pull several layers of nail off, because gel is more adhesive than regular polish. [substeps] Remember that it can take six months to a year for nails to grow out, after being badly damaged.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}