{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"49d2a389-88d0-5b2e-a653-cda3822e6ce2","task_key":"default--validation--13405","task_revision_id":"1","upstream_id":"13405","short_description":"HellaSwag validation 13405","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do polka dot nail art [title] Apply a base coat. [step] Before you polish your nails, apply a base coat to fill in any holes or ridges. This will provide a smooth bed for the actual nail polish and help your manicure last longer.\",\"endings\":\"['[substeps] Avoid getting polish on the sides of your nails, as this can make them bleed. [title] Get a primer and apply it over the polish.', \\\"Finish with a primer for the base coat. [substeps] It's best to use a clear top coat before you do this base coat.\\\", 'You can also use a protective or strengthening base coat to keep your nails healthy and strong. [substeps] Apply a thin coat to each nail, just enough to cover it without any excess.', 'Your base coat will help the polish adhere to your nails as well as clean your french pedicure. [substeps] Your base coat should be slightly darker than your polish.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}