{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5cbfee7-4737-571c-9b96-53588e424720","task_key":"default--validation--4688","task_revision_id":"1","upstream_id":"4688","short_description":"HellaSwag validation 4688","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be a feminine guy [title] Maintain your hair. [step] Long, feminine hair is one of the single most important things in the feminine beauty. Done correctly, it can be amazingly beautiful, and simple at the same time.\",\"endings\":\"['[substeps] If your hair is straight or wavy, try to do some it on one side, and scrunch the other side. If you have long hair, think about styling it in one (but only one) part.', \\\"You want your hair to look perfectly healthy and shiny when you're wearing it (whether it's in a twist or pulled back into a ponytail). [substeps] Keeping your hair simple allows you to create cool styles that way.\\\", \\\"Bring a clip from your hair stylist (and more) that clips your hair up in a ponytail or braid. It's a good idea to keep your hair a little longer.\\\", 'The key to having luscious hair is to moisturize and wash daily. Use moisturizing shampoos and conditions every day when you shower.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}