{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"851acd59-d2e8-527c-a65a-69828e667f1c","task_key":"default--validation--4295","task_revision_id":"1","upstream_id":"4295","short_description":"HellaSwag validation 4295","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be a bombshell [title] Have the hair. [step] We all know that a bombshell is a symbol of smoldering female sexuality. You can identify this symbol from a distance.\",\"endings\":\"[\\\"The key is to be frugal when creating your look. Your hair doesn't need to be short, it should be at least 1/2 head length.\\\", \\\"Plus, part of the model's beauty would be her hair-regardless of what a bombshell she is. As a model you may have hair that is primarily brunette or pastel red.\\\", 'Think 007 silhouettes-the bombshell silhouette has a gorgeous figure and the big, bodacious hair that completes the picture. Use shampoo and conditioner that keep your hair healthy and shiny, and hairspray and velcro rollers to give your hair volume.', \\\"If you're serious about being a bombshell, don't sweat it--well, being a bombshell is famous. Many communities and urban streets give out fashion and makeup kits.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}