{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3281ddf7-0e4a-5c00-996c-dfbdae1818c8","task_key":"default--validation--16029","task_revision_id":"1","upstream_id":"16029","short_description":"HellaSwag validation 16029","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make yourself more attractive [title] Find the right hairstyle or hair color for you. [step] Not everybody can pull off bangs or bleach blonde hair. It might require some experimentation, and years of trial-and-error to find your ideal hairstyle.\",\"endings\":\"[\\\"[substeps] Choose a hair color that is within one or two shades of your natural color so that it is easy to maintain, and won't look ridiculous once your roots grow in. If you want to go lighter, consider adding subtle highlights rather than a new overall color.\\\", \\\"It's best to find the best hair style for you, and assume that your hair color is exactly what you want, and don't be afraid to experiment with changing, in a new style, or some combination. [substeps] If you're afraid that people will never be able to tell what you look like, focus on looking your best.\\\", \\\"It'll take a lot of hard work, but eventually, you'll get a great look! [substeps] Research styles that you enjoy. If you have trouble coming up with flattering hair styles, try going for typical kitten-ears and crooked brows.\\\", \\\"Don't be afraid to experiment and try your best. [substeps] Part your hair down the middle, keeping the sides with the ends.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}