{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"26a11dcd-1dc7-5966-9a19-8bd441a7e780","task_key":"default--validation--31901","task_revision_id":"1","upstream_id":"31901","short_description":"HellaSwag validation 31901","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take your style out of a slump [title] Change your typical hairstyle. [step] Consider cutting your hair, getting some side swept bangs, or fringing it; this change can get you out of that style slump and change your look. Or, change your hair color.\",\"endings\":\"['A big change like this may be just what you need to pull yourself out of your slump, but a streak of color may be just enough. Look at different hairstyles, and think carefully about what you want to look like.', \\\"Typically, you'll want to change your hair color however you see fit, regardless of other factors. It helps to refer to this guideline for more information.\\\", 'Brown hair is not the most flattering hair color, and when your hair looks dead, that can indicate a style slump. [substeps] For example, a strawberry blonde hair color could be paired with teased highlights in different shades of hair, such as brown and cinnamon.', \\\"[substeps] Don't cut your hair in a circle. Instead, you want it to be long, straight, and wavy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}