{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"402d7d4d-e265-5ee1-94fe-a5c84b83cb80","task_key":"default--validation--40378","task_revision_id":"1","upstream_id":"40378","short_description":"HellaSwag validation 40378","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to keep high heels from slipping [title] Learn your size for heels. [step] Many people wear different sizes for heels than they do for flats, which can make getting your size right tricky! Try on heels a half-size larger than your usual size to see if they fit more comfortably. [title] Buy platform or wedge heels.\",\"endings\":\"[\\\"[step] Platform heels are just legs with ankle pads and gel foot protectors. Wedge heels are not as common, but maybe they're for you! [substeps] Platforms and wedges add some depth to a flat heel, on the other hand, but generally, they're uncomfortable to walk in.\\\", \\\"[step] Stiletto heels look great, but they're much harder to walk in. Buying wedge heels or heels with a platform sole will level your foot out and make it easier to walk.\\\", \\\"[step] Platform heels are the most popular, as they don't provide enough room or provide comfort. However, wedge heels are very secure and low to the ground and usually cost around $5.\\\", '[step] Platform heels fit a variety of different sizes, so go online and find the one that is right for you. You can find both platform and wedge shoes on amazon, and if you can find them in storage, you can skip this step.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}