{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"89f9d0bd-4134-5f10-ac20-bb7ed3b72a7a","task_key":"default--validation--49876","task_revision_id":"1","upstream_id":"49876","short_description":"HellaSwag validation 49876","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear boots with jeans [title] Choose ankle boots that end 2 inches (5.1 cm) above your ankle. [step] This is the thinnest part of your leg, which you want to show off to keep your silhouette proportionate. If the boots cut you off any higher than a couple inches above your ankle, they can make you look shorter and stockier.\",\"endings\":\"['[substeps] Boots with high heels are especially popular for men with narrow hips. They tend to hug your legs more snugly to show off your waist, making boots that fall just below your knee look less flattering.', '[title] Cuff tapered jeans above a pair of ankle boots to show them off. [step] To cuff your jeans, fold them up about 2 inches (5.1 cm), then roll them once more.', '[substeps] As a result, opt for ankle boots that end at at mid-calf. Pair them with floor-length or dress boots.', '[title] Consider a layered boot if you want to pull the sadness in. [step] If you want to draw more attention to your legs, choose knee-high boots that go from ankle to knee.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}