{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c8a97444-8981-58b6-81e7-adbf8b715829","task_key":"default--validation--19385","task_revision_id":"1","upstream_id":"19385","short_description":"HellaSwag validation 19385","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear thigh high socks [title] Prepare to be daring. [step] Thigh high socks are inherently bold and definitely lean toward the sexy side of chic fashion, even if you carefully plan the rest of your outfit around them. Don't be too surprised if you raise a few eyebrows when you slip them on.\",\"endings\":\"[\\\"Fashion is a mode of self expression and it shouldn't matter what people's eyebrows do. [substeps] That being said, there are definitely ways to wear thigh high socks without looking trashy.\\\", '[substeps] Or, think about celebrities who have made the testosterone high their top secret form of exercise, despite peer pressure to figure it out. [title] Wear a skirt or a tank top.', \\\"Remember that bold, out-dated items are not the same as knee high socks. Depending on the length of your feet and the cut you're seeking, you may want to wear knee high socks with the supporting end cropped.\\\", \\\"This is one of the few telltale items you can go into to have inspired the bold look. [substeps] If you're rock slender, sporty, or have an extensive wardrobe, you might put on thigh high sock stockings to match.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}