{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f7bab646-957b-5542-aac2-fa3e1a0c17fd","task_key":"default--validation--10136","task_revision_id":"1","upstream_id":"10136","short_description":"HellaSwag validation 10136","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear pink [title] Wear pink with more neutral colors. [step] Pink looks great, but it can sometimes be difficult to pair it with other colors. Choosing one pink statement piece, such as a shirt, a nice pair of pink pants, or even a pink jacket will look great if you pair it with a more neutral color like white, black, or khaki.\",\"endings\":\"[\\\"[substeps] Pink has the added benefit of being bold, as you can mix and match colors. You can wear pink with dress shoes, but with a pink tank top and solid purple jeans, it's almost impossible to completely match shades.\\\", \\\"[substeps] Opt for neutral colors like brown, grey, dark blue, or light turquoise. These are colors that will also work, since they don't clash too much with the shade of pink in your outfit.\\\", '[substeps] Pink shirts and jackets, on the other hand, can give an even more interesting appearance. Try pairing pink with more neutral, floral colors, like a tank top or a purple jean top.', '[substeps] For example, wearing a light pink jacket with a white dress or skirt will look mature and elegant. If you wear a pink outfit, try accessorizing with different colors.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}