{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b95ed3f9-fb36-5610-928d-184ab3a2a8e7","task_key":"default--validation--4596","task_revision_id":"1","upstream_id":"4596","short_description":"HellaSwag validation 4596","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dress smart casual (females ) [title] Think about what bottoms to wear. [step] For a smart casual outfit, you must balance flairs of professionalism and fashion. Consider wearing bottoms that are comfortable but sharp looking; they need to be able to pull through a professional yet casual look.\",\"endings\":\"['Choose simple, cool colors, mostly leopard print or solid green, to really add to this look. [substeps] Think of a top that fits snugly across your torso.', \\\"[substeps] Avoid shorts with plunging or sloping fronts. Slip off the top of the shorts as well when you're dressing to keep your knee-length, breezy bottoms from showing through when you top them off.\\\", 'For example, a nice pair of slacks, darker-colored conservative skirts, and even a dark wash pair of jeans can all be appropriate bottoms for a smart casual outfit. Most times, your bottoms can act as a base from which you create your ensemble outfit.', \\\"Suit and tie is optional, but try to avoid that to an extreme by wearing something flowing and simple. You don't need to pull it off for fun, but you should avoid tight tops, tight necklines, skirts, or clothes with class prints.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}