{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a1cf9754-fe7b-5fa8-968d-fd835ab9ce24","task_key":"default--validation--16193","task_revision_id":"1","upstream_id":"16193","short_description":"HellaSwag validation 16193","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear an ear warmer [title] Consider the color. [step] Your ear warmer should be a fashionable accessory that works with the rest of your clothes. When choosing an ear warmer to wear, select one that will match the colors you're wearing.\",\"endings\":\"['Black and brown ear warmers also work well, but a zebra ear warmer will have more space, and not provide as much space as beige or brown ear warmers. If you wear the ear warmer too often, you may find it hard to wear it with turquoise, teal, and bronze tones.', 'Choosing a brightly colored ear warmer can cut down on the price since you can also find ear warmers at thrift stores. [substeps] Ear warmers tend to be sticky to the touch, making them a good option for warm clothes.', 'You can wear your ear warmer in a variety of colors, or, you can choose a more eye-catching color that works well with the rest of your wardrobe. Different ear warmer shades will match more colors than the rest of your wardrobe.', \\\"While picking the same colors works, it's not the only way to coordinate your colors. Make sure that your ear warmer and clothes stay within the same family of tones.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}