{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cb24878c-50f4-50c7-8c85-eda7f6cdb2ef","task_key":"default--validation--46071","task_revision_id":"1","upstream_id":"46071","short_description":"HellaSwag validation 46071","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style glitter boots [title] Go with glitter ankle boots for a versatile option. [step] Glitter boots come in all sorts of styles. If you want a low-key boot that you can wear with many different outfits, go with an ankle boot.\",\"endings\":\"['[substeps] Ankle boots are similar to boots in that they have more ankle straps, their ankle band is thicker, and they are made with better flare. Ankle boots, however, are more comfortable that regular walking boots, as you can use one or more strap ankle boots.', \\\"Ankle boots look great styled casually or dressed up. [substeps] This way, you won't be covered up to your knees in glitter! [title] Choose knee-high glitter boots for a bold look.\\\", 'This will offset some of the beauty of your boots and create a really casual, modern look. [substeps] If you want to wear a girly-girl or catwalk look, try stick to a dark purple or chocolate brown for a perfect, elegant alternative to your ankle boots.', \\\"Because you won't be carrying large amounts of weight, glitter boots are a way to add volume and take away the mood on dresses, skirts, and other outfits. Choose small and large toe boots that you can wear with large outfits every day, or that match your wardrobe and budget.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}