{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f30ba048-8f47-5c81-b558-a51452f212fb","task_key":"default--validation--3209","task_revision_id":"1","upstream_id":"3209","short_description":"HellaSwag validation 3209","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to accessorize [title] Wear a few well-chosen accessories at a time. [step] A lot of people make the mistake of piling on all the accessories they own at once. When it comes to accessories, less is usually more.\",\"endings\":\"[\\\"Instead of trying to chose them all, try finding the sum of the accessories you already own to figure out what pairs best with them. Look in the mirror and casually check out each accessory you own, even if it's just a piece of jewelry.\\\", \\\"It's the clothes that impact the style, not the accessories. Try to choose a few that work for you.\\\", \\\"If you're wearing jewelry, a watch, a scarf, a hat and sunglasses, no one piece will stand out, and your outfit will end up looking cluttered. Choose a few accessories that accent your outfit or highlight the feature you want to play up.\\\", 'Less should be more and you should be giving yourself time to have fun even though you might not be letting loose with it. Even if you\\\\'re wearing a flashy piece or accessory it still falls into a \\\" sophisticated \\\" category.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}