{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d589ff54-e61e-5039-9c06-bf091b37826e","task_key":"default--validation--5533","task_revision_id":"1","upstream_id":"5533","short_description":"HellaSwag validation 5533","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to become friends with a guy that doesn't know you exist [title] Create a better look for yourself. [step] A solid personality never goes unnoticed! Concentrate on yourself first, dress better, and create a look that suits you best. For example, if you have pretty eyes, use an eyeshadow/eyeliner/mascara to highlight your eyes.\",\"endings\":\"['Enhance your sense of humor by being more formal. Wear different hairstyles and dress the same.', 'Wear proper fitted clothes, use make up that enhances your features, accessories that compliment your attire. The look you carry speaks even before you actually speak.', 'If you have good cheeks, touch up with a foundation foundation or concealer. If you have hair, hair accessories can be a big help.', 'If you have a cute nails or a great smile, use a bit more makeup then you would normally. You need to ensure that your makeup matches your hair as well as your clothing/accessories.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}