{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0483ab5f-d292-55af-a42c-ab7b5f0f8e21","task_key":"default--validation--34565","task_revision_id":"1","upstream_id":"34565","short_description":"HellaSwag validation 34565","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to create a beauty regime [title] To begin, look in the mirror. [step] Have acne? Consider wearing a primer and foundation. Dark circles under your eyes? Concealer is the answer.\",\"endings\":\"['Makeup? You should consider wearing it in the morning. After applying the primer, lightly cleanse your face with water.', \\\"Run a tiny powder over your face so no blemishes. Even pale pimples seem big! Find a product you like and keep it on your face but don't smudge or tear up.\\\", \\\"Want your eyes to pop? Eyeliner and mascara is for you. [title] After deciding what you need to wear, go shopping for your makeup, if you don't already have it.\\\", 'Try to smile) and try to keep your lips and gums clean. In the morning, you can go to sleep refreshed! Do not forget moisturizers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}