{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8073ea2f-f852-5a85-859b-01ce16f9c280","task_key":"default--validation--27396","task_revision_id":"1","upstream_id":"27396","short_description":"HellaSwag validation 27396","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply neutral makeup for special occasions [title] Wear natural makeup when you want your own skin to show through. [step] Natural makeup is sometimes confused for neutral makeup, but the two are quite different. A natural look is casual, fresh, and dewy and is used to achieve a refreshed \\\" just woke up \\\" look.\",\"endings\":\"['[substeps] Some wear concealer on your face, which will blend in as your foundation dries. But you should follow the same rule if you decide you want your skin to show through.', 'If you want your makeup to really look cute, go for a natural look when you really want to be fresh and sleepy. [substeps] You can wear a fresh green eyeshadow on the top lid, and a lipstick on the bottom lid.', 'Natural makeup, on the other hand, will be slightly more casual. Put makeup on and naturally loosen up with refreshing water, your favourite perfume or body spray.', 'A casual look is achieved with minimal makeup. [substeps] Sheer or light foundation might be used so that the skin, freckles and all, still shows through.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}