{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9ae6007f-c79a-55ec-a2f0-22e2e79e6320","task_key":"default--validation--34092","task_revision_id":"1","upstream_id":"34092","short_description":"HellaSwag validation 34092","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear makeup without overdoing it [title] Apply primer, foundation, and concealer. [step] Primer creates a base for the rest of your makeup to stick to, meaning you can apply less and achieve a more optimal effect. Foundation will help even out your skin tone, and concealer will hide blemishes and discoloration.\",\"endings\":\"['[substeps] Whichever foundation you choose, take a professional, powdery makeup primer (non-stick). Place concealer, eyeshadow, pencil or cream over your brows if you have one, then you need to erase any dark circles.', \\\"When you're done applying foundation, follow up with concealer to blend any blemishes further and keep your look fresh. [substeps] Primer and concealer will help get the same effect, but stick to darker foundations on darker circles.\\\", \\\"Concealer can be primer-based or you can choose to choose your own. Once you've chosen your makeup, use the lid at the top to frame the nose, and then swipe concealer all the way up the bridge to ensure even coverage.\\\", 'The key is to apply each sparingly. [substeps] Put a small dollop of primer on your finger and apply a thin layer all over your face.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}