{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cae0fd53-f9f9-5f6d-b0fa-cf39206bde86","task_key":"default--validation--17320","task_revision_id":"1","upstream_id":"17320","short_description":"HellaSwag validation 17320","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to do your makeup successfully in the morning [title] Wash your face! [step] This clears your skin of any grime or dirt that could possibly be built up underneath your skin. [title] Put on foundation. [step] Your skin color is unique! When going shopping for foundation there are different types of foundation basically being powder and liquid.\",\"endings\":\"['[substeps] Liquid foundation adds protection from factors like sun exposure, wear to school, dirt, and skin type. Powder foundations add a bit of shimmer.', 'There are 2 that cover your entire face, three that cover much more skin. The first type would probably work for morning look.', 'A good foundation should not wear off during the day, and should match your skin color! [title] Put on concealer. [step] You can skip this step if you have clear skin.', 'Choose your preferred one and get it in order for your face to look good. [substeps] The most basic foundation for your face is banana powder, but you can experiment to find a different one or apply other makeup to your face for more coverage.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}