{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6ba04fb0-92b3-54ff-b7e2-0809fe70a651","task_key":"default--validation--18191","task_revision_id":"1","upstream_id":"18191","short_description":"HellaSwag validation 18191","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply pressed powder foundation makeup [title] Wash your face with a mild cleanser. [step] Use one pump of facial cleanser and lukewarm water to wash your face. Focus on areas of oil build up, such as the forehead and nose, scrubbing with your fingertips to deep clean.\",\"endings\":\"['This will remove dirt and oil from your face. [substeps] Your face might feel oily, so try to clean it out.', 'Rinse your face with cool water to close your pores, and dry with a clean towel. [substeps] Cleansing your face will remove surface oils and create a clean canvas for your makeup.', \\\"Avoid applying makeup in small areas so that you don't damage the actual makeup. [substeps] For particularly oily face, you may need to do a deeper cleaning before applying your powder foundation.\\\", '[substeps] If your face is deep in oil, feel free to put a little cornstarch into your wash for oil recharentities. [title] Cover your face with a layer of powder foundation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}