{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"72fbbd5f-ba03-5c67-b8f1-c5a593f7ef6f","task_key":"default--validation--40690","task_revision_id":"1","upstream_id":"40690","short_description":"HellaSwag validation 40690","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to apply eyeliner to the waterline [title] Apply a concealer. [step] Take a little of the concealer you normally use for your skin tone and dab a little just below your eye line using your fingertips. Applying concealer can help the eyeliner stay in place longer.\",\"endings\":\"['[substeps] Always wash your face before applying makeup and be sure to wash makeup off of your face at the end of the day. This will help keep your skin clear and healthy.', \\\"[substeps] If you apply concealer before you apply eyeliner to your waterline, eyeshadow may drip down onto the area and it can ruin your eyeliner routine. It's best to keep your makeup minimal in this stage, for example.\\\", \\\"[substeps] Dab a little eyeliner on the tip of the eyeliner brush once you're happy with it, then place it dab dab close to your waterline. Take another dab, this time a bit lighter.\\\", '[substeps] Apply concealer to the outer corner of the lid for a smokey look. You can use a matte line going into your other eye if you want the lines to appear dramatic.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}