{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3a7ddf04-25db-5ed5-98f4-cbc9591b8ceb","task_key":"default--validation--4384","task_revision_id":"1","upstream_id":"4384","short_description":"HellaSwag validation 4384","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to use blurring powder [title] Apply blurring powder after your regular makeup. [step] Blurring powder is generally used to enhance existing makeup and help further smooth over any inconsistencies in your skin tone. Before applying blurring powder, put on your makeup as you regularly would.\",\"endings\":\"[\\\"If you're changing your makeup every day, you'll probably notice that blurring powder tends to stay on even if you carry it with you. Practice dabbing it onto affected areas until you get the hang of it.\\\", \\\"Once you're finished with your normal makeup routine, you can apply the powder as necessary. [title] Shake the container to loosen the powder.\\\", '[substeps] Reapply blurring powder of one dimension to protect your skin. Apply the blurring powder after you have dressed to increase its coverage.', 'Make sure you are putting on no more than 2 layers to get the most effect on your eyes. [substeps] Wipe your makeup off before you apply blurring powder.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}