{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"8476042d-30c6-5e83-a007-3bd9c60fd197","task_key":"default--validation--26396","task_revision_id":"1","upstream_id":"26396","short_description":"HellaSwag validation 26396","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to thin eyebrows [title] Comb your eyebrows up. [step] Use a fine-toothed comb or spolie brush to brush all of the hairs in your eyebrows straight up towards the top of your forehead. This will help you identify any hairs that are unnecessarily long.\",\"endings\":\"['[substeps] Twist your fingers slightly towards your forehead. This will ensure that your eyebrow hairs are even.', 'This will also ensure that your brows stay relatively straight. [substeps] Doing this will also help them retain their natural shape while you wait for the product to blend into your eyebrow hairs.', '[title] Hold the comb at the top edge of your eyebrow. [step] After you comb the eyebrow hair upward, stop the comb when the teeth are rested just above the top edge of your eyebrow.', '[substeps] Apply 1-2 coats of eyebrow gel to your eyebrows before and during the waxing session to keep them from falling out. [title] Trim your eyebrows with a fine comb.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}