{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4fb3a30e-e457-5dd5-b0f9-8dd1858051d3","task_key":"default--validation--28202","task_revision_id":"1","upstream_id":"28202","short_description":"HellaSwag validation 28202","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make a lace front wig [title] Measure the head. [step] Hold the tape measure on the natural hairline and run it back to where you want your lace front piece to stop. The length of your lace front piece is up to you.\",\"endings\":\"[\\\"If you'd like, use the tape measure to mark your hairline on top of the wig. [substeps] If you prefer to take measurements at night, you can always measure the head just after bed.\\\", '[substeps] Next, measure from side to side. Hold the tape measure just in front of one ear, where the hairline ends.', \\\"[substeps] If you don't want your wig to be so long, don't bother measuring your head. You can buy wig measuring kits at a wig supply store.\\\", 'Measure your head from the hairline to the tips of your bangs, then measure again from the hairline down your middle along your forehead. [substeps] This is the \\\" hairline \\\" measurement for your wig.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}