{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dd0fb531-6a93-5a34-8e66-353775981302","task_key":"default--validation--45383","task_revision_id":"1","upstream_id":"45383","short_description":"HellaSwag validation 45383","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to take your hairstyle from day to night [title] Dampen your hair. [step] Creating waves from a bun is a great option for long hair. When you want to use a bun to create waves in your hair, it's best to start with at least partially damp hair.\",\"endings\":\"['So before you start, use a towel to blot at the spot you want to put the hair. [substeps] A good rule of thumb is to dry your hair with a towel before putting it in your bun.', \\\"If you're washing your hair in the morning, blow or air dry it halfway before creating the bun. If you don't plan to wash your hair, lightly mist it with a spray bottle filled with water.\\\", \\\"[substeps] Curly hair will look effortless and frizzier without a damp head because it's smooth and shiny. If your hair isn't as dry as you want it, don't go crazy.\\\", 'If you want to leave it down overnight, blow dry it. [substeps] A hairdryer usually works best.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}