{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cc127d49-7be6-53b1-b9b1-9a41d64e206e","task_key":"default--validation--2900","task_revision_id":"1","upstream_id":"2900","short_description":"HellaSwag validation 2900","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style a bob [title] Dampen your hair or leave it wet after a shower. [step] This method is one of the most common ones for styling a bob, and it starts with your hair being wet. Spray or wet your hair if it is dry, or leave it wet after your shower before doing anything else to it.\",\"endings\":\"['[substeps] Mist your hair to make it wet before going outside. Spritz or spray your hair with mist or add leave-in conditioner to give yourself a spritz of moisture before you go outside.', '[title] Point your clippers away from your hair. [step] Place the pointed end of one end of the clippers against the front of your roots.', \\\"Towel dry the rest of your hair so that it is damp, but not dripping wet; you could also leave your hair drying outside at home. [substeps] If you washed your hair, don't put it in the dryer overnight; that will cause the cuticles to dry.\\\", '[title] Massage a styling agent, such as mousse or soft-hold gel, into your hair. [step] The styling agent will help to hold your hair in place once you style and blow dry it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}