{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"03ec8208-48f7-5ca7-9eb8-a9b6cbb628e7","task_key":"default--validation--38014","task_revision_id":"1","upstream_id":"38014","short_description":"HellaSwag validation 38014","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get shiny hair while using a flat iron [title] Shampoo and condition your fine hair. [step] Step in the shower or tub and run your hair under warm water. Apply a small amount of lightweight volumizing shampoo directly to your scalp.\",\"endings\":\"['Work the shampoo into a lather and then rinse it out with warm water. Coat the ends of your hair (from mid shaft to the tips) with a small amount of lightweight volumizing conditioner.', 'Once you are all wet, allow your scalp enough time to absorb the shampoo. [substeps] You should be able to feel this from anywhere in your head but it most often occurs just under the hair shaft.', 'Make sure to wash it out, then apply it to your scalp. [substeps] Do not forget to apply conditioner.', \\\"Run your hand over your hair, rubbing shampoo into it from the roots to the ends. Do not wash your hair as the conditioner will not balance your hair's shine.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}