{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a84ec81d-e703-53b9-a2f4-9b5f87655e61","task_key":"default--validation--8405","task_revision_id":"1","upstream_id":"8405","short_description":"HellaSwag validation 8405","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your hair stand up [title] Wash your hair. [step] You'll have an easier time adding volume to your hairstyle if you're working with clean hair. Gently dry off with a towel when you're finished.\",\"endings\":\"['[title] Blow dry your hair from head to tail. [step] Use flat dry hair is what all the adults used to say.', \\\"You can also skip this step if your hair is very clean, but you can't mess with the part you just washed. You can separate your hair into four pieces and wash them all in the same washing cycle.\\\", \\\"Make sure you use products specially designed for working with hair. [substeps] If you have light hair, it's a good idea to skip products like blow drying it straight, rubbing alcohol into it, or straightening it a bit (as well).\\\", '[title] Massage 1 tablespoon (15 ml) of pre-styling mousse into your damp hair. [step] Rub a palm-sized amount of mousse between your hands, and then run your fingers from the front to the back of your scalp.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}