{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ddd09272-84e5-53d7-8769-21e424b0e013","task_key":"default--validation--49122","task_revision_id":"1","upstream_id":"49122","short_description":"HellaSwag validation 49122","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye eyelashes [title] Choose an eyelash dye. [step] Never use standard hair dye when dealing with your eyelashes. Instead, look for a dye specifically formulated for use with lashes and brows.\",\"endings\":\"['[substeps] Eyelash dye products containing pigments are non-toxic when applied to hair. These products are not only formulated for the hair, but also to protect against the pigment.', \\\"Head to the store and pick out an eyelash dye container big enough to fit your entire lashes. [substeps] If you're using a strand of black hair, apply a thin layer of dye directly to each curl once you begin.\\\", \\\"[substeps] Standard hair dyes use chemicals that are dangerous to apply near your eyes, so you should never use one on your eyelashes. You'll have a few different colors to choose from.\\\", \\\"If you use kegel hair dye, make sure it's nonprescription. [title] Decide what length and thickness you want your lashes to be.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}