{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3f66c26b-6c28-5a41-b195-9e6ba629f355","task_key":"default--validation--16648","task_revision_id":"1","upstream_id":"16648","short_description":"HellaSwag validation 16648","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to color hair with food coloring [title] Lighten or bleach your hair, if needed. [step] Food coloring is translucent. This means that it only adds to whatever color is already there.\",\"endings\":\"['If you want your hair color to be darker, you need to add more food coloring in the same way you would lighten or bleach it. Mix it up with your hair color to achieve a dark, realistic color.', 'If you have dark hair, the dye may not show up at all. If you have light brown or brown hair, the dye will turn out darker.', \\\"For this reason, it's often best to use food coloring instead if you are dyeing your hair light and it has damaged it. [substeps] The beauty of foods lightening (or bleaching) hair is it absorbs the nutrients from the food dye in a more effective manner.\\\", \\\"Most people tend to use food coloring once or twice a week, so if you're prone to lightening hair, go ahead. [title] Create a mixture of dyes and artificial hair products.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}