{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4803ec7b-c10a-54fa-9c6f-76a638b9ead7","task_key":"default--validation--40647","task_revision_id":"1","upstream_id":"40647","short_description":"HellaSwag validation 40647","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to bleach your hair at home [title] Assess the risk. [step] The best results happen on hair that has not been colored before and hair that is light brown or lighter. You can bleach darker hair, but it will require some patience, and the damage will inevitably be greater.\",\"endings\":\"['You will also need go through the bleaching process several times in order to see the results you want. [substeps] Professional colorists recommend spacing out bleachings by a few weeks.', 'Your best options for hair length will vary, but in general, you should look for a natural color that you like. Try to pick the color that is most natural to you.', 'Start by looking at your hair to see how much color you will need. Only you know your hair color and risk factors, so do not use a foundation while bleaching.', \\\"Coloring can be tricky, but with an experienced stylist you should be able to achieve that, as well as get the right fade. [substeps] Dyeing your hair' lighter' determines your undertone to keep it from turning brown during the bleaching process.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}