{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2f1ecc18-aba4-58ed-9d9d-e140e1f5202e","task_key":"default--validation--38312","task_revision_id":"1","upstream_id":"38312","short_description":"HellaSwag validation 38312","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye your hair amber naturally [title] Take a cup or two of water and bring it to a boil on the stove. [step] ( add less rather than more because you can always adjust it later) you can use distilled water which is said to have a better affect but either way should work fine. [title] Add a berry tea.\",\"endings\":\"['[step] Just take a spoonful of the berry tea mix and pour it directly onto your hair. [substeps] This is a good way to get out some shimmer and color.', '[step] Basically any tea that turns a maroon or red when added. Hibiscus is a very good option because it turns red when added to water and its very healthy for hair.', '[step] When added to the water, a good amount of cinnamon oil, apple cider vinegar, rose water and honey provides great results. Just be careful, because making this tea in the morning will ruin the black face for days.', '[step] As your hair dye mixer gets hot, add one part of berry tea and one part of bicarbonate of lime juice (the lemon flavor). This will slightly change your hair color from an amber to a golden color.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}