{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9acab2ce-b43a-537c-81f7-e771b7e2ae80","task_key":"default--validation--19004","task_revision_id":"1","upstream_id":"19004","short_description":"HellaSwag validation 19004","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to dye your hair rose gold [title] Purchase the proper supplies. [step] If you have dark hair, you will need to lift the color before applying any rose hues. While your hair doesn't need to be platinum for this to work, the rose color will not show up on brown hair.\",\"endings\":\"['It can \\\" dress \\\" brown hair however as well. To apply rose gold dye to black hair, purchase the following supplies : [substeps] 1 ounce (15 grams) of rose gold (approx.', '[substeps] This specific treatment takes up the least amount of processing space and requires two to three minutes to mix. You could opt for hair that is normally white or brown.', \\\"You will need : [substeps] A medium sized bottle with a cap. You'll find it at most beauty supply stores.\\\", 'You will need to reach a golden color before you can do anything else. [substeps] You can purchase a bleaching kit at your local beauty supply store.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}