{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9877977-da95-579c-9798-be50db159e74","task_key":"default--validation--40401","task_revision_id":"1","upstream_id":"40401","short_description":"HellaSwag validation 40401","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to transition from dyed to natural gray hair color [title] Get mixed color highlights or lowlights. [step] You can try to dye your hair a lighter color closer to gray, but this can still leave a line. Adding in small colored areas is less noticeable and can smooth out the transition.\",\"endings\":\"['[substeps] If you have naturally light hair, instead add in white highlights. If your hair is lighter, choose green highlights.', 'Highlights brighten the color through infusions and highlights, which can be applied with a brush. Lowshadows are different from lowlights, so skip highlighting and lowshadows.', 'Highlights are generally lighter and closer to your natural gray shade. Lowlights can be used to break up the gray.', '[substeps] If you have gray hair, you can dye it the opposite color. Highlights are a good option if you plan to dye your hair near the hairline.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}