{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ee808b21-db09-54e8-add5-47856f013546","task_key":"default--validation--37396--variant-eb4b242c6c77","task_revision_id":"1","upstream_id":"37396--variant-eb4b242c6c77","short_description":"HellaSwag validation 37396","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to treat fried hair [title] Get a haircut. [step] When your hair is fried, it's usually the ends that show the most damage. A visit to your hair stylist for a cut can instantly make your locks look better.\",\"endings\":\"['[substeps] Say something like, \\\" i\\\\'ve really wanted to get my hair cut, and you can help me do it. Would you mind making an appointment to work with me on my hair? \\\" the stylist can critique you and mark the areas where you missed a dime-sized cut or two.', \\\"That doesn't mean you have to go for a super short cut, though. Getting regular trims can help your fried hair look healthier.\\\", 'People with hair that is fried most often make the most mistakes as they tend to more frequently dye their hair back lighter colors. Ask your stylist if they allow you to leave your hair down, or if they make their own custom cuts for the treatment.', \\\"Find a stylist that's good with your hair, and ask them to cut your hair for you. [substeps] If you have fine or curly hair, ask your hairdresser to trim it manually, or you can do it yourself.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}