{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c7967a4e-cc50-52a0-a009-e4cb14c9b9e3","task_key":"default--validation--16002","task_revision_id":"1","upstream_id":"16002","short_description":"HellaSwag validation 16002","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to enhance your hair color using tea [title] Brew chamomile tea to gently lighten. [step] Steep 2-3 tea bags of pure chamomile tea in a cup of boiling water for 10 minutes. Let cool and transfer to a spray bottle or pour directly onto clean, damp hair, then rinse.\",\"endings\":\"['[substeps] Leave in for 30-60 minutes or longer, or sit out in the sun with the chamomile tea still in for stronger results. Add additional ingredients to the spray such as lemon juice, white vinegar, or raw honey to help strengthen the lightening effect.', 'Wash and condition when your hair is dried to your desired strength. [title] Do not mix together the essential oils from tea to add texture.', 'Do this 1-2 times daily to cleanse your hair of dead skin cells and restore hair texture. [substeps] Keep the make-up in your ritual jar with you at all times and make sure you use a fragrance-free shampoo for light to medium tones, medium and dark.', \\\"[substeps] Be careful with your hair-chamomile tea is a naturally astringent, and doesn't generally damage the hair. If you don't want to steep tea bags, you can run your fingers gently through your hair.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}