{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f23140d1-3356-5fc6-a291-8cfbf480aad0","task_key":"default--validation--28552","task_revision_id":"1","upstream_id":"28552","short_description":"HellaSwag validation 28552","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wash micro braids [title] Prepare your hair for washing. [substeps] As micro braids are quite delicate, you will need to arrange them properly to prevent possible breakage or damage while washing. Before entering the shower or bath, braid your hair into 4 to 6 larger braids.\",\"endings\":\"['Place the head of the braid into the shower and secure a hair tie to the top of the braid to secure the sections. Once secure and your hair is as straight as possible, twist the braids the same direction, and secure the sections with a hair clip to keep them tight.', 'Tie a hair tie around the number of braids you desire. After having the braids arranged well, you can wash your hair and towel dry it.', 'Keep the braids relatively loose to allow the water, shampoo, and conditioner to permeate all strands of hair. Secure the end of each braid with a rubber band or other type of hair tie.', 'If you have curly or curly hair, you may prefer a smaller braid. If you have curly or wavy hair, a smaller braid will best begin to work.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}