{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"63d7f2f3-34af-593e-9435-6720294affa2","task_key":"default--validation--21253","task_revision_id":"1","upstream_id":"21253","short_description":"HellaSwag validation 21253","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to make your own wig out of weave [title] Maintain your hair. [step] Depending on your hair type, you may need special products to condition and treat your hair. From natural oils like coconut oil to specialty products like hair mayonnaise and a protein pack, use the right combinations that work to keep your hair healthy.\",\"endings\":\"['Always clean your hair before going through your stylist or straightening it. He or she should be able to tell you what styles and tonings work best for you.', \\\"A light amount of conditioner or oil is fine as long as you use it regularly. [substeps] Under-washing doesn't provide moisturizer as you don't want your hair to wear down and the texture of your wig may change.\\\", '[substeps] Curly hair becomes spikier and will return more easily in the first 48 hours. Loose or wavy hair may need trims or mousse to keep it on and out of the way.', '[substeps] Consult a stylist or haircare specialist to find what works best for you. There are natural essential oils and mixtures that can keep your hair moisturized like, lavender and rosemary if you are concerned with using a chemical formula.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}