{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b6a354f0-006b-506a-818a-103ad5c63840","task_key":"default--validation--38935","task_revision_id":"1","upstream_id":"38935","short_description":"HellaSwag validation 38935","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get straight hair without using irons [title] Purchase straightening products. [step] Straightening shampoos and conditioners are formulated to loosen curls. Shop at beauty supply stores and hair salons for the best products, or ask a salon expert to assist you.\",\"endings\":\"['A good rule of thumb is to choose hair products that are beauty-only. Products with sulfates or african american features will not give you volume, just encourage moisture.', '[substeps] Many common hair styling products are cosmetic, so be sure to inspect a manual product to identify the part of the hair before attempting to apply it. Use scissors to cut the hair as close to the roots as possible in order to avoid damaging hair.', '[substeps] Read the ingredients listed in the shampoo and conditioner that you purchase. Make sure alcohol is not one of the primary ingredients, since it will dry out your hair and make straightening more difficult.', 'Some hair stores even have products designed specifically for flat hair, and you can choose to make your own shampoo instead! [substeps] The best products for flat hair are sulfates, styling cream, etc. Avoid products that say \\\" sulfates, \\\" which are shampoos.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}