{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b7b8723-368f-5419-a559-1103a07f5fca","task_key":"default--validation--11933--variant-ca9bed225ccb","task_revision_id":"1","upstream_id":"11933--variant-ca9bed225ccb","short_description":"HellaSwag validation 11933","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to prevent hair from breaking off [title] Wash with a restorative shampoo to strengthen your hair. [step] While your hair is still wet, rub a quarter-sized amount of deep conditioner between your hands. Gently massage it into your hair from mid-length to tips.\",\"endings\":\"['This will act as a relaxer and tighten your cuticles. [substeps] You can purchase deep conditioner at most beauty salons.', 'Then, rinse your hair with lukewarm water. Always mix your shampoo and solution in a small bowl and rinse before bed.', 'Rinse away the conditioner with warm water. [title] Avoid the use of hot rollers or curling irons, as these are usually created from plastic and can cause breakage.', 'Then, pin your hair back and let it soak in for 10-30 minutes. [substeps] You can place a shower cap over your head to keep the deep conditioner in place.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}