{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"36343e38-1529-57f9-996b-7705381aefa0","task_key":"default--validation--47843","task_revision_id":"1","upstream_id":"47843","short_description":"HellaSwag validation 47843","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to tame poofy hair [title] Wash your hair as infrequently as possible. [step] Your scalp produces natural oils which provide your hair with a lot of moisture. When you shampoo your hair, you wash away these oils, leaving your hair dry.\",\"endings\":\"['Because of this, always wash your hair every two days, rather than every other day. Shampoo every other day and use conditioner to keep your hair moisturized and silky looking.', 'Instead of washing your hair every day, simply rinse your hair in the shower and shampoo only every 3-5 days. [substeps] If your hair looks greasy in between washes, use a dry shampoo to soak up the oil and add texture.', \\\"When you wash your hair, you don't rinse it well, but gently massage your scalp, then rinse it out with water. [title] Dry your hair before playing with it.\\\", 'Showering too frequently or spending time outside in extreme temperatures can damage your hair. [title] Use astringents to detangle your hair.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}