{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0250182d-a7ba-56f6-8f01-5311abba6752","task_key":"default--validation--46774","task_revision_id":"1","upstream_id":"46774","short_description":"HellaSwag validation 46774","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to brush your hair [title] Pick a brush made with quality materials. [step] Never use a cheap brush! Low-quality plastic or metal bristles can snag and rip damaged hair at its weakest points. Instead, look for quality brushes made with boar's bristle or gentle synthetic fibers.\",\"endings\":\"['Soft bristled brushes are better than metal ones. Check your toothbrush to see what you use best.', 'Brush your hair once a day if possible, and brush it once to have it dry. Brush as you normally would, to prevent frizz and more damage.', 'These kinds of brushes help your hair stay put as you brush it, preventing possible damage. [substeps] Try to use a \\\" run-to \\\" brush if your hair is soft and natural.', 'If you invest in a high-quality brush and take good care of it, it will last for years. [substeps] You can find quality brushes for sale in salons, beauty supply stores, and online.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}