{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1ca63f44-e810-59c2-9dc2-197674510dae","task_key":"default--validation--32404","task_revision_id":"1","upstream_id":"32404","short_description":"HellaSwag validation 32404","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have healthy, shiny silky hair [title] Handle your hair gently when you wash and dry it. [step] The way you handle your hair makes a big difference in its texture and appearance. When you're rough with your hair, it can frizz up and start looking dull.\",\"endings\":\"[\\\"Hair is a fragile material that should be handled with care, just like a delicate piece of fabric. Here's what to keep in mind : [substeps] When you shampoo your hair don't roughly scrub it.\\\", \\\"Keep an oil in it that's right for you when it's tangled. If you have curly hair, take off any curls or flyaways so your hair is wavy.\\\", 'Whenever possible, use a light product on your hair and blow dry it. This will help maintain your silky hair despite its lack of frizz.', \\\"Help prevent this by using a serlier or diffuser when you're washing and drying it. Use a diffuser if your hair gets too stiff while you wash it.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}