{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b44c638b-2853-5abd-a3c1-267959fa37b5","task_key":"default--validation--31206","task_revision_id":"1","upstream_id":"31206","short_description":"HellaSwag validation 31206","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to style chin length hair [title] Use rollers to create voluminous waves. [step] Voluminous waves are great for a night out with friends or a formal event. It is a sexy and dramatic look.\",\"endings\":\"['Simply take a handful of your hair and divide it into sections in your regular style. You can also have someone else create a more voluminous style for you, or use their own hair product.', 'She often wears her hair in a ponytail, with the rest of her hair pinned to the side. [title] Use a low to medium effect with waves.', \\\"When you've spilled your liquids or left your hair wet, rollers are your best bet. [substeps] Lay a newspaper over a trashcan, it can stain your yard (neon green plastic containers work well).\\\", 'To get these waves, first part your hair to whichever side you prefer. Then, set your hair in 1.5 inches (3.8 cm) rollers.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}