{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b0048fa2-e8e8-53e1-b531-c0aeb0eb7da9","task_key":"default--validation--631","task_revision_id":"1","upstream_id":"631","short_description":"HellaSwag validation 631","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to wear a sports bra [title] Select a sports bra made of moisture-wicking material. [step] You want your sports bra to be made of moisture-wicking material that is breathable. Most new sports bras these days contain technology to wick away sweat, making them the ideal choice for working out.\",\"endings\":\"['[title] Choose a sports bra made of breathable materials. [step] High-quality sports bras should not be too loose-fitting because this could send heat into the necessary space and encourage sweat from the hard to reach tissues in your body.', 'This makes them perfect for work or after sports practice. [substeps] In addition to sweat, sports bras also help to protect your arm and leg from heat, and can go well under shorts or other form-fitting gear.', '[substeps] Not everyone has how much of the material they need for a workout in their bras. Less is more, as sport bras tend to last longer.', \\\"Try to steer clear of cotton, which tends to soak up moisture and stay wet. [substeps] Choosing a moisture-wicking material will also help to regulate the temperature of your body as you're working out.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}