{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e6227df5-f9e5-5601-b8f3-7ddd00422081","task_key":"default--validation--10641","task_revision_id":"1","upstream_id":"10641","short_description":"HellaSwag validation 10641","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to dress like an alpha [title] Hair can make or break your entire outfit. [step] So make sure it looks good. No frizzy hair, no out of place hair, and definitely no greasy hair.\",\"endings\":\"['Buy moroccan oil to control frizz, make hair soft, and add tons of shine. [substeps] Shampoo/condition everyday (or every other day, at the very least).', '[title] Take some time to shower before you leave the house. [step] This is supposed to ensure that your hair looks great and that nothing is wrinkled.', \\\"Don't wear out classy wear the same thing all year! So when cold and winter, wear classy do your best to pull it off. Keep messy, naturally wavy, and girly and your hair will look amazing and you will look awesome.\\\", 'Make sure that it only adds body to your look. Wear it down or put it up a little.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}