{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"82535fb1-3a61-507b-8102-ac33d716024d","task_key":"default--validation--29404","task_revision_id":"1","upstream_id":"29404","short_description":"HellaSwag validation 29404","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to cosplay as poppy moore from wild child [title] Have perfect skin. [step] Absolutely no exceptions. Poppy has the most flawless skin on her face, and you must have too.\",\"endings\":\"[\\\"If you spend time going to the salon and applying makeup to make sure all skin is flawless, it's hard to look like poppy moore. Your skin needs to be soft and bare to look like poppy moore.\\\", 'Find a regular beauty regime for your face, and stick to it. Deal with zits properly and make sure you are always fresh-faced.', 'Always use a little bit of concealer or vaseline (no formula) on your face to keep from looking like a nut shell. [title] Keep your hair simple and well-kept.', 'In life, you should be sun exposed as much as you can, because get sun tan! [title] See a makeup artist. [step] Everyone, absolutely everyone, wants to look like poppy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}