{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ff358704-ad8b-59bf-91fc-a32a90ac2724","task_key":"default--validation--21304","task_revision_id":"1","upstream_id":"21304","short_description":"HellaSwag validation 21304","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to be your own person [title] Be unique. [step] Don't alter your style for the latest fashion; don't purposely oppose it either. Dress how you feel and how you like.\",\"endings\":\"['Embrace yourself (for instance, long-sleeved tee shirts and no pants), and own what you like. Let go of your wealth and talents and seize every opportunity to express whatever is important to you.', \\\"Who else do you want to be like? Many fashion gurus embrace being unique: artists with unique style, engineers with unusual style, and celebrities with artistic style, for example. However, the similarities between normal people and unique styles have not affected what kind of things you look like, so always be yourself and always be others' equal.\\\", 'Most celebrities, particularly rock stars, like taylor swift sometimes dress up on fashion talks and hit the streets looking for playmates to look like them. Make sure to be unique for your life.', \\\"If others don't like it, just don't care. It will be hard at first, ignoring them, but if you keep on doing it, they will stop taunting you.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}