{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f9c66957-598c-5ab8-9e73-9295afe9637a","task_key":"default--validation--39803","task_revision_id":"1","upstream_id":"39803","short_description":"HellaSwag validation 39803","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to define your personality [title] Make a list of your traits. [step] Traits are the parts of you that don't usually change much over time. They are characteristics about you that may be positive, while others might be a bit more negative.\",\"endings\":\"['Decide what aspects you do need the most because what the benefits of your personality need vary from person to person. You may need to consider the following qualities : [substeps] Intelligence social capacity mutual respect for others personality (i.e.', \\\"[substeps] If you identified traits that make you unique, then take detailed notes about those characteristics. If you don't have traits to make a list of, then you can work on developing your own characteristics.\\\", \\\"Are you outgoing, brave, kind, nurturing, responsible, and happy? [substeps] If you don't want people to know, don't describe yourself; simply define who you are. It's always easier to distinguish some traits from others, even if they are different.\\\", 'Your personality is the sum of all these traits and characteristics and is what makes you a unique person. Listing your traits can help you define your personality.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}