{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"02428b81-9ec5-5063-bd01-bdd8649f664d","task_key":"default--validation--45809","task_revision_id":"1","upstream_id":"45809","short_description":"HellaSwag validation 45809","config":"default","split":"validation","body":"{\"activity_label\":\"Food and Entertaining\",\"ctx\":\"[header] How to relate to an introvert [title] Avoid passing judgement. [step] People with introverted traits can seem like they have no problem socializing; they may be able to trade quips, be quick witted, put on presentations for school and work with seeming ease. Introversion is not shyness, social anxiety nor avoidant behavior.\",\"endings\":\"['They are capable of expressing themselves in a way that makes their needs apparent from a distance. [title] Determine if they are also introverted.', 'Just because introverts can pull out the social fireworks when necessary does not mean that they are not in fact introverted or are faking it. You don\\\\'t know how \\\" passing \\\" by being social and extroverted in a given situation affected that person.', 'Your introverted temperament and attitude make people rather open than enthusiastic. But it is often better to accept this for a respectful attitude.', 'It can be able to smile and have fun, talk in polite tones. But self-introverted individuals who are not like these can do not take criticism well and may misbehave very badly and may lash out at other people.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}