{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b3fd6245-61d1-558e-8057-9dc730b0329b","task_key":"default--validation--8843--variant-d4972573d805","task_revision_id":"1","upstream_id":"8843--variant-d4972573d805","short_description":"HellaSwag validation 8843","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop forcing yourself to act okay [title] Stop worrying about what others think. [step] To be yourself and stop pretending, you have to stop analyzing how you come across to others. Not focusing on how you're acting allows you to instead focus on what you're doing, which is when people are typically themselves.\",\"endings\":\"['[substeps] If you see any people who come off as overly confident or arrogant, remind yourself that they\\\\'re not what they\\\\'re looking for. Put yourself in their shoes, and ask yourself questions like, \\\" am i acting okay? \\\" to set clear boundaries and respect yourself.', \\\"Not constantly seeking approval from others by pretending to feel good when you don't, allows you to be yourself, which is usually more enjoyable than putting on a charade. [substeps] Whenever you catch yourself worrying about others' opinions of you, quickly evaluate your situation.\\\", \\\"Here are some things you can do to give up the mentality that you're the total opposite of how the person looks at you : [substeps] Realize that you are human. At one point you might judge a person for being crazy, which may be hard, but this is okay.\\\", 'One study showed that replacing negative thoughts with positive ones can help \\\" force \\\" the behavior. [substeps] Example: maybe i am running late to class due to a coworker who isn\\\\'t impressed with my performance.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}