{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"be75636b-99f4-5d75-8236-8559dfb11fed","task_key":"default--validation--26692","task_revision_id":"1","upstream_id":"26692","short_description":"HellaSwag validation 26692","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to deal with dumb people [title] Lower your standards. [step] This one is tough, but very important. Part of the reason that you may find yourself constantly frustrated by the stupidity in the world is because you have unrealistic expectations.\",\"endings\":\"['Different people may have different backgrounds, different opinions or different priorities in their life. Remind yourself that the \\\" average \\\" person isn\\\\'t going to meet your high expectations of how a person should think and act, and lower your standards accordingly.', 'If you got mad and you find out a new coworker or student is acting stupid, keep your lower standards going. \\\" stupid \\\" people are just that, stupid people.', 'In some situations, their arrogance stems from a lack of empathy for how they behave. Rank them on a pedestal of \\\" classy \\\" and\\\\' cool\\\\' (or just be indifferent), so that their behavior is inconsequential.', \\\"That is why it's important to understand why dumb people will not succeed at their career. [substeps] When a person's intelligence falls far below what he/she is supposed to be able to do, it makes him/her far too immature for his/her field or field.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}