{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"38e8d31f-c000-5ed4-a6c3-7625cc5fc0cc","task_key":"default--validation--7759","task_revision_id":"1","upstream_id":"7759","short_description":"HellaSwag validation 7759","config":"default","split":"validation","body":"{\"activity_label\":\"Philosophy and Religion\",\"ctx\":\"[header] How to gain wisdom [title] Try new things. [step] It's hard to gain wisdom when you stay in and do the same thing day after day. You get wiser when you put yourself out there and give yourself the opportunity to learn, make mistakes and reflect on the experience.\",\"endings\":\"['If you tend to be on the inhibited side, work on cultivating an inquisitive spirit and the willingness to put yourself in new situations. Every time you experience something new, you open yourself up to the possibility of learning and getting a little wiser for having tried it.', \\\"Chances are, you will become more wiser as you study, learn and be more active. [substeps] Try things that doesn't require your full concentration.\\\", 'Taking the initiative to do something new might not improve your mindset, or keep you from trying something new. Take the initiative to try new things, and spend your daily existence maximizing your wisdom.', 'Find some new topics to do and then get out there and do something! Changing your stress levels can really help to, adapt and build your enthusiasm towards it all. [substeps] Try martial arts, in which you organize competitions and compete in the ring.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}