{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"3fdcfb1e-de3c-5a68-a4d7-c228023b86fa","task_key":"default--validation--23073","task_revision_id":"1","upstream_id":"23073","short_description":"HellaSwag validation 23073","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop labeling yourself as an underachiever [title] Look closely at your expectations. [step] If you are labeling yourself as an underachiever, this means that you are accomplishing less than you expect. So it is possible this lies not within your work, but instead in your own expectations.\",\"endings\":\"['In fact, you may not even be fully aware of the high expectations you have for yourself. Take some time to truly reflect on what you think you should be accomplishing.', 'Underestimating your own achievements is one of the most common reasons people share idealised attitudes toward a given academic subject. [title] Think about the reasons why you want to change the viewpoint.', '[substeps] In order to fully identify if you are making a false assumption, make a list of the things you expect to achieve and how many you expect to accomplish in a given experience. This list will guide your labeling abilities as you evaluate your own assumptions.', '[substeps] If you expect your work to go more smoothly if you are unreasonably stressed out, ask yourself why. Is your productivity slowing or worsening? Have you stopped driving? Have you crossed the street? Have you fallen victim to loneliness? Remind yourself that you are deserving of all that you are given.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}