{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"086ff5c9-b7e6-5088-8fd8-70aee3a290fa","task_key":"default--validation--30919","task_revision_id":"1","upstream_id":"30919","short_description":"HellaSwag validation 30919","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to feel connected [title] Consider why you feel disconnected. [step] A simple \\\" thank you \\\" goes a very long way. Unfortunately, it is something that people who are close often take for granted.\",\"endings\":\"['Others may frown upon or insist you don\\\\'t \\\" feel \\\", whereas you are probably ignored or unloved, and simply cannot bear. Recognizing your emotional need to be connected, and experiencing any of the ways that it might involve giving a hug, even a simple \\\" thanks \\\", can help remove any uncertainty or trauma that you may feel during your recovery.', 'Being connected to someone who is disconnected from you also makes it easier to overreact. This is another reason why you find yourself irritable in a social environment.', 'Telling someone you appreciate their time, love, and efforts can strengthen your bond and help you to become more connected. [substeps] For example, cook your parents a dinner for no reason, write a friend a note, or simply tell someone how much you appreciate what they do for you.', 'When you realized who you are the first time around and\\\\'re ready to make the next big switch, \\\" self-connection \\\" will be sometimes overlooked. Pay attention to why you\\\\'re often disconnected without this person.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}