{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1909cffb-8513-5f35-837a-626f90d1cc62","task_key":"default--validation--30968","task_revision_id":"1","upstream_id":"30968","short_description":"HellaSwag validation 30968","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to make your parents proud of you [title] Be a great listener for people who need it. [step] Your friends, family members, and even people you don't know very well will sometimes need an open ear. Pay attention if people share their stories or problems with you.\",\"endings\":\"[\\\"Don't interrupt or zone out, or try to shift the conversation to focus on you. If someone's asking for your advice, let them tell you their whole problem before weighing in.\\\", \\\"Most often, people need positive feedback or encouragement to improve their lives or improve their relationships. [substeps] It's normal to want to talk to your friends and family and to need to hear what they're going through.\\\", \\\"You don't have to be perfect, just make sure to be attentive. If someone is talking about a bad or severe situation, remind them that you are there for them.\\\", 'Show them that you are listening by holding onto them often without interrupting them. [substeps] If someone is struggling with a life crisis or getting ready for a big move, be there to help them.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}