{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e930f050-adb0-572c-83a2-eb0fefecdbb3","task_key":"default--validation--37922","task_revision_id":"1","upstream_id":"37922","short_description":"HellaSwag validation 37922","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to stop being moany [title] Understand the problem. [step] Before you can find a solution, it's best to gather information and find out why people see you as moany. Ask your family members, friends, or colleagues about your personality and why they think of you that way.\",\"endings\":\"[\\\"Sometimes, you may not even be aware of how you're acting. You might have habits and behaviors that cause people to dislike you, so you should find out what they are.\\\", \\\"By finding out why everyone treats you this way, you can have a better answer to any fixation and function issues. [substeps] The biggest main reason why people tend to be mean or criticize you is simply because they think you're a sociopath.\\\", 'If your behavior is unwanted, tell them so. Also pay attention to the way you treat other people, and why they think that way about you.', 'They may have a very hard time explaining the problem to you. [substeps] Once you understand why, you are likely to have a new perspective about the situation.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}