{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f82247c-d9be-5d9a-a7de-cfa0caa67e11","task_key":"default--validation--1593","task_revision_id":"1","upstream_id":"1593","short_description":"HellaSwag validation 1593","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be happy everyday [title] Acknowledge your emotions. [step] Being happy every day does not mean that you will be happy every moment. That is impossible and unrealistic.\",\"endings\":\"['This is part of the anxiety and self-awareness of single-dwelling individuals. This is most likely true for daily routines such as waking up a few hours earlier each day, or weekends.', 'Instead, aim to become a person who is well-rounded emotionally. Once you are comfortable feeling a range of emotions, you will be better able to get in touch with how to be happy.', 'Finding strength in your approach will mean recognizing your feelings and then accepting them. The first step to being happy at a particular time is to recognize that your moods are up and strong.', 'Instead, focus on how you feel every day. Examine all of your emotions with an impartial eye.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}