{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f1fe1563-7edc-5fc2-a722-6a6af3179135","task_key":"default--validation--47712","task_revision_id":"1","upstream_id":"47712","short_description":"HellaSwag validation 47712","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to choose to be happy [title] Recognize your right to be happy. [step] Before you can begin to be happy in general, you have to believe that it's okay for you to be happy. You have to accept that you may not be perfect and may have made mistakes, but you still have the right to smile, laugh, and feel joy and excitement.\",\"endings\":\"[\\\"[substeps] It's important to notice and accept that you are imperfect. In fact, accept yourself the same way you are-remove a blank part of yourself that you didn't know you had.\\\", '[substeps] Knowing that you do have the right to feel happiness may help you maintain a positive attitude towards life and moving forward. Be mindful that engaging in any kind of work or hobby will only hamper you in doing so.', \\\"If you can't be happy, that's okay too. Recognizing how it's okay to be happy doesn't mean to give up your happiness and allowing the world to give you what it needs.\\\", '[substeps] Try looking in the mirror and telling yourself, \\\" i deserve to be happy, and that\\\\'s what i\\\\'m going to do \\\". In your journal each day, write an affirmation of your right to be happy.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}