{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d9ee3b22-f4c1-539a-8832-04093c2edbe0","task_key":"default--validation--42741","task_revision_id":"1","upstream_id":"42741","short_description":"HellaSwag validation 42741","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to let go of something you cannot change [title] Journal about it. [step] If you cannot quite pinpoint what is causing you pain, suffering, confusion, or what is blocking you from letting go, spend some time writing about your experience and how you feel. You may realize that certain thoughts or beliefs keep you from letting go of something.\",\"endings\":\"['Write down a list of what drives that thought or belief. Then write down things you would like to change.', 'You can also learn to identify and express your emotions through journaling. [substeps] Be completely honest in your journal and share your thoughts and feelings.', 'You may also realize that a journal helps you recognize and accept this, both mentally and emotionally. However, you may not yet experience here.', 'Journaling might help you to identify what you are suppressing so you can move forward and make positive choices. [substeps] Look for interesting things or experiences that are a part of your everyday life.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}