{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2fa00fbd-e740-5161-826d-a7c0014f3353","task_key":"default--validation--27369--variant-6a675c760cb3","task_revision_id":"1","upstream_id":"27369--variant-6a675c760cb3","short_description":"HellaSwag validation 27369","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to evaluate your depression management plan [title] Consider if your goals are being met. [step] Think about what brought you to confront your depression in the first place and what you had hoped to gain from managing your depression. If you see a therapist, you may have created goals together early in treatment.\",\"endings\":\"[\\\"If it has not been awhile since you made contact with an agency or someone who has taken steps to help you, the treatment may be a phase. Look for areas where you could improve : [substeps] You've been able to identify your strengths and highlight them.\\\", \\\"If you feel better earlier than you initially, you're more likely to move on. [substeps] For instance, are you being motivated enough to work harder and to exercise more than you normally would? [title] Celebrate and respect your dreams.\\\", 'Go over those goals and see how you are doing. Ask yourself what you want to improve and how you will improve it.', \\\"Don't assume your goals were met because of your relapse, but rather because you didn't get professional help. [substeps] Being able to identify your goals out loud or in writing can help you keep your head on straight and realize they are worthy of reflecting your perceptions.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}