{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"64744293-4cce-59d6-b362-659e37872082","task_key":"default--validation--30329","task_revision_id":"1","upstream_id":"30329","short_description":"HellaSwag validation 30329","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to stop taking zoloft [title] Consider why you want to discontinue taking zoloft. [step] You should generally continue taking zoloft if the medication has effectively controlled your depression or disorder. However, there are good reasons to discontinue or change your medication under the supervision of a doctor.\",\"endings\":\"['[substeps] People often leave a prescription for a different drug for a different reason. If you are taking zoloft to control the effects of your depression, you will need to consult a doctor.', '[substeps] For example, you might try other anti-depressants or ssris. Ssris may lead to weight gain or obesity.', \\\"To support your reasons for discontinuing zoloft : [substeps] You've not taken zoloft for a long time because of its high potential for unwanted changes in mood. You've been diagnosed with hyperglycemia.\\\", 'These reasons include : [substeps] If you experience severe or continuous side effects. If your depression or disorder is not under control with zoloft.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}