{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"dfe1db2c-764a-5978-9e1e-5b5419cb0627","task_key":"default--validation--28744","task_revision_id":"1","upstream_id":"28744","short_description":"HellaSwag validation 28744","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to benefit from interpersonal therapy [title] Talk to your doctor. [step] The decision to use interpersonal therapy should be discussed with your doctor. If you have depression or a similar condition, you may decide to try interpersonal therapy prior to medication, or you may decide to combine medication with the therapy.\",\"endings\":\"['Once you have discussed your concerns, you can decide which therapy approach is right for you. [substeps] Determine if you want to involve a doctor or a therapist in your therapy.', 'Your doctor will help determine the best treatment for you, and you may begin to feel better after. [substeps] Some people may not feel comfortable using an interpersonal therapy program.', '[substeps] Many forms of interpersonal therapy are used to help dependents or people with depression who have highs and lows. Participating in an interpersonal therapy session may help you better understand what to expect.', \\\"[substeps] If you don't already have a therapist or psychologist, ask your doctor for a referral. You can also search online for therapists who treat your mental illness and use interpersonal therapy.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}