{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2dbe30dd-3be3-5bcd-8336-52e3b3ef9875","task_key":"default--validation--7920","task_revision_id":"1","upstream_id":"7920","short_description":"HellaSwag validation 7920","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to attend group counseling [title] Ask a professional. [step] Talk to a medical professional if you're interested in enrolling in a program of group therapy, like a doctor, psychologist, or psychiatrist. A nurse, social worker, or even a chaplain may also be of help.\",\"endings\":\"['Your doctor or psychiatrist may also be able to recommend your school or department if one of your classes has an psychology major. [title] Look into therapy courses offered through your preferred schools.', 'A faculty member may also be of assistance. There are similar reasons your doctor may be able to help : [substeps] Financial or health problems.', \\\"They should be able to advise you and to suggest options for the specific type of group therapy that you want to join-whether it's psychotherapy, support, or otherwise. [substeps] Be sure to follow up, as well.\\\", \\\"[substeps] If you don't know anyone in your school or college, all you need to do is contact your friend's teacher or coach. If, however, someone you know who graduated from high school, talk to them.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}