{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9aed71b4-722a-5108-8241-c89c7d1422e5","task_key":"default--validation--10593","task_revision_id":"1","upstream_id":"10593","short_description":"HellaSwag validation 10593","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become an adoption counselor [title] Earn a bachelor's degree in counseling, psychology, public health or social work. [step] You will be working directly with clients, so you should be highly trained on how to work through conflict, provide emotional support and work with government or other agencies. [title] Apply for an internship with a counseling office or agency.\",\"endings\":\"['[step] Take this opportunity to gain experience working with people who are going through an emotional process. Also, decide whether you have the communication skills and emotional strength to handle the requirements of the job.', '[step] Depending on your major, you may need to apply for internships with a mental health clinic. Leave room in your graduation application for a solo internship.', '[step] The internship it takes to become an adoption counselor can be quite rewarding. But know that while most internship programs take 1 to 3 years, it is still incremental each person is seeking certification.', \\\"[step] In most cases you need some experience working with children and teens to qualify for an internship. It's important to go into this field looking for jobs quickly and be prepared to do good from place to place.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}