{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d1264712-3eac-522a-b5ad-cb2a5d3c8d36","task_key":"default--validation--37577","task_revision_id":"1","upstream_id":"37577","short_description":"HellaSwag validation 37577","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become a sterile processing technician [title] Obtain a high school diploma or a ged. [step] You should have a strong background in science. [title] Take certification courses at community colleges, career colleges, or take an online course.\",\"endings\":\"['[step] This will help you hone your skills. [title] Take the required licensing exam or placement exam every year.', '[title] Visit a blood testing center in midtown, wisconsin. [step] Ask the receptionist what environment they will test you in.', '[title] Complete advanced courses in mathematics, chemistry, anatomy, science, and english. [title] Pass your undergraduate and technical college exam.', '[step] There are several schools which offer online courses. Career colleges offer 10 weeks programs, community colleges-1 to 2 years programs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}