{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5f6b1e9a-cf44-53cb-9d3f-1e3170383e37","task_key":"default--validation--13688","task_revision_id":"1","upstream_id":"13688","short_description":"HellaSwag validation 13688","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to get your pharmacy technician license [title] Meet the qualifications. [step] Before you apply for certification with the ptcb you will need to make sure you meet the basic qualifications. These will ensure that you will be able to progress through the process without trouble or losing your application fee.\",\"endings\":\"['[substeps] Only qualify if you meet certain academic and financial eligibility requirements. These requirements will vary from state to state.', 'Prior to applying, make sure you meet the requirements to be certified. [substeps] You must be at least 18 years of age.', 'Take a moment to review the following qualifications [substeps] High school diploma or equivalent. You will have to report any criminal records.', '[substeps] Fingerprints, licensing and exam scores are with the ptcb for eligibility. It is important that you meet these basic qualifications before you can get a pharmacy technician license.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}