{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6d9fd87e-4a53-521d-8ea4-e2452f0c4723","task_key":"default--validation--49050","task_revision_id":"1","upstream_id":"49050","short_description":"HellaSwag validation 49050","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to become cpr certified [title] Identify reasons to get certified. [step] There are many reasons to get certified in cpr. Some of the most important ones include : [substeps] You can save lives-it teaches you to be aware of your surroundings and recognize signs of cardiac arrest and other debilitating situations.\",\"endings\":\"['You can defend yourself if someone is choking on you or you feel the need to terminate the cpr training unit. [title] Publish your requirements for cpr training.', 'You are better equipped to assist others in need. Studies have shown that cpr certified individuals are more likely to lend a hand in time of need.', 'People in cpr would benefit from volunteering and on medical training programs. Though there are all sorts of certifications awarded to recognized medical students, there are only a few ways that you can get a certification.', 'You can help cover up fires-make medical emergency medical diagnoses happen quickly and effectively. You can encourage people to stop smoking and to use breathing purifiers such as artonite and prozac that protect people at all times.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}