{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"9331d70c-3f5b-537b-b997-a7084ac673b4","task_key":"default--validation--42655","task_revision_id":"1","upstream_id":"42655","short_description":"HellaSwag validation 42655","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to become an interrogator [title] Decide if you want to serve in the armed forces. [step] The various branches of the united states military offer careers in the field of intelligence gathering, such as human intelligence collector for the u.s. army. These careers may not focus solely on interrogation, but you will likely be required to use your interrogation skills in order to get information vital to national security.\",\"endings\":\"['[substeps] Sure, you might expect a job in the intelligence field, but there are plenty of other professions. If your mission or position in the u.s.', '[substeps] To become an interrogator, you must be a non-gi and are working with certain populations. You will need a place to work and a name.', \\\"Do your research before embarking on any major career path. It is worth the investment to think about when in the field you'd like to work in.\\\", '[substeps] If you are considering a career in the military, speak to a recruiter to learn more about the requirements and the availability of positions that interest you. Be prepared to be deployed if you join the military.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}