{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1bae686d-c971-5a38-a12e-a13bd25962de","task_key":"default--validation--42304","task_revision_id":"1","upstream_id":"42304","short_description":"HellaSwag validation 42304","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to become a technical writer [title] Get a bachelor's degree in technical writing. [step] Technical writers usually have a college degree. Having a relevant degree or training in the field can multiply your chances of landing technical writing jobs.\",\"endings\":\"['If you are looking to start school, explore degrees in writing and communication. [substeps] Technical writing degrees normally give you the option of technical, medical, and scientific options for your degree.', 'A major in technical writing or writing will significantly improve your chances of landing a coding job. [substeps] You can apply to a technical writing program if your university does not provide one.', '[substeps] Do not take a minor in english. The masters of technical writing and fine print will not adequately prepare you for technical writing jobs.', 'They can also boost your chances of landing writing writing jobs. [substeps] Some schools offer courses related to technical writing.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}