{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"010ae5cb-aecb-5e08-a3a8-f4151704ec81","task_key":"default--validation--21547","task_revision_id":"1","upstream_id":"21547","short_description":"HellaSwag validation 21547","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to become a laser hair removal technician [title] Know your state requirements for laser hair removal technicians. [step] There are no federal laws governing laser hair removal, so each state has their own regulations. Make sure that you know what those regulations are and find a school which will give you a certification recognized by the state where you intend to work.\",\"endings\":\"['[substeps] Some states, beginning with arizona, will require a certain number of training hours, around 40 hours of class time. About 24 hours of hands on training could also be required.', '[substeps] Any professional laser hair removal clinic or hair delivery service will publish their certification documents on their website. The processing label will tell you what the blue sticker will say on it.', \\\"Make sure that you find a school that is accredited by your state's state university. [substeps] If you decide to work on your own, start looking into enrollment at major universities in your area.\\\", \\\"[substeps] You must have at least 2 years of experience working with laser hair surgeons. In some states you don't possess additional qualifications, but you can still follow the federal law.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}