{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"ef1af388-c0cd-5b67-a3f9-8401caddb5f8","task_key":"default--validation--656","task_revision_id":"1","upstream_id":"656","short_description":"HellaSwag validation 656","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become a radio host [title] Obtain practical disc jockey or radio presentation experience. [step] One of the first places to start is to get actual experience that will help boost a career in radio. [substeps] Take advantage of opportunities for local or institutional radio.\",\"endings\":\"['Find career opportunities on a variety of broadway radio networks, television networks, radio directories or radio broadcasting subnetworks. Be sure to develop your credentials in order to be hired to your assigned radio station.', \\\"Tell your boss, your manager, or your parents what you're interested in doing, and take advantage of the time you have to sit in between presentations to do it. Know who is working at the radio station and make a strong case for back-up.\\\", 'Both teaching radio and working as a radio announcer will do make you a better communicator in your field. Teaching radio presentations can help you overcome research that suggests you also have special skills that would otherwise come in handy for entertainment.', 'Many radio presenters who work for radio stations and other larger broadcasting venues got their start in smaller, localized radio presentations. One example is hospitals, where a hospital network may have its own localized radio broadcasted over a pa system.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}