{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"168a0a6e-970e-5e09-8ed4-936678bbb117","task_key":"default--validation--21365","task_revision_id":"1","upstream_id":"21365","short_description":"HellaSwag validation 21365","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to be an effective public speaker [title] Know your audience. [step] This includes the expected size of the audience, as well as their age, gender, educational background, and socioeconomic status. It's also important to know their level of knowledge about the topic you're presenting.\",\"endings\":\"[\\\"If you're making a speech geared toward particular people, for example, they are already a lot more informed regarding the subject you're talking about. Figuring out what your audience is thinking and feeling will help you get them to open up.\\\", 'Knowing this essential information can make you get ideas and go forward with your speech more efficiently. [substeps] Level of knowledge is the characteristics of the audience you are presenting to.', \\\"Finally, consider how the audience views you and what they will likely expect to gain from your presentation. [substeps] For example, will you be presenting to people who are relatively new to the topic, or are you speaking at a professional event where people will have some familiarity? You'll need to adjust your material to fit their needs.\\\", \\\"Figuring out who to speak to can often be difficult. [substeps] In the 1500's, mass communication was very difficult.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}