{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f976fcf8-d764-562b-9ec6-2f60b1c61bad","task_key":"default--validation--32289","task_revision_id":"1","upstream_id":"32289","short_description":"HellaSwag validation 32289","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to make memorable sales calls [title] Build rapport by listening. [step] People like to do business with people they like. The first portion of the discussion is all rapport building, or small talk.\",\"endings\":\"['The more comfortable you are talking to the person, the better your natural flirting will appear. [substeps] Ask an interested opinion or ask questions about what someone says.', 'Ask about the customer and share about your life, too-hometown, current neighborhood, college stories, favorite sporting teams, vacations, golf, books, current events, good news and goals. All of these topics lead to a deeper, more meaningful discussion.', 'You can let the other person speak at their own pace as they talk, but remember to pay attention and listen attentively. This is one of the health benefits of working with someone you already know and trust.', \\\"You want to keep things clear before you ask, and build on topics common to almost any business talk. [substeps] Pay attention to anyone's body language and tone.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}