{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d320b04e-1233-5828-a177-312c9323de5e","task_key":"default--validation--29900","task_revision_id":"1","upstream_id":"29900","short_description":"HellaSwag validation 29900","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to end a best man's speech [title] Use family-friendly language in your ending. [step] Weddings typically include guests of all ages. Even if kids aren't in attendance for your speech, the couple's parents and grandparents probably are.\",\"endings\":\"['Inquire about these possible ways to end, including message phrasing, phone messages, or shared birthday cards. If only a few individuals are in attendance, light a lavender scented candle and attempt to buy the couples a nice ending.', \\\"That's why they may be listening. [substeps] At the end of your speech, consider literally handing your guests your wedding certificate and date-stamped envelope.\\\", 'Leave explicit language and dirty jokes at home. [title] Avoid using humor to criticizes others.', \\\"If there are large family members present, you should use those as part of your ending. Your child's parents and grandparents are often more likely to be in attendance, and they'll be more willing to have you and their older children be present.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}