{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d306668c-749c-5b5c-b1a7-c6eca82e5115","task_key":"default--validation--25073--variant-37263b167d1f","task_revision_id":"1","upstream_id":"25073--variant-37263b167d1f","short_description":"HellaSwag validation 25073","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to bow politely [title] Know when to bow. [step] Bowing is typically used in asian cultures to show respect, honor, or gratitude. A silent bow often replaces the phrase \\\" thank you.\",\"endings\":\"['\\\" in asian cultures, you should bow from the hip with your head pointed down. Polite bowing is still common in many asian countries, but it is not practiced as strictly in america.', '\\\" a silent bow means \\\" good morning \\\" or \\\" evening. \\\" about 5-6 decades ago, bowing was thought of as common and customary courtesy.', '\\\" [substeps] If you want a silent bow, you need to know when and where to bow at. For the majority of asian people, a silent bow signals deference to someone behind them, such as a teacher or student.', '\\\" [substeps] Say \\\" no \\\" in an indian language. ( \\\" please \\\" is the sign for \\\" attendee \\\" in chinese.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}