{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"bcffe168-4528-5538-b8de-2e8493b0278a","task_key":"default--validation--5971","task_revision_id":"1","upstream_id":"5971","short_description":"HellaSwag validation 5971","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to say hello in vietnamese [title] Say \\\" xin chào \\\" as a general greeting. [step] If you only learn one vietnamese greeting, \\\" xin chào \\\" would likely be the best greeting to choose. [substeps] Pronounce \\\" xin chào \\\" as: sin jow the word \\\" chào \\\" means \\\" hello \\\" in english, but you would rarely use it alone.\",\"endings\":\"['Typically, you would need to follow the term with another word based on the age, gender, and familiarity of the other person. Adding \\\" xin \\\" to the front of \\\" chào \\\" makes the phrase more polite.', 'Not even aware of this distinction, however, many french speakers actually use it as a greeting in french because it is polite and easier to pronounce. [title] Mention the full name in a double dutch.', '[substeps] Patch, pants mal \\\" qué \\\" means \\\" hello \\\" in vietnamese, but you may also use it as \\\" qué. \\\" for english speakers, it is pronounced \\\" costa paina chào-qué.', 'You would probably do this while you are out with friends or working on a task for which you are not required to have your office address. [title] Greet regular customers with \\\" chee \\\".']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}