{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5fa8f699-eaec-5327-8e6c-a36c63400212","task_key":"default--validation--36238--variant-fa2355f8d4db","task_revision_id":"1","upstream_id":"36238--variant-fa2355f8d4db","short_description":"HellaSwag validation 36238","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to speak nicely [title] Pronounce your words clearly. [step] People range in their ability to hear and understand language, and you have a greater chance of being heard and understood when you speak clearly. Practice with a recorder or ask a friend to help you learn to pronounce your words with more clarity.\",\"endings\":\"['[substeps] Stay in tune with your body language by remembering that your brows are raised at any emphasis. You should also keep your mouth shut so that you appear poised.', \\\"[title] Be more inquisitive by asking deeper questions. [step] If you're questioning your own words or even the people around you, take the time to learn how to ask them.\\\", '[substeps] You may work with your therapist or tutor for help if you\\\\'re having trouble with pronunciation of words that have to be pronounced in the center of the mouth. Other examples of sounds that would be heard with proper grammar include \\\" oh \\\" and \\\" uh.', 'Things that can help include slowing down, lowering the tone of your voice, listening to and borrowing from actors whose accent or tone you like, etc. [substeps] Avoid using a monotone (no variances in your speech).']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}