{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"98f630a0-e70b-5ea8-8c19-b02a76b84f59","task_key":"default--validation--39747","task_revision_id":"1","upstream_id":"39747","short_description":"HellaSwag validation 39747","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to look confident at social gatherings [title] Stand up tall. [step] Probably the easiest way to look confident is to have a confident demeanor. If you are slouched over, no one will believe in you.\",\"endings\":\"[\\\"Stand tall and don't slouch. Don't make fun of yourself, just act confident.\\\", 'Instead, look up to people with the main goal of being confident. Aim for being tall with strength and confidence and then survey the crowd.', 'Making yourself tall communicates victory, like you just won a competition. [substeps] Body language (nonverbal communication) makes up 60% to 93% of how others perceive you.', \\\"Take a firm look in the eye when people talk to you, and smile when people are around you. This makes you also remember how to act when you're at parties and meetings.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}