{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"6f9d14a8-4178-5dcd-851c-8e3562d8e4eb","task_key":"default--validation--35639","task_revision_id":"1","upstream_id":"35639","short_description":"HellaSwag validation 35639","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to make people think you are confident [title] Picture what a person lacking in confidence looks like. [step] She may hang her head low, slouch, take up as little space as possible, and avoid eye contact. This posture is associated with submission and anxiety.\",\"endings\":\"['She might also collect her handbag or backpack, look into the bag as though it was her only way home, and avoid eye contact. This may seem like a flirt, but unless she is really the hottest girl on the planet, it might not even be.', 'Your nervous energy grows when you spend undeveloped money on your clothes or accessories. You may feel self-conscious but look eager and excited when you need something.', 'When this posture is abused, you are more vulnerable. [substeps] Imagine how you feel on the inside out.', 'This body language reinforces and sends the message that you are nervous, submissive, and lack confidence. Changing your posture and body language will alter the impression you make on others, their behavior towards you, and eventually your own perception of yourself.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}