{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"33a70308-04d7-5b9d-a2b8-875f9a7d766a","task_key":"default--validation--50544","task_revision_id":"1","upstream_id":"50544","short_description":"HellaSwag validation 50544","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to get even [title] Play it cool for the time being. [step] Sometimes getting even is a way to release negative emotions like anger which can be unhealthy. Don't show your hand, or your anger right away and say you're going to get even.\",\"endings\":\"[\\\"It's not your best idea to burst out like a hurricane, reach in front of the player and blast him with a cross from press. This situation isn't going to get you anywhere since you're in a different room and don't want to deal with any tension between you.\\\", \\\"Show that this anger is natural and engaging. You can continue the game until you feel you're really calm.\\\", 'You are probably likely to be upset because it would be your fault if you said, or did something like that. And you could inadvertently do other things that would hurt your feelings.', \\\"Instead react honestly, and make your target think he's won. This way he'll be less likely to expect payback.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}