{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b82850ce-c287-5232-8cec-2c368ba77537","task_key":"default--validation--36763","task_revision_id":"1","upstream_id":"36763","short_description":"HellaSwag validation 36763","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to deal with drama queens or kings [title] Refuse to participate in the drama. [step] The dramatic person wants attention, and by participating in whatever crisis she's attempting to drag you into, you're feeding that need. If you resist this, and refuse to engage with her, you can short-circuit the whole situation and possibly diffuse the drama.\",\"endings\":\"[\\\"[title] Remember, you're your own worst enemy. [step] Of course, you're not the reason for drama, but how you react will depend on what other people around you think.\\\", \\\"[substeps] Don't let this person guide any drama. She'll probably take out the spotlight and make fun of your negative actions.\\\", '[substeps] If you have to, try to leave the room with something more appealing to the character. Set your phone away and let the dramatic woman have her way.', \\\"[substeps] If the dramatic person starts up, simply tell her outright that you won't be putting up with it. You can do so firmly without also being rude or harsh.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}