{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"cbbc9086-a1b0-5630-b3bd-2065e4c53aea","task_key":"default--validation--17252","task_revision_id":"1","upstream_id":"17252","short_description":"HellaSwag validation 17252","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to get out of a fight unharmed [title] De-escalate the situation. [step] De-escalation means reducing tensions between you and the person who is fighting you or wishing to fight you. To de-escalate the situation, don't antagonize the hostile person.\",\"endings\":\"['You want to effectively show the other person that you are not responding to their aggressive personality. [substeps] This includes not immediately jumping into an argument with the confronter, or even a screaming match.', 'Instead, find a safe space where you and the other person can breathe and talk without interruption. [substeps] Say, \\\" we\\\\'re in a fight.', '[substeps] At first, you may want to diffuse the situation so the hostile person has something to go on. Then, if the person is not taking your argument seriously, deescalate with an alternate approach.', 'Express your disinterest in fighting. [substeps] For instance, you might say, \\\" i am not interested in fighting.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}