{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"74559026-8fe3-5823-869f-72263fb01ded","task_key":"default--validation--29389","task_revision_id":"1","upstream_id":"29389","short_description":"HellaSwag validation 29389","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deal with being fired [title] Try not to get angry or freak out. [step] Though you may be feeling intense feelings of rage or anger, it's important not to insult or yell at your boss or others in the office. Once your boss or hr supervisor tells you the news, try to swallow any anger in the moment.\",\"endings\":\"['[substeps] Getting upset at your boss or your co workers will only damage your reputation and create a scene. Rather than get mad, focus on getting out of the meeting with some measure of dignity.', 'If you are in a lot of shock at the news, your next best choice is to try to relax and get more in the mood. Calling out to a stranger at work you will probably be a little angry and then yelling at your boss.', 'Instead, focus on the good news and happiness rather than reacting immediately. [substeps] This can help keep your feelings inside and prevent any emotional fallout.', \\\"Sit down and think about how you want the news to affect your day-to-day life. [substeps] Knowing that you're being fired could have a very negative impact on your day-to-day work.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}