{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"1f262299-da49-5db8-a943-e1608f92dcb1","task_key":"default--validation--46080--variant-afa3ec012ce0","task_revision_id":"1","upstream_id":"46080--variant-afa3ec012ce0","short_description":"HellaSwag validation 46080","config":"default","split":"validation","body":"{\"activity_label\":\"Computers and Electronics\",\"ctx\":\"[header] How to stop being bullied [title] Don't react with more bullying. [step] Although it might seem tempting to fight back with bullying, it can cause further problems. Bullies enjoy feeling as though they have power over you or that they are able to get a reaction from you.\",\"endings\":\"['Know your strengths and weaknesses and take control. Remember that bullies are considered strong people and deserve to be treated with respect.', 'Bullying back or getting angry will let the bully know they are hurting you. Do not respond to the bully with more aggression in order to get them to leave or stop.', 'Not only will this lower your chances of getting bullied by a bully, but it also prevents you from getting the reaction you want. [substeps] You can try to break the bullying cycle by not being mean and allowing it to just get worse.', '[substeps] When you are bullied in the workplace, it can be one of the most intense times of the day and you might feel weak or wobbly in your seat. You might find yourself climbing all over your co-workers to get your attention.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}