{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"f4db3525-415f-58c7-be2c-1fd7a6647cf8","task_key":"default--validation--903","task_revision_id":"1","upstream_id":"903","short_description":"HellaSwag validation 903","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to not have a big ego [title] Stop comparing. [step] Regardless if it is directed towards the positive or the negative, playing the comparison game can result in greater anxiety, depression, and poor decision-making. There are always two sides to a coin.\",\"endings\":\"['Accept the fact that you have those things instead of trying to get rid of them. The other person may think you did a good job trying to get his or her thing, but neither can you.', 'You may look at someone and say yourself \\\" i\\\\'m so much better at this than him \\\". It is just as likely that the other person surpasses you on some other trait.', \\\"True, everyone's perspective cannot be completely altered if we do not see the positive in everyone we treat. So always try to see each situation differently.\\\", 'Improve if possible, and choose your side. [substeps] When you compare yourself to your ideal opponent, your mind automatically picks up on the inherent validation and positivity.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}