{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77461a41-f88c-5631-adc6-5e90bcb046cf","task_key":"default--validation--24041","task_revision_id":"1","upstream_id":"24041","short_description":"HellaSwag validation 24041","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to cope with arrogant people [title] Enter an encounter with an arrogant person with the strong and confident realization that you are well and strong. [step] When you feel sound within your own self, there is nothing an arrogant person can say or do to undermine you. Your sense of confidence and self-worth will prohibit you from being vulnerable to an arrogant person.\",\"endings\":\"['[title] Try a variety of approaches to identify the person arrogant and go from there. [step] Once you find someone who you can confidently and correctly identify with, go back to the following strategies.', 'The arrogant person may be unable to relate to you and might even say noxious or cruel things but you can let it slide when you feel secure in yourself. [title] Use the encounter as an opportunity to improve your own listening skills or tolerance.', 'Pick the right time and place to approach the person and speak directly. [substeps] You may approach the person after work rather than during a break or when they are not busy working at the office.', 'You will not be forced to tolerate the pull and manipulation which will drive you to become incredibly insecure. [title] Try meditation or something else that helps you in all aspects of your life.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}