{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2b362e3c-9d4d-5133-a58c-84a9aa940afa","task_key":"default--validation--10461","task_revision_id":"1","upstream_id":"10461","short_description":"HellaSwag validation 10461","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to deal with opinionated people [title] Figure out if you need to confront this behavior. [step] Interacting with opinionated people is unavoidable, so, you'll have to pick your battles wisely to make sure that you're not engaging in verbal warfare when such people cross your path. Not every annoying comment needs to be dealt with.\",\"endings\":\"['[title] Reward the person for his or her perceived rudeness. [step] There will come a time when you should keep unliked comments fresh in your head as the person may take offense or start to resent them.', \\\"These folks will become extremely annoyed if you are left to your own devices to vent the frustrations they throw at you. Once you've determined the issue, you'll have options.\\\", 'Also, it may not be in your best interest to try to confront a person. [substeps] Is this an opinion worth spending your time disputing? Some opinions may be annoying but is pointless to argue.', 'Try to come to a resolution with these \\\" ums \\\" of people before you decide to keep bothering them. [substeps] If you\\\\'re feeling down, excuse yourself for a moment and speak to a trusted close friend, family member, or neighbor.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}