{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"2e735211-ddcf-5cdd-be3e-71c94c04ba68","task_key":"default--validation--27245","task_revision_id":"1","upstream_id":"27245","short_description":"HellaSwag validation 27245","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to identify a narcissist [title] Watch for a change in behavior. [step] Most relationships with a person with narcissism will start off well. They will initially come off as friendly and confident, and seek to find ways to show that you two are similar.\",\"endings\":\"['Many narcissists display glazed anger over their own flaws or criticize themselves as well. Pick up on the signs of a change in behavior, like : [substeps] Sudden, abrupt, or drastic mood swings.', 'They will introduce themselves to you and then they may drop hints that you need to get on with your life. [substeps] For example, they might begin associating you with a medical professional after the fact, and go on and on about how loved that person is.', 'However, they may quickly change to be very hostile or angry to meeting new people. [substeps] This seems like a form of insurance, with the person appearing to hate new people.', 'They really are listening to you, at least at first, because being friends with you reflects well on them. [substeps] Their pleasant demeanor may vanish when he or she does something that might show weakness.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}