{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"27a713fa-f7e6-5206-b7de-2b42472805e9","task_key":"default--validation--13421","task_revision_id":"1","upstream_id":"13421","short_description":"HellaSwag validation 13421","config":"default","split":"validation","body":"{\"activity_label\":\"Relationships\",\"ctx\":\"[header] How to deal with a narcissist [title] Learn to identify a narcissist. [step] Before you start tossing the word around, you need to remember that a lot of people have some narcissistic tendencies but aren't necessarily narcissists. By learning what makes a narcissist, you'll be able to better avoid them and deal with the ones already in your life.\",\"endings\":\"[\\\"[substeps] For example, narcissists might tease and call you names that you'd rather not hear. They may say these things to you, but they might not mean them.\\\", 'Look for moments where you have little or no evidence of a narcissist. These moments may include : [substeps] Surprising your spouse during a break-up.', 'Ask yourself if the person : [substeps] Has an exaggerated sense of their own importance. Expects or demands constant praise and attention from others.', \\\"[substeps] A narcissist can be all about attention. They may be interested in someone else when they're talking about them but want someone else's attention right away.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}