{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b01b8ee4-cff4-5089-8a23-90ba22b82fa4","task_key":"default--validation--36242--variant-82c12c36efe7","task_revision_id":"1","upstream_id":"36242--variant-82c12c36efe7","short_description":"HellaSwag validation 36242","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be positive when surrounded by negativity [title] Avoid taking things personally. [step] People who speak negatively oftentimes have a bad habit of doing so. It may be aimed directly at you, but more likely it is merely about the myriad of other factors which are going on in that person's life.\",\"endings\":\"['It is difficult to face an onslaught of negativity, and especially so when you are the target of it. But keep in mind that the complaints are likely just a way for the individual to vent.', \\\"[substeps] You may also be coming across as bad if you shift the focus across from yourself. This may include making remarks about others having things others don't like, sharing opinions that belong to another person, or expressing opinions that you disagree with.\\\", \\\"Reacting negatively towards the person you care about has little to do with you representing themselves to this person, or acquiring their respect. [substeps] If you, for example, remember when your mom always told you that you didn't look smart to begin with, consider confronting her on the issue again.\\\", 'Listen to your gut and often call on help to truly step outside of your comfort zone. [substeps] Your own emotional investment is not a factor in your life and should be taken seriously as it would be impossible to make someone change.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}