{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"69b3bf30-b365-50cd-a03e-7998a4962d20","task_key":"default--validation--26890","task_revision_id":"1","upstream_id":"26890","short_description":"HellaSwag validation 26890","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to be a happier person [title] Think positively. [step] It's impossible to have a challenge-free life, but your attitude makes all the difference with how you respond to life's challenges. Positive thinking means how you approach difficulties with a positive outlook.\",\"endings\":\"['By focusing on the positive aspects of every situation you know that outweigh the negatives of every situation that pops into your head, you will be able to get a better work-life balance and lower your anxiety. [substeps] Identify and empower yourself to see obstacles as opportunities.', \\\"Knowing what makes you happy and what will make you happy can help you overcome challenges that don't exactly match your beliefs. A positive attitude is one that helps you avoid setbacks.\\\", 'You have reason to feel sad and angry when decisions are made in opposition to what was meant to be or is not supposed to be. Your attitude can prove to be a big step towards being a happier person if you take the time to admit that there is not a right answer to every question.', \\\"It doesn't mean you avoid or push away unpleasant experiences, but that you see the best in situations. [substeps] Thinking positively means reminding yourself that negative events are temporary and opportunities to learn and grow.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}