{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d7955cd9-9b9d-57dd-a6f4-42c770064ce6","task_key":"default--validation--35566","task_revision_id":"1","upstream_id":"35566","short_description":"HellaSwag validation 35566","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to choose wisely [title] Be calm and analyze the problem. [step] . Many poor decisions are made because people panic and don't think properly about the consequences of their decisions.\",\"endings\":\"[\\\"In other words, stressful situations can cause people to jump, fight, or avoid a given situation without thinking about consequences. Oftentimes, better decision-making strategies involves focus upon what you're doing.\\\", 'When you feel yourself becoming critical, take a moment to write down what you will be trying to accomplish. [substeps] For example, maybe you feel annoyed with your partner, but only because he never lets you make decisions like this.', \\\"Sometimes, people make the wrong decision and don't manage to find a solution, and this behavioral pattern can affect how you ultimately spend your money. [title] Identify what kind of expenses you are actually going to spend money on.\\\", \\\"Remaining calm and analyzing the options with a cool head is the best way to begin. [substeps] Take your time and choose well, but remember that nobody is perfect; sometimes you might make a risky choice or end up picking a solution you regret, and that isn't the end of the world, either.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}