{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"7610162d-9b43-51b8-9bd0-5f206a38eb3e","task_key":"default--validation--1754","task_revision_id":"1","upstream_id":"1754","short_description":"HellaSwag validation 1754","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to save money when you have a spending habit [title] Realize that you have a problem. [step] The first step to solve any issue is to be self-aware. It's easy to be in denial, so if you're conscious of your habits then you already won half of the battle.\",\"endings\":\"[\\\"But if you're insightful about them you'll be better equipped to assess your situation and take action to overcome it. [substeps] Ask for clarification if you can; you may be either losing money or difficulty in accomplishing your goals.\\\", \\\"Remember that having a problem is a reflection of yourself, so don't be shy about noticing it. [substeps] By acknowledging that you have a problem, you can develop confidence in your ability to have control over your habits.\\\", 'When you\\\\'re aware of the negative spending habits, you start second guessing every cash exchange, swipe and proceed to checkout click. Even if you continue to spend carelessly, the \\\" should i do this \\\" thought will linger in the back of your mind.', 'Ignoring this behavior can cause you to spend more money on other expenses. [substeps] Think about what you can do to change your habit and stick with it.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}