{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c0d60d30-63cc-5aef-9ded-e36e3fb02acd","task_key":"default--validation--4777","task_revision_id":"1","upstream_id":"4777","short_description":"HellaSwag validation 4777","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to enjoy retirement [title] Manage your expectations. [step] To start, you'll want to manage your expectations. If you're anxious to get out of a stifling career, you may think retirement will be glorious.\",\"endings\":\"[\\\"However, your expectations may not be realistic based on certain circumstances. If you're a true retirement enthusiast, you may worry that retirement is unanticipated.\\\", 'Consider defining your expectations as \\\" hard work, \\\" and what activities you\\\\'ll enjoy doing. Deciding on what activities are fun, rewarding, and enjoyable for you will help you adapt to the unexpected.', \\\"Although this idea might seem like you're friends with benefits, you may not take your retirement in the immediate, immediate way that you want. If you're capable of being in a thriving career after you retire, it's important to identify and manage your expectations.\\\", \\\"However, it's very normal for the transition into retirement to be stressful. Try to keep your expectations realistic, and expect some sadness in the early days of retirement.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}