{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"eb7775fc-c72d-56ef-bb13-d5707fe7d366","task_key":"default--validation--41970","task_revision_id":"1","upstream_id":"41970","short_description":"HellaSwag validation 41970","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to live a fuller life after middle age [title] Decide what's most important to you. [step] Now that you've passed middle age, you really don't need to be wasting time on things you don't enjoy. That means you need to figure out what you do enjoy spending your time on.\",\"endings\":\"[\\\"If you're not devoting more time to it, you're really off on the right foot. You also don't need to spend all of your time thinking about stuff you really want to accomplish (like finding a job or fulfilling your own little dream).\\\", \\\"Maybe you love throwing yourself into your work, or maybe your home life is more where you're focused. Maybe you love to travel and have adventures.\\\", 'Being married or having children is perhaps the most important thing to you about yourself in general. Consider what activities and talents you enjoy most-such as traveling, playing an instrument, and controlling certain things.', \\\"[substeps] It's all about the things that matter to you personally. What you enjoy, what you don't, or what bothers you the most are the factors that make you want to focus all your time on yourself.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}