{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"79aae5a8-33ea-5468-a5d5-5e811603d552","task_key":"default--validation--10175--variant-2a223d167ade","task_revision_id":"1","upstream_id":"10175--variant-2a223d167ade","short_description":"HellaSwag validation 10175","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to hone your memory through the beauty of art [title] Grab the moment. [step] Everything seems to revolve around our childhood. The problem is that as we age we tend to forget that which shaped and molded us into who we are today.\",\"endings\":\"['And, we feel no control over our decisions, so we train ourselves to interpret things as natural. Let go of physical pressure and focus on what truly makes you who you are.', \\\"Today society is way too high paced and we just don't seem to have time to reflect on times past. The truth is, we have the time, we fail to grab the moment.\\\", 'That knowledge leads to distrust, resentment and stereotypes. The beauty of art is the authentic image we surround ourselves with, which shows us who we really are.', 'So once you understand you will begin to gain that experience. [substeps] Watch the moment on tv or take photographs.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}