{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"a4dbc1d2-dc12-5bc8-af25-6a8934648ff1","task_key":"default--validation--44943","task_revision_id":"1","upstream_id":"44943","short_description":"HellaSwag validation 44943","config":"default","split":"validation","body":"{\"activity_label\":\"Health\",\"ctx\":\"[header] How to keep your brain in top shape [title] Go outside your comfort zone. [step] Your brain is like a muscle and requires challenges and novelty in order to more fully develop. Once you determine that a certain area of study or mental activity is outside your comfort zone, push yourself to attempt it anyway.\",\"endings\":\"[\\\"If not, you'll add experiences you wouldn't be able to expect. [substeps] For example, taking up running has been shown to increase brain apids levels.\\\", 'A good rule is that comfort is not good for your brain. Aim for unsteadiness and uncertainty in learning.', '[substeps] For instance, instead of learning to stand upright, you could drop on the ground and kneel down with your legs bent. You could wait for a teacher to be around, say, \\\" you really did so well on that big test today, paul.', \\\"[substeps] Working outside will always allow your brain more opportunities to develop. Start with small chunks of time outside of your office, around lunch or bar, or somewhere you know you'll get a good workout.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}