{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"4153e419-baee-5bd5-bb98-da90fa0d9970","task_key":"default--validation--20103","task_revision_id":"1","upstream_id":"20103","short_description":"HellaSwag validation 20103","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to learn good habits [title] Understand how habits are formed. [step] Habits have a lot to do with brain chemistry and everything to do with psychology. If we do something enough times, the brain will adapt to fit it.\",\"endings\":\"['[title] You probably know what a good habit is. [step] It is \\\" consciously recognizing \\\" a habit or maintenance habit that allows us to decide what to change? We can restore the same habit by trying with a different method.', \\\"Trying to pull out all the stops before you start the trick doesn't give the brain time to correctly adapt or get used to the new habits. It's vital to learn the habits that your brain uses and which ones don't.\\\", 'The most common and safest activity that we use when living a good life is a good habit. [substeps] Strong habits can also mean we do bad things (e.g.', 'Left to our own devices, we will follow things that make us feel good, and avoid the things that make us feel unpleasant. Even when we know something like exercise (adding discomfort) or dieting (removing comfort) will help us more in the long run, your current brain chemistry will do anything to get you to stick to your routine.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}