{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"83cc432e-95eb-5fa2-889e-f02ba3ff2430","task_key":"default--validation--7913","task_revision_id":"1","upstream_id":"7913","short_description":"HellaSwag validation 7913","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to look pretty and slim [title] Eat healthy. [step] Eating healthy is a very important thing. Eat good proportions though.\",\"endings\":\"['Full fats or fat rich in other, healthy fats should be looking good every day. Get enough of them out of your diet.', 'Try to drink 6 cups of water three times a day and especially smaller glasses if you like. [title] If you have a large chest, then drink plenty of water daily.', \\\"Don't eat too much of that food because it can be bad for you even though you may be eating healthy foods. Start eating whole grain toast or more veggies.\\\", 'Not only does eating cut down on the amount of calories consumed by your body, but it is also vital to your health. Some health standards say to eat 500-800 calories per day for women and 400 calories per day for men.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}