{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"29ee211d-bba4-515f-b2cb-ec6e91ec99b7","task_key":"default--validation--17368","task_revision_id":"1","upstream_id":"17368","short_description":"HellaSwag validation 17368","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have a pretty face [title] Get plenty of sleep. [step] It is very important for your overall health to get at least eight to nine hours of sleep every night. A lack of adequate sleep will translate through your face with dull skin and dark circles under your eyes.\",\"endings\":\"['As you are getting older, the increased frequency of sleeping will lead to dry skin, sunken eyes, and more trouble with lighting up. To ensure you get enough sleep you might consider : [substeps] Studying for exams or tests try not to sleep more than three hours every night, as this will make you sleepy more.', \\\"You'll need to aim for about seven to nine hours of sleep a night for most of the day and in the morning. [substeps] Aim for seven to nine hours of sleep a night.\\\", 'Also, once you miss a night of sleep, you cannot make it up later by over sleeping because the damage is already done. In order to keep your skin looking fresh and bright, create a regular bedtime schedule.', 'You will need to hit the gym or do some classes, like crunches or chin up exercises, every day. Regular sleep will also help tone your complexion and make your face softer and less defined.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}