{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"83b798fe-f79d-5a47-bf8d-85f821623362","task_key":"default--validation--19037","task_revision_id":"1","upstream_id":"19037","short_description":"HellaSwag validation 19037","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to have fun being naked [title] Create a self-love routine. [step] Establish a routine that helps you feel good about yourself. This can be anything--doing your hair, nails, or wearing something that compliments your body.\",\"endings\":\"[\\\"[substeps] Try shaving your legs, brushing your hair, or using self-care products to keep your skin soft and refreshed and improve energy and happiness throughout the day. Don't forget to wash your hair occasionally, too.\\\", 'Practice every day and get up in the morning to do it. [title] Unplug from your online activities.', 'But it should be something that you feel comfortable wearing, happy to be naked, and do, not something you would use just for fun. Some examples might be : [substeps] Bring some pastel sheets and toss them in the washing machine.', '[substeps] These tasks do not have to be body related. They simply need to be tasks that help you feel better about yourself.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}