{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"d76addab-3bf0-5f33-bb2b-748e29b026bc","task_key":"default--validation--8119","task_revision_id":"1","upstream_id":"8119","short_description":"HellaSwag validation 8119","config":"default","split":"validation","body":"{\"activity_label\":\"Personal Care and Style\",\"ctx\":\"[header] How to be peaceful [title] Practice what brings you peace. [step] Finding internal peace begins with identifying what makes you feel calm. Consider activities you enjoy that leave you with a sense of peace and calm.\",\"endings\":\"['Then, ask yourself if those activities bring about peace. Some ways of discovering inner peace include taking a day off from work so you can spend more time with friends, family, and some of your more passionate coworkers and associates.', 'Make time in your schedule to practice calming and centering activities on a regular basis. Some peaceful activities may include : [substeps] Reading a book.', \\\"For example, on a friday night where you enjoy reading and had a good night's sleep, identify these activities. Integrating them into your daily routine will help you de-stress and reduce anxiety triggers.\\\", '[substeps] Art is another good example of being peaceful. Paintings are calm unless they have been put up for decoration or display.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}