{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c09b0082-b849-5742-90e5-ec0f6f84ff16","task_key":"default--validation--10967","task_revision_id":"1","upstream_id":"10967","short_description":"HellaSwag validation 10967","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a destination wedding photographer [title] Take professional photography courses. [step] Before you jump into the specifics of becoming a destination wedding photographer, you must become familiar and comfortable with all the technical aspects of being a photographer. Enroll at a professional photography institute or take classes as your local community college.\",\"endings\":\"['These courses will teach you about local photography, the role of the bride, and planning various wedding functions while providing you with additional studio experience. [substeps] One advantage of a wedding photography program is that you will be seen by photographers to be new to photography in the area.', \\\"You should also take classes on digital photography, since these do not hold up well with the cover shots required for an entry-level position. [substeps] If you are not sure what level of photographer you'd like, your local university may be the perfect place to start.\\\", \\\"[substeps] Don't assume that you have to attend a top photography school. Learn the basics, regardless of where you go, and practice constantly to improve your skills.\\\", '[substeps] Be familiar with the 100-200 subjects your subject will need to know in order to become a destination wedding photographer. You must know basic chemistry, photography skills, and how to load and fire an espresso.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}