{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"755922aa-0c13-5483-880b-b38baae51223","task_key":"default--validation--47551","task_revision_id":"1","upstream_id":"47551","short_description":"HellaSwag validation 47551","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a wedding officiant in new york [title] Find a church that ordains people online. [step] Online ordination has grown in popularity in recent years. In order to keep costs down and make the ceremony more personal, engaged couples are increasingly asking friends or family members to get ordained online and officiate their wedding.\",\"endings\":\"['Many churches produce online referral letters and community service service applications, but still there are some who allow students to get ordained online. [title] Contact the catholic church and holy trinity church in the area that ordains people into bishop positions.', 'New york recognizes ordinations received over the internet as valid, though in some cases additional paperwork is required. [substeps] There are a number of churches that provide online ordinations, so do some research and choose one that you think is a good fit.', 'Online ordination can be done in two different ways. [substeps] Social media: online states that the person being ordained currently has a social media presence and can get those links in an instant.', \\\"Finding one that is highly acclaimed can also help you get hired. [substeps] You can also find churches in new york through a rabbitet in arkansas or you can call the clerk's office and talk to the scheduler at advance of the ceremony.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}