{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"083de3df-9e49-5aa9-b5d3-1d825fd42d79","task_key":"default--validation--30089","task_revision_id":"1","upstream_id":"30089","short_description":"HellaSwag validation 30089","config":"default","split":"validation","body":"{\"activity_label\":\"Family Life\",\"ctx\":\"[header] How to become a wedding officiant in california [title] Find a church. [step] Consider what faith or denomination would best fit your beliefs, and what requirements that group sets for becoming an ordained minister. Sit in on a few services at local churches to see if their style and focus are a good match for you.\",\"endings\":\"[\\\"[substeps] Think about the different types of church you would like to attend, and what you feel most comfortable attending. While these aren't always quite as important, they'll help keep you focused on your passions when you're allowed to attend.\\\", '[substeps] Speak to your friends and families about their belief systems before choosing the church you want, or keep in mind that you might need to convert some services to accommodate families and clergy. It is important to find the best church for your faith, but do not rule out any protestant faith and any other denominations.', '[substeps] Once you find a church whose message resonates with you, seek out senior members of the church and speak to them about ordination via seminary school. Most seminaries have an established history with particular denominations, so senior members can guide you toward a school that will be the best fit for your beliefs.', \\\"You'll look for the students at churches who perform the traditional ceremony and feel suited to an officiant. Alternatively, check into weddings recognized by others to see if that congregation is committed to treating a wedding like a marriage ceremony in itself.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}