{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"5933d97e-2937-5d43-8ba9-dcd65b78fe89","task_key":"default--validation--27100","task_revision_id":"1","upstream_id":"27100","short_description":"HellaSwag validation 27100","config":"default","split":"validation","body":"{\"activity_label\":\"Work World\",\"ctx\":\"[header] How to become an ordained minister online [title] Find out if you can legally be a minister in your county. [step] If you're getting ordained to perform a wedding, this step is essential. Some states recognize online ordinations as legal, while others only consider you a minister if you have a congregation.\",\"endings\":\"['[substeps] To qualify for a coventee online, click here. [title] Gather information about your church and the overall beliefs of your church.', \\\"Look up your state's laws, or call your county clerk for more information. Some states require minister licensing, which is the process of registering as clergy with the state.\\\", '[substeps] For example, if you live in wisconsin, you are under some legal formalities to start a minister account. You can register your registration at any street corner in your county.', '[substeps] Some states believe that catholics or minister worship essentially throughout the year. Others only abstain from being an ordained minister and prefer not to abstain from the mass.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}