{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"20e55ee9-aca5-5a33-90a2-f58e717a41b1","task_key":"default--validation--6199","task_revision_id":"1","upstream_id":"6199","short_description":"HellaSwag validation 6199","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to file for divorce in louisiana [title] Consider hiring an attorney. [step] Family law is very detailed and far reaching. So many different things are likely to impact your case, and judges have great latitude for discretion.\",\"endings\":\"['If you can afford a local attorney who knows the types of things your judge favors and disfavors, it would be best to hire one. See [find a good attorney | how to find a good attorney].', \\\"With the research you have, you'll be able to uncover better ways to evaluate divorce law. Attorneys who know the law in high regard can make recommendations regarding your case.\\\", \\\"[substeps] Issues of child rights and alimony are very pervasive in louisiana. You don't have to go all out to hire a lawyer.\\\", \\\"Even if your divorce is final, you should still consider consulting an attorney who has experience representing family members and property. If you are the plaintiff, your lawyer will assist you in drafting your divorce petition and any other documents that support your spouse's petition for divorce.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}