{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"b5ab812f-3f26-5eb4-beb4-7fbe17610297","task_key":"default--validation--38576","task_revision_id":"1","upstream_id":"38576","short_description":"HellaSwag validation 38576","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to file a lawsuit in new york city [title] Consider hiring an attorney. [step] Law can be very confusing, and one seemingly insignificant item can change the course of your case. If you can afford to hire a full-service attorney, that is usually best.\",\"endings\":\"['This varies among courts, so your options include either your local or state bar association, but the majority of them will probably have professional references available to support your case. [substeps] You will probably have better luck filing your lawsuit if your city or state bar association has a referral service.', \\\"If you are suing as a business, you must be represented by an attorney. Even if you can't afford a full service attorney, consider hiring one for unbundled services (only specific services that you need).\\\", \\\"However, if you've been charged with the crime and have a contingency fee agreement in place, you may want to bring at least one. An attorney typically can help you engage in a meaningful conversation regarding the issue and how your complaint would benefit her or him.\\\", 'Filing without an attorney can be costly and will usually only leave you with blank court forms. [substeps] As before, make sure that you identify the defendant before filing your lawsuit.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}