{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"e1a44dc7-c30a-5ceb-9ab8-e1fc06272ece","task_key":"default--validation--25571","task_revision_id":"1","upstream_id":"25571","short_description":"HellaSwag validation 25571","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to reduce your sentence for misdemeanors [title] Hire a lawyer. [step] With any criminal matter, whether a felony or a misdemeanor, consulting with a lawyer is a good idea. A lawyer will help you minimize your sentence by negotiating with the prosecution and making valid legal arguments to the court.\",\"endings\":\"['[substeps] You can also seek help in other immediate situations. Depending on the nature of the crime, you may want to hire a lawyer based on the crime.', '[substeps] The easiest way to hire a lawyer is to hire a low-cost investment banker who is adept at representing teenage children and up-to-date on the latest trends. A good investment banker will have powerful experience in contract law, tax law, criminal defense practices, and civil procedure.', 'A good lawyer may even be able to get the charges against you dropped or reduced before the case ever goes to trial. [substeps] If you cannot afford to hire a lawyer, you can ask to have one appointed to you.', \\\"Lawyers will do background checks on you, which will keep you from being prosecuted for an assault or you from being prosecuted for misdemeanors you didn't commit. [title] Use depositions, where you are in court.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}