{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"77b11f38-f69e-5681-9e35-df8cb7726e5c","task_key":"default--validation--40710","task_revision_id":"1","upstream_id":"40710","short_description":"HellaSwag validation 40710","config":"default","split":"validation","body":"{\"activity_label\":\"Finance and Business\",\"ctx\":\"[header] How to prove police misconduct [title] Arrange for release on bail if you've been detained. [step] It is a lot easier to plan your defense on the outside than it is behind bars. If you were appointed a criminal defense attorney, work with them to obtain your release.\",\"endings\":\"['[substeps] Keep in mind you often get a bad rap on the side of the dollar based on the circumstances of your case. For example, you might have been charged with a felony that involved reckless driving.', \\\"[substeps] It's possible to be released on your own recognizance. This means you simply sign a paper agreeing to show up for all your court dates and don't have to pay any money.\\\", \\\"[substeps] If you're arrested for physical assault, you may be able to negotiate an agreement with the judge to release you from the charges. Keep in mind that many courts now don't allow unsupervised arrest.\\\", 'At at this stage, you can begin negotiations with the prosecutor and/or bail bondsman. [title] Determine the minimum bail amount required for you.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}