{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"0b032b4b-c17f-5b3d-99f6-a5cce71add8f","task_key":"default--validation--7951","task_revision_id":"1","upstream_id":"7951","short_description":"HellaSwag validation 7951","config":"default","split":"validation","body":"{\"activity_label\":\"Youth\",\"ctx\":\"[header] How to sue a judge [title] Identify judicial acts. [step] Judges in the united states are immune from suit for any \\\" judicial act \\\" that they perform. This immunity applies even when the judge acts maliciously or corruptly.\",\"endings\":\"[\\\"The defendant will probably use this immunity to pay off his or her debts. You need to have the judge's favor in the case to proceed.\\\", 'You could file your lawsuit in the following situations : [substeps] Failure to pay bail. The defendant may have told you not to pay in advance of any payments he or she may pay.', 'To help identify the judicial act, do the following : [substeps] Review the matter as a whole. You may have probably looked for a notarized document that contains a oath that the judge signed.', 'This is a very broad protection for judges. Generally, the acts a judge performs during your trial or case will be \\\" judicial \\\" and therefore immune.']\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}