{"kind":"task","effective_mode":"full","benchmark":{"kind":"benchmark","effective_mode":"full","slug":"hellaswag","formal_name":"HellaSwag","introduction":"HellaSwag asks which of four continuations naturally follows a sentence or a video caption. The wrong options are produced by adversarial filtering, so items that are nearly trivial for people remain hard for models.","introduction_ja":"","introduction_en":"","category":"Category not supplied","task_count":null,"acquisition_status":"Acquisition status not supplied","official_url":"https://rowanzellers.com/hellaswag/","indexing_mode":"index","profile":{"resources":[],"task_format":"","scoring":"","metric":"","size":"","answer_access":"","license":"","citation":"","maintainer":"","released":"","why_hard":"","related":[],"history":"","construction":"","limitations":"","saturation":"","scores":[]}},"task_id":"c2c7cba1-b447-56bf-bfca-204c11692ad9","task_key":"default--validation--32559--variant-299e21c6bb1a","task_revision_id":"1","upstream_id":"32559--variant-299e21c6bb1a","short_description":"HellaSwag validation 32559","config":"default","split":"validation","body":"{\"activity_label\":\"Education and Communications\",\"ctx\":\"[header] How to oppose a motion to dismiss [title] Identify why the defendant seeks dismissal. [step] You should receive a copy of the defendant's motion to dismiss. Once you receive it, read through the document and look to see why the defendant seeks dismissal.\",\"endings\":\"[\\\"[substeps] If you don't know why the defendant seeks dismissal, then find common grounds. The defendant could be trying to get in trouble for refusing to work with you because you aren't accepting credit on your debt, or because the defendant wants to get money.\\\", \\\"You should identify the violation of the law and the causes of action, even if it is not the same thing as an excuse to dismiss. [substeps] For example, a defendant may complain of a big change in the values of the property in question and argue that making the change drastic means the home won't be put in good working order.\\\", \\\"Generally, a defendant seeks to have a case dismissed for the following reasons : [substeps] You didn't serve the complaint properly on the defendant. You haven't stated a valid legal claim in your complaint.\\\", \\\"[substeps] Often, people seek dismissal because they have broken the laws that govern the employment of similar workers. You can find out if the defendant has this reason in the lawsuit by reading the particular court's rules of civil procedure (or calling the clerk's office) and looking for the official complaint form on the court's website.\\\"]\"}","display_format":"text","language":"","answer_status":"published","assets":[],"source_url":"https://rowanzellers.com/hellaswag/","history":"initial import","indexing_mode":"index","subproblems":[],"grids":[]}