Douglas R. Vannoy
Trial Court · Kit Carson · Kit Carson
Meets Standards(Retain)5 cycles on record
Evaluation history
- 2014 retention cycleTrial Court · Kit Carson · Kit CarsonMeets Standards(Retain)VotersRetained· 69.5% yes17,127 yes · 7,519 no50% needed to retainRetention Year: 2014 Recommendation: Retain Reports: 2014 Retention Survey Report (PDF) 2011 Interim Survey Report (PDF) 2009 Interim Survey Report (PDF) Need an accessible PDF Document Version? Please click on the link below and email our staff Contact Us The Thirteenth Judicial District Commission on Judicial Performance unanimously recommends that Judge Douglas R. Vannoy BE RETAINED. Judge Vannoy graduated from Colorado State University in 1973, and he earned a Juris Doctor degree from the University of Denver College of Law in 1976. Before being appointed to the Thirteenth Judicial District Court Bench in 1988, Judge Vannoy was a private attorney in general practice. Judge Vannoy’s professional activities include teaching jury management at the Advanced New Judge’s Orientation, and he facilitates quarterly “Best Practices” meetings for stakeholders in juvenile-court cases. Also, Judge Vannoy is a 4-H volunteer, and he is a member of the Morgan Saddle Club. Previously, Judge Vannoy served on a committee involved with the Cross-Over Youth Project in Morgan County. Evaluation methods used by the commission included reviews of judicial performance survey reports. Those reports contained summaries of responses to survey questions and comments from attorneys and non-attorneys who had been involved in proceedings in Judge Vannoy’s courtroom. The non-attorneys surveyed included civil litigants, criminal defendants, jurors, witnesses, crime victims, court staff, interpreters, and probation and law enforcement officers. The evaluation process also involved review of the Judge’s written self-evaluation, review of a sample of the Judge’s written decisions, courtroom observations by some members of the commission and an interview with the Judge. Of the attorneys surveyed about retention, 77% recommended retaining Judge Vannoy, 4% recommended not to retain, and 19% made no recommendation. Of non-attorneys surveyed, 81% recommended retaining Judge Vannoy, 9% recommended not to retain, and 10% made no recommendation. Based on the survey results of attorneys, Judge Vannoy received an overall rating slightly below the overall average rating of all district judges standing for retention. Judge Vannoy’s overall rating based on the survey results of non-attorneys, while high, is somewhat lower than the overall average rating of all district judges standing for retention. Judge Vannoy received high marks in case management, application and knowledge of law, communications, and diligence. Some who took the survey noted Judge Vannoy to be impatient at times; however, this is often in relation to parties or attorneys who may be unprepared or who may be pursuing matters not relevant to the proceeding.
- 2008 retention cycleTrial Court · Kit Carson · Kit CarsonMeets Standards(Retain)VotersRetained· 72.5% yes19,616 yes · 7,458 no50% needed to retainReports: 2008 Retention Survey Report Need an accessible PDF Document version? Please click on the link below and email our staff Contact Us The Thirteenth Judicial District Commission on Judicial Performance recommends by a unanimous vote that Judge Douglas R.. Vannoy BE RETAINED. Background: Judge Vannoy was appointed to the Thirteenth Judicial District Court bench in 1988. He received a Bachelor of Arts degree in history from Colorado State University in 1973 and a Juris Doctor degree from the University of Denver College of Law in 1976. He was in private practice of law prior to his judicial appointment. Judge Vannoy’s community service interest and activities include teaching continuing legal education to local attorneys and at state judicial conferences, and conducting mock trials for local elementary school students. For the past two years he has served on the Commission for Judicial Discipline, currently serving as Vice-chairperson. He also serves on a Colorado Supreme Court Committee charged with preparing a revised and updated version of the Colorado Code of Judicial Discipline. Judge Vannoy is based in Fort Morgan, but hears cases in the seven counties in the judicial district. His caseload covers the entire range of cases which come before the district court, including civil, domestic relations, felony and juvenile cases. Strengths: Attorneys and non-attorneys who responded to survey questions rated Judge Vannoy above average overall in every aspect of judicial performance addressed in the survey. Survey comments by attorneys predominantly commend his knowledge of the law. Comments by both attorneys and non-attorneys indicated that he is very effective in keeping Court hearings under control with fairness to all parties. Weaknesses: Comments note a tendency to be impatient at times, however, this is often in relation to parties or attorneys who may be unprepared or pursuing irrelevant matters. Recommendation: 85% of attorneys surveyed and 67% of non-attorneys strongly recommended that Judge Vannoy be retained in office. Overall, 6% of attorneys and 12% of non-attorneys recommended that he not be retained, while 93% of attorneys and 81% of non-attorneys surveyed recommended he be retained.
- 2002 retention cycleTrial Court · Kit Carson · Kit CarsonMeets Standards(Retain)Retention Year: 2002 Recommendation: Retain Reports: 2002 Retention Survey Report Need an accessible PDF Document Version? Please click on the link below and email our staff Contact Us The Thirteenth Judicial District Commission on Judicial Performance recommends that Judge Douglas R. Vannoy BE RETAINED. Judge Vannoy was appointed to the Thirteenth Judicial District Court bench in 1988. He earned his law degree at the University of Denver Law School in 1976. Judge Vannoy presides over civil, domestic relations and criminal juvenile cases. Judge Vannoy is very knowledgeable, thorough and thoughtful. His involvement in the community is to be commended, especially the mock trial conducted in area schools by students. Survey results were very positive for Judge Vannoy. In non-attorney surveys, 85% recommended Judge Vannoy be retained. Of attorneys surveyed, 86% recommended he be retained. Non-attorney comments were very favorable for retention. Because of his extremely large docket, at times he may appear impatient. An overwhelming majority of the responses praised Judge Vannoy for his hard work. Other positive aspects of Judge Vannoy are his work ethic, being punctual and fair.
- 1996 retention cycleTrial Court · Kit Carson · Kit CarsonMeets Standards(Retain)VotersRetained· 63.2% yes15,100 yes · 8,806 no50% needed to retainRetention Year: 1996 Recommendation: Retain The Thirteenth Judicial District Commission on Judicial Performance recommends that Judge Vannoy BE RETAINED. Judge Vannoy was appointed to the Thirteenth Judicial District Court Bench in 1988 and has served in a full-time capacity for 8 years. He is based in Fort Morgan. He hears the entire range of cases that come before the district court, including civil, domestic relations, felony and criminal misdemeanor and juvenile cases. Judge Vannoy covers cases in the seven counties of the judicial district, as well as cases heard on an as-needed basis in other judicial districts. Evaluations received from attorney, courthouse personnel, jurors, and law enforcement personnel consistently rated Judge Vannoy highly capable. From an in-person interview with Judge Vannoy, the Commission finds him to be dedicated to helping people settle disputes, both in and out of the courtroom. He expressed his concern with balancing judicial efficiency needed for crowded court dockets with the care required for complex cases and his written decisions.
- 1990 retention cycleTrial Court · Kit Carson · Kit CarsonMeets Standards(Retain)VotersRetained· 63.5% yes12,565 yes · 7,217 no50% needed to retainRetention Year: 1990 Recommendation: Retain Judicial Performance Commission’s recommendation: Should Be Retained. Judge Vannoy passed the bar in 1976. From then until his appointment to the bench in 1988, he was in private practice in Fort Morgan. Vannoy was appointed a District Court judge in July 1988. Vannoy handles primarily felony and misdemeanor criminal cases, civil cases where the amount in controversy does exceed $5,000, divorce and child custody cases, juvenile proceedings and probate cases. He received universally high marks from surveyed attorneys. Other groups surveyed indicated similar opinions of Vannoy, though law enforcement ratings were substantially lower than other groups. However, only three surveys concerning Vannoy were received from law enforcement personnel. The commission found Vannoy to be an enthusiastic and thoughtful judge who is involved in his community and is willing to attempt and innovative programs to solve the problems of the people who appear before him. He also displays a sense of fairness to those who appear before him and displays a keen awareness for organization in his position.
Surveys & reports
- 2014 cycle
- 2013 Interim Survey Report(PDF on OJPE)
Read full interim survey textexpand
## Page 1 State of Colorado Logo COMMISSION ON JUDICIAL PERFORMANCE TThhee HHoonnoorraabbllee DDoouuggllaass RR.. VVaannnnooyy 2011 Interim Judicial Performance Survey 13th Judicial District ## Page 2 May 6, 2011 The Honorable Douglas R. Vannoy Morgan Combined Court 400 Warner Street Ft. Morgan, CO 80701 Dear Judge Vannoy: I am pleased to make available to you the attached copy of your 2011 Interim Judicial Performance Survey Report. The report is based on two surveys relating to how you are seen carrying out the performance of your office: One of attorneys who have had cases in your court or who are knowledgeable about your judicial performance, second a survey of non-attorneys who have observed your performance in court or who have otherwise been affected by your performance as a judge. In addition to this introduction, the report is divided into five main sections: 1. A brief summary of the results of the two surveys. 2. The numerical results of the survey of attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments attorneys made about your judicial performance. In some instances the comments have been redacted to eliminate respondent identifying information. A copy of the attorney questionnaire is included in the final section of this report. 3. The numerical results of the survey of non-attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments these respondent made on the subject of your judicial performance. In few instances the comments have been redacted to eliminate respondent identifying information. A copy of the non-attorney questionnaire is included in the final section of this report. 4. The fourth section of the Report discusses the methodology of the surveys. 5. The final section provides copies of the questions or questionnaires that were used for each survey. 100 Arap ahoe, Suite One, Boulder, CO 80302 Phone 303.443.5300 Fax 303.200.7385 ## Page 3 Hon. Douglas R. Vannoy May 6, 2011 Page 2 If you have any questions about the methodology and how the survey was conducted, please feel free to contact me at 303-443-5300 ext 1 or by email at talmey@talmeyresearch.com (please put the words “Judicial Performance” in the subject line), and for any other questions you might have about the survey please call the Executive Director of the Office of Judicial Performance Evaluation, Jane Howell, at 303-866-6465. Best regards, Paul A. Talmey President enc: ## Page 4 SSuummmmaarryy ooff RReessuullttss bbyy YYeeaarr aanndd JJuurroorr//NNoonn--JJuurroorr On average, district judges received an overall combined average grade in the 2011 Interim Judicial Performance Survey of 3.49--the overall average grade received from attorney respondents, 3.30, to the survey plus the overall average grade received from non-attorney respondents, 3.67, divided by two. Based on an average attorney grade of 3.56, and an average non-attorney grade of 3.39, Judge Douglas R. Vannoy’s combined grade for the 2011 Interim Judicial Performance Survey of 3.48. Judge Vannoy Average Grade Combined Attorney Non-attorney Overall Grade 3.48 3.56 3.39 Sample Size - 92 315 Table 1 The results presented in this report are based on data from cases heard and closed by Judge Vannoy from 20051 through 2010. (See Methodology section for description of sampling process.) Table 2 shows Judge Vannoy’s overall average grades for each of these years. Judge Vannoy Average Grades by Year Combined Attorney Non-Attorney Average Average Sample Average Sample Year Score Score Size Score Size 2005 3.55 3.57 10 3.52 56 2007 3.47 3.78 13 3.15 98 2008 3.75 3.97 2 3.53 41 2009 3.53 3.51 25 3.55 81 2010 3.41 3.49 42 3.33 39 Overall 3.48 3.56 92 3.39 315 Table 2 Due to sending questionnaires to all jurors—not just a sample—and their much higher response rate than other non-attorneys surveyed, the percentage of jurors in the district judge sample of the non-attorney survey is 66%. Moreover, jurors tend to grade judges much higher than non-jurors. The juror overall average grade for district judges was 1 There were no surveys conducted based on cases that closed in 2006. See methodology section for more details. 1 ## Page 5 3.86, while the overall average grade awarded by non-jurors was 3.28. The effect of this is that judges with a higher percentage of jurors in their sample tend to have higher average grades in the non-attorney survey than those judges with a small percentage of jurors. The number of jurors in a judge’s sample is, of course, closely related to the number of jury trials the judge presides over. The table below shows Judge Vannoy’s non-attorney results broken out by jurors and non-jurors for each year from 2005 to 2010. It also shows the overall average juror and non-juror grades for all district judges. Judge Vannoy Average Grades by Year Jurors Non-Jurors All District Judges Average Sample Average Sample Juror Non-Juror Year Score Size % Score Size % Average Average 2005 3.55 54 96% 2.83 2 4% 3.84 3.25 2007 3.77 9 9% 3.09 89 91% 3.86 3.31 2008 3.69 25 61% 3.27 16 39% 3.87 3.30 2009 3.84 39 48% 3.26 42 52% 3.87 3.26 2010 3.67 24 62% 2.73 15 38% 3.88 3.28 All Yrs. 3.68 151 48% 3.12 164 52% 3.86 3.28 Table 3 Table 3 allows one to compare Judge Vannoy’s juror and non-juror grades with the all district judge averages to better ascertain if the judge is seen as performing relatively well or relatively poorly among these two subgroups. 2 ## Page 6 SSuurrvveeyy ooff AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee DDoouuggllaass RR.. VVaanooyy ((SSaammppllee SSiizzee 9922)) ## Page 7 Survey of Attorneys Regarding Trial Judges Average Judge Douglas R. Vannoy Douglas R. All District Sample Size = 92 A B C D Fail DK/NA Vannoy Judges 1. Case Management: 1a. Promptly issuing a decision on the case after trial. 65% 22% 4% 0% 0% 9% 3.67 3.40 1b. Maintaining appropriate control over proceedings. 73% 20% 4% 2% 0% 1% 3.65 3.41 1c. Promptly ruling on pre-trial motions. 66% 17% 9% 0% 0% 8% 3.62 3.24 1d. Setting reasonable schedules for cases. 51% 36% 9% 0% 0% 4% 3.44 3.26 Overall Case Management 3.60 3.33 2. Application and Knowledge of Law: 2a. Being able to identify and analyze relevant facts. 78% 16% 3% 0% 1% 1% 3.73 3.29 2b. Basing decisions on evidence and arguments. 57% 24% 4% 2% 0% 13% 3.55 3.14 2c. Willing to reconsider error in fact or law. 55% 23% 11% 3% 0% 8% 3.41 3.02 2d. Issuing consistent sentences when the circumstances are 44% 23% 6% 0% 0% 27% 3.51 3.14 similar. Overall Application and Knowledge of Law 3.55 3.15 3. Communications: 3a. Making sure all participants understand the proceedings. 60% 31% 9% 0% 0% 0% 3.51 3.52 3b. Providing written communications that are clear, thorough 67% 15% 8% 0% 0% 10% 3.65 3.30 and well reasoned. Overall Communications 3.58 3.41 4. Demeanor: 4a. Giving proceedings a sense of dignity. 77% 18% 6% 0% 0% 0% 3.71 3.49 4b. Treating parties with respect. 58% 23% 11% 7% 1% 0% 3.30 3.41 4c. Conducting his/her courtroom in a neutral manner. 66% 18% 13% 3% 0% 0% 3.46 3.29 4d. Consistently applying laws and rules. 68% 18% 9% 2% 2% 1% 3.48 3.24 Overall Demeanor 3.49 3.36 5. Diligence: 5a. Using good judgment in application of relevant law and 67% 21% 8% 2% 1% 1% 3.52 3.18 rules. 5b. Doing the necessary homework and being prepared for 71% 22% 3% 1% 0% 2% 3.67 3.33 his/her cases. 5c. Being willing to handle cases on the docket even when 63% 19% 6% 2% 0% 10% 3.59 3.41 they are complicated and time consuming. Overall Diligence 3.59 3.31 Overall Average Grade: 3.56 3.30 2011 Interim Judicial Performance Survey 4 ## Page 8 Survey of Attorneys Regarding Trial Judges Percentage Judge Douglas R. Vannoy Douglas R. All District Vannoy Judges Sample Size = 92 Would you say the judge is: Very biased in favor of the prosecution 5% 11% Somewhat biased in favor of the prosecution 21% 26% Completely neutral 53% 47% Somewhat biased in favor of the defense 14% 8% Very biased in favor of the defense 2% 2% Don't know or not sure 5% 4% 8. How strongly do you recommend that the Judge be retained in office, or not be retained in office? [Percentages excluding undecided responses.] Strongly recommend retain 82% 72% Somewhat recommend retain 16% 16% Somewhat recommend not retain 2% 6% Strongly recommend not retain 0% 6% Total Retain 98% 88% Total Not Retain 2% 12% [Percentages including undecided responses.] Strongly recommend retain 80% 69% Somewhat recommend retain 15% 15% Undecided or Don't Know 2% 4% Somewhat recommend not retain 2% 6% Strongly recommend not retain 0% 6% Total Retain 95% 84% Undecided/Don't Know 2% 4% Total Not Retain 2% 12% 2011 Interim Judicial Performance Survey 5 ## Page 9 Judge Douglas R. Vannoy Survey of Attorneys Regarding Trial Judges Average Grades 3.56 Overall Average Grade 3.30 Q1. Overall Case Management 3.60 3.33 1a. Promptly issuing a decision on the 3.67 case after trial. 3.40 1b. Maintainingappropriate control over 3.65 proceedings. 3.41 3.62 1c. Promptlyruling on pre-trial motions. 3.24 1d.Setting reasonable schedules for cases. 3.44 3.26 3.55 Q2. OverallApp & Knowledge of Law 3.15 2a. Beingable to identify and analyze 3.73 relevant facts. 3.29 2b.Basing decisions on evidence and argument. 3.55 3.14 3.41 2c. Willing to reconsider error in fact or law. 3.02 2d. [Criminal only] Issuing consistant sentences 3.51 whencircumstances are simmilar. 3.14 3.58 Q3. Overall Communication 3.41 3a.Making sure all participants understand 3.51 the proceedings. 3.52 3b. Providing written communications that are 3.65 clear, thorough and well reasoned. 3.30 2.0 2.5 3.0 3.5 4.0 Douglas R. Vannoy All District Judges Judge Douglas R. Vannoy 6 2011 Interim Judicial Performance Survey ## Page 10 Judge Douglas R. Vannoy Survey of Attorneys Regarding Trial Judges Average Grades 3.49 Q4. Overall Demeanor 3.36 3.71 4a. Giving proceedingsa sense of dignity. 3.49 3.30 4b. Treating participants with respect. 3.41 4c. Conducting [his/her] courtroom 3.46 in a neutral manner. 3.29 3.48 4d. Consistanly applyinglaws and rules. 3.24 3.59 Q5. Overall Diligence 3.31 5a. Using good judgement in application of 3.52 releveant laws and rules. 3.18 5b. Doing the necessary 'homework' and 3.67 being prepared for [his/her] cases. 3.33 5c. Being willing to handle cases on the docket even 3.59 when they are complicated and time consuming. 3.41 2.0 2.5 3.0 3.5 4.0 Biased in favor of prosecution/defense. 5% Very biased in favor of the prosecution 11% 21% Somewhat biased in favor of the prosecution 26% 53% Completely Neutral 47% 14% Somewhat biased in favor of the defense 8% 2% Very biased in favor of the defense 2% 5% Don't know/not sure 4% 0% 10% 20% 30% 40% 50% 60% Douglas R. Vannoy All District Judges 7 2011 Interim Judicial Performance Survey ## Page 11 Judge Douglas R. Vannoy Survey of Attorneys Regarding Trial Judges Q8. How strongly do you recommend that Judge Vannoy be retained or not retained in office? Excluding Undecided Respondents 82% Strongly recommend retain 72% 16% Somewhat recommend retain 16% All Dist Judge Vannoy Judges 2% Total Retain 98% 88% Somewhat recommend not retain Total Not Retain 2% 12% 6% 0% Strongly recommend not retain 6% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Including Undecided Respondents 80% Strongly recommend retain 69% 15% Somewhat recommend retain 15% All Dist 2% Judge Vannoy Judges Undecided or DK 4% Total Retain 95% 84% Undecided or DK 2% 4% 2% Somewhat recommend not retain Total Not Retain 2% 12% 6% 0% Strongly recommend not retain 6% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Douglas R. Vannoy All District Judges 8 2011 Interim Judicial Performance Survey ## Page 12 SSuurrvveeyy ooff NNoonn--AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee DDoouuggllaass RR.. VVaanooyy ((SSaammppllee SSiizzee 331155)) ## Page 13 Survey of Non-Attorneys Regarding Trial Judges Average Judge Douglas R. Vannoy Douglas R. All District Sample Size = 315 A B C D Fail DK/NA Vannoy Judges 1. Demeanor: 1a. Giving court proceedings a sense of dignity. 61% 27% 6% 2% 3% 1% 3.44 3.70 1b. Treating participants in the case politely and with respect. 62% 22% 10% 3% 3% 1% 3.38 3.72 1c. Conducting court in a neutral manner. 63% 22% 7% 2% 5% 1% 3.37 3.67 1d. Having a sense of compassion and human understanding 54% 28% 10% 3% 4% 2% 3.26 3.61 for those who appear before the court. Overall Demeanor 3.36 3.68 2. Fairness: 2a. Giving participants an opportunity to be heard. 64% 23% 6% 2% 3% 1% 3.44 3.69 2b. Treating those involved in the case without bias. 60% 25% 4% 3% 5% 2% 3.36 3.65 2c. Treating fairly people who represent themselves. 40% 16% 4% 1% 3% 36% 3.39 3.66 2d. Giving each side enough time to present his or her case. 62% 23% 5% 2% 3% 5% 3.46 3.69 Overall Fairness 3.41 3.67 3. Communications: 3a. Making sure participants understand the proceedings, and 64% 21% 9% 2% 2% 2% 3.46 3.72 what is going on in the courtroom. 3b. Using language that everyone can understand. 65% 24% 8% 1% 2% 1% 3.50 3.74 3c. Speaking clearly so everyone in the courtroom can hear 61% 23% 12% 1% 2% 1% 3.41 3.75 what is being said. Overall Communications 3.46 3.74 4. Diligence: 4a. Beginning court on time 52% 23% 14% 4% 3% 5% 3.22 3.54 4b. Maintaining appropriate control over proceedings. 65% 23% 5% 2% 1% 4% 3.56 3.75 4c. Setting reasonable schedules for cases. 53% 21% 11% 3% 2% 11% 3.33 3.64 4d. Being prepared for cases. 64% 22% 5% 2% 3% 5% 3.49 3.71 4e. Managing court proceedings so that there is little wasted 55% 24% 10% 3% 4% 3% 3.27 3.58 time. Overall Diligence 3.37 3.64 5. Application of Law: 5a. Giving reasons for rulings. 56% 22% 10% 2% 4% 5% 3.32 3.60 5b. Willing to make decisions without regard to possible 51% 21% 6% 2% 4% 17% 3.36 3.64 outside pressure. 5c. Being able to identify and analyze relevant facts. 58% 22% 5% 3% 4% 9% 3.39 3.63 Overall Application of Law 3.36 3.62 Overall Average Grade: 3.39 3.67 2011 Interim Judicial Performance Survey 10 ## Page 14 Survey of Non-Attorneys Regarding Trial Judges Percentage Judge Douglas R. Vannoy Douglas R. All District Vannoy Judges Sample Size = 315 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 11% 8% Competely neutral 78% 86% Biased in favor of the defense total 11% 6% [A positive average indicates bias toward prosecution, and a Average 0.00 0.07 negative average indicates a bias toward the defense.] 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 7% 8% Competely neutral 69% 82% Lenient sentencing total 22% 10% [A positive average indicates sentences are harsh, and a Average -0.32 0.04 negative average indicates sentences are lenient.] 10. How strongly do you recommend that the Judge be retained or not retained in office? [Percentages excluding undecided responses.] Strongly recommend retain 76% 89% Somewhat recommend retain 15% 6% Somewhat recommend not retain 4% 2% Strongly recommend not retain 6% 4% Total Retain 91% 95% Total Not Retain 10% 6% [Percentages including undecided responses.] Strongly recommend retain 71% 84% Somewhat recommend retain 14% 6% Undecided or Don't Know 6% 5% Somewhat recommend not retain 4% 2% Strongly recommend not retain 5% 4% Total Retain 85% 90% Undecided/Don't Know 6% 5% Total Not Retain 9% 6% 2011 Interim Judicial Performance Survey 11 ## Page 15 Judge Douglas R. Vannoy Survey of Non-Attorneys Regarding Trial Judges Average Grades 3.39 Overall Average Grade 3.67 3.36 Q1. Overall Demeanor 3.68 3.44 1a. Giving proceedings a sense of dignity. 3.70 1b. Treating participants politely and with respect. 3.38 3.72 1c. Conducting the courtroom in a neutral 3.37 manner. 3.67 1d. Having a sense of compassion and human 3.26 understanding for those who appear before the judge. 3.61 3.41 Q2. Overall Fairness 3.67 2a. Giving participants an opportunity to be 3.44 heard. 3.69 2b. Treating those involved in the 3.36 case without bias. 3.65 2c. Treats people fairly who represent 3.39 themselves. 3.66 2d. Giving each side enough time to present his 3.46 or her case. 3.69 3.46 Q3. Overall Communtications 3.74 3a. Making sure participants understand the 3.46 proceedings, and what's going on in the courtroom. 3.72 3b. Using language that everyone can 3.50 understand. 3.74 3c. Speaking clearly so everyone in the courtroom 3.41 can hear what's being said. 3.75 2.0 2.5 3.0 3.5 4.0 Douglas R. Vannoy All District Judges Judge Douglas R. Vannoy 12 2011 Interim Judicial Performance Survey ## Page 16 Judge Douglas R. Vannoy Survey of Non-Attorneys Regarding Trial Judges Average Grades 3.37 Q4. Overall Diligence 3.64 3.22 4a. Beginning court on time. 3.54 4b. Maintaining appropriate control over 3.56 proceedings. 3.75 4c. Setting reasonable schedules for cases. 3.33 3.64 4d. Being prepared for his or her cases. 3.49 3.71 4e. Managing court proceedings so that there is 3.27 little wasted time. 3.58 3.36 Q5. Overall Legal Ability 3.62 5a. Giving reasons for rulings. 3.32 3.60 5b. Willing to make decision without regard to 3.36 possible outside pressure. 3.64 5c. Being able to identify and analyze 3.39 relevant facts. 3.63 2.0 2.5 3.0 3.5 4.0 Q6 Biased in favor of prosecution/defense. 0.00 Douglas R. Vannoy 0.07 All District Judges -5 -4 -3 -2 -1 0 1 2 3 4 5 Defense Prosecution Q7 Lenience or Harshness in Sentencing. -0.32 Douglas R. Vannoy 0.04 All District Judges -5 -4 -3 -2 -1 0 1 2 3 4 5 Lenient Harsh Douglas R. Vannoy All District Judges 13 2011 Interim Judicial Performance Survey ## Page 17 Douglas R. Vannoy All District Judges Judge Douglas R. Vannoy Survey of Non-Attorneys Regarding Trial Judges Q10. How strongly do you recommend that Judge Vannoy be retained or not retained in office? Excluding Undecided Respondents 76% Strongly recommend retain in office 89% 15% Somewhat recommend retain in office 6% All Dist Judge Vannoy Judges Total Retain 91% 95% 4% Somewhat recommend not retain in office Total Not Retain 10% 6% 2% 6% Strongly recommend not retain in office 4% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Including Undecided Respondents 71% Strongly recommend retain in office 84% 14% Somewhat recommend retain in office 6% 6% All Dist Undecided 5% Judge Vannoy Judges Total Retain 85% 90% 4% Undecided 6% 5% Somewhat recommend not retain in office 2% Total Not Retain 9% 6% 5% Strongly recommend not retain in office 4% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Douglas R. Vannoy All District Judges 14 2011 Interim Judicial Performance Survey ## Page 18 MMeetthhooddoollooggyy ## Page 19 MMeetthhooddoollooggyy The results shown in the 2011 Interim Judicial Performance Survey Report are based on two surveys: The Survey of Attorneys Regarding Trial Judges, and the Survey of Non- Attorneys Regarding Trial Judges. Below is a description of the methodology used in the two surveys. I Attorneys Regarding Trial Judges a. Sample: Talmey-Drake Research & Strategy received case data with the names of people who had likely been in each judge’s courtroom from five primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Denver County Courts District Attorney’s Office, Second Judicial District (Denver) District Attorney’s Office, Ninth Judicial District Additional information was provided by the State Public Defender’s Office and the courts in the 1st and 18th Judicial Districts. The data from these different data sources are combined, duplicates removed and addresses corrected. i. Prior to 2009, the survey of Attorneys Regarding Trial Judges was conducted using paper questionnaires mailed to the attorneys’ offices. A sample of attorneys drawn from the case data were assigned to evaluate judges subject to the following rules applied in the order shown. 1. No attorney would be asked to evaluate the same judge in a 24-month period. 2. If an attorney was eligible to evaluate both a trial judge and an appellate judge, the attorney was assigned to evaluate the appellate judge. 3. If there were several judges the attorney could potentially evaluate, the attorney was assigned the judge with whom he or she had had the most cases during the sampling time frame, or the judge with the smallest sample in order to even out sample sizes among judges. Attorneys were mailed a questionnaire, and if they did not respond they were sent a reminder postcard followed by a second questionnaire and in some cases a second reminder postcard. Questionnaires were barcoded, and if an attorney mailed back two questionnaires, the second one was deleted from the data file. Attorneys who did not complete the survey after the second request were then telephoned and asked to complete the survey by phone. 16 ## Page 20 ii. In 2009 the Attorneys Regarding Trial Judges Survey moved from being a paper survey mailed to potential respondents to an online survey. Moving the survey to online permitted asking individual attorneys to evaluate up to five trial judges, and with the exception of the effects of the modified assignment rules 1 through 3 below, it became a survey of all attorneys who had cases before trial judges. Allowing an attorney to evaluate up to five judges, entailed slightly modifying the assignment rules: 1. No attorney would be asked to evaluate the same justice or judge in a 24-month period. 2. If an attorney was eligible to evaluate both a trial judge and an appellate judge, the attorney was assigned to evaluate the appellate judge. 3. If there were more than five judges who could be assigned to the attorney, the attorney was assigned the judges with whom he or she had had the most cases during the sampling time frame, or the judges with the smallest samples in order to even out sample sizes among judges. Attorneys were first mailed a letter about the online survey to let them know that they would soon receive an email with a link to the survey. The Web address of the survey and a password were included in the letter if the attorney wanted to complete the survey immediately. A week after the first email was sent, a follow-up email was sent. Potential respondents who did not complete the survey after the second email were then telephoned and asked to either complete the survey then by phone, or to please complete it online. iii. In 2010, and going forward, rule #2 above was changed so that an attorney could be asked to evaluate a combination of up to seven trial judges or Court of Appeals judges, if the attorney had had a case before the COA. Attorneys who had cases before the both the Supreme Court and trial judges during the sample time frame were asked to evaluate all seven Supreme Court justices, and not asked to evaluate the trial judges. The results shown in the 2011 Interim Judicial Performance Survey Report for the Attorneys Regarding Trial Judges survey are based on the combined survey results collected from January 2005 through March 30, 20111 for those questions that have been consistently asked during that time period. Since 2010, the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the justice’s or judge’s term of office: ten years for a Supreme Court justice, eight years for a COA judge, six years for a district judge and four years for a county judge. To use a district judge as an example: as survey data is collected it is pooled together for six years. After six years, as new data is added to the judge’s survey results in the first quarter of the seventh year, the oldest quarter of data in the pool is deleted. The current data for all judges only goes back as far as 2005—or the year the judge took the bench—therefore the rolling of the survey results only affects the county judge sample in the 2011 Interim reports. 1 The State Commission on Judicial Performance authorized continuous surveying in 2007. Prior to 2007 data was only collected in the odd numbered years before the retention reports were issued. Therefore, while data was gathered in 2005 and 2007 through the 1st quarter of 2011, and used in this report, there was no data collected in 2006. 17 ## Page 21 b. Questions: The survey questions asked respondents to use a grade of A, B, C, D, or F to assess the justice or judge's performance on twelve aspects of judicial performance. (See Questionnaire section.) These grades were then converted to a numerical scores where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the justice or judge be retained or not retained in office. c. Comments: In addition to the A through F questions, respondents were also asked what they considered to be the judge’s strengths and what they considered to be the judge’s weaknesses. By statute these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. Since 2005 there have been changes to the number of comment questions asked, though the strengths and weaknesses questions have been posed in every survey. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. Most spelling and typographical errors have been fixed, but where the respondent entered a comment in all upper or all lower case, or without punctuation, the comment was not corrected. d. Analysis: The Attorneys Regarding Trial Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all district judges and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all district judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. 18 ## Page 22 The next table shows the percentage distribution of the responses to the question about recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all district judges. The percentages are shown both including and excluding “don’t know/undecided” responses. The next page displays the question averages in horizontal bar-graph form. The percentage distribution to the retention question is then presented in the graph on the next page. The third part of the Attorneys Regarding Trial Judges section of the report lists the comments the attorney made about the judge’s strengths and weaknesses. e. Cooperation Rate: The overall response rate for the Attorneys Regarding Trial Judges Survey is calculated as the number of completed survey-evaluations (the number of judges an attorney chose to evaluate) divided by the number of possible evaluations (the number of judges the attorney could have evaluated) resulting in an overall response rate of 43.3% for district judges and 33.4% for county judges. An equivalent response rate for an individual judge is computed as the number of completed survey-evaluations for that judge divided by the number of possible evaluations that could have been completed for the judge. Since 2009 attorneys have generally been asked to evaluate multiple judges per survey cycle, which affects the way cooperation rates are calculated and results in what appear to be lower overall cooperation rates. However, comparing the percentage of unique attorneys who responded to the mail surveys conducted from 2005 to 2008 to the percentage of unique attorneys who responded to the online surveys conducted from 2009 to the first quarter of 2011 yields very similar percentages. From 2005 to 2008 6,347 unique attorneys were asked to participate in the Judicial Performance mail surveys. Four thousand three (3,984), or 62.8%, responded with a completed questionnaire. Similarly, from 2009 through the first quarter 2011 Talmey-Drake asked 7,589 unique attorneys to participate in the Judicial Performance online survey, of which an almost identical percentage, 62.9% (4,777 attorneys) responded with one or more completed survey-evaluations of a judge. On average each attorney responding to the online survey request evaluated 3.7 judges. 2 2 Because Talmey-Drake deletes survey results associated with judges who are no longer on the bench, the counts used in this paragraph refer only to data collected regarding trial judges who are active at this writing. 19 ## Page 23 II Non-Attorneys Regarding Trial Judges a. Sample: Talmey-Drake Research & Strategy received case data with the names of non-attorneys who had likely been in each judge’s courtroom from five primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Denver County Courts District Attorney’s Office, Second Judicial District (Denver) District Attorney’s Office, Ninth Judicial District The data from these different data sources are combined, duplicates removed and addresses corrected. Depending on the number of names available to be sampled for each judge, a random sample was drawn if the quantity of potential respondents was large. On the other hand, if the count of possible respondents was small, all potential respondents were included in the sample. Where a person had been in more than one judge’s courtroom, the selection criteria for which judge he or she would be sent a questionnaire was generally for the judge in whose courtroom the potential respondent had been in most often. Each person whose name was sampled for the Non-Attorney Survey was mailed an initial postcard informing the recipient that he or she would be receiving a questionnaire. Two to three weeks after the post card was mailed, the potential respondent was sent a personalized introductory letter and a questionnaire with a postage-paid return envelope. If the person did not respond, a second questionnaire and letter were sent approximately four weeks later. Questionnaires are barcoded, and if a respondent mailed back two questionnaires, the second one was deleted from the data file. Since in 2010, non-attorney section of the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the judge’s term of office: six years for a district judge and four years for a county judge. To use a district judge as an example: as survey data is collected it is pooled together for six years. After six years, as new data is added to the judge’s survey results in the first quarter of the seventh year, the oldest quarter of data in the pool is deleted. The current data for all judges only goes back as far as 2005—or the year the judge took the bench—therefore the rolling of the survey results only affects the county judge sample in the 2011 Interim reports. 3 3 The State Commission on Judicial Performance authorized continuous surveying in 2007. Prior to 2007 data was only collected in the odd numbered years before the retention reports were issued. Therefore, while data was gathered in 2005 and 2007 through the 1st quarter of 2011, and used in this report, there was no data collected in 2006. 20 ## Page 24 b. Questions: The survey questions asked respondents to use a grade of A, B, C, D, or F to assess the justice or judge's performance on twelve aspects of judicial performance (See Questionnaire section.) These grades were then converted to a numerical scores where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the justice or judge be retained or not retained in office. A copy of the questionnaire is included in the last section of this report. c. Analysis: The Non-Attorneys Regarding Trial Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all district judges and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all district judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the questions about prosecution or defense bias and recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all district judges. The percentages for the retention question are shown including and excluding “don’t know/undecided” responses. The next page displays the question averages in horizontal bar-graph form. The percentage distribution of the prosecution-defense bias and retention questions are then presented in the graph on the next page. The third part of the Non-Attorneys Regarding Trial Judges section of the report lists the comments the attorney made about the judge’s strengths and weaknesses. d. Comments: In addition to the A through F questions, non-attorney respondents were asked what they considered to be the judge’s strengths and what they considered to be the judge’s weaknesses. By statute these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the 21 ## Page 25 Commission, an attempt is made to redact all respondent identifying information from the comments. Since 2005 there have been changes to the number of comment questions asked, though the strengths and weaknesses questions have been posed in every survey. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. e. Cooperation Rate: The estimated cooperation rate for the Non-attorney Survey is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses and refusals, undeliverables and other responses. The table presents the estimated overall cooperation rate as well as the cooperation rate by the different types of respondents. The true cooperation rates are likely higher than shown because of the percentage of people who were mailed questionnaires about judges who they had not observed. This is due, in part, to many cases being disposed of without the parties having appeared in court, as well as in the case of law enforcement, the data includes all those who were subpoenaed for a case, not just those who appeared. A table of the response counts by respondent type for Judge Vannoy is shown below, and on the next page is a table of the overall cooperation rates for both the attorney and non-attorney regarding trial judges surveys for all district judges. 22 ## Page 26 Judge Douglas R. Vannoy Judge Response Counts by Type of Respondent Total No Undeliverable/ Other Non- Coop Role Type Sent Response Not Applicable Responses Completes Rate Attorneys Criminal District Attorneys 36 18 2 0 16 47.1% Defense Attorneys 60 38 0 0 22 36.7% Other Attorneys Criminal 5 5 0 0 0 0.0% Civil Attorneys for Litigants 63 21 2 0 40 65.6% Other Attorneys Civil 22 10 0 0 12 54.5% GAL 1 0 0 0 1 100.0% Attorneys, Unknown Role Type 4 2 1 0 1 33.3% Total Attorneys 191 94 5 0 92 49.5% Non-attorneys Criminal Witness 97 59 23 3 12 16.2% Other 46 27 10 1 8 22.2% Law Enforcement 213 84 49 4 76 46.3% Defendant 428 248 152 1 27 9.8% Civil Litigant 202 125 40 1 36 22.2% Witness 3 2 0 0 1 33.3% Other 2 0 2 0 0 0.0% Non-Attorneys, Unknown Role Type 27 17 9 0 1 5.6% Jurors 318 137 21 9 151 50.8% Employees 3 0 0 0 3 100.0% Total Non-attorneys 1339 699 306 19 315 30.5% Grand Total: 1530 793 311 19 407 33.4% 2011 Interim Judicial Performance Survey 23 ## Page 27 Total Response Counts by Type of Respondent for All District Judges Total No Undeliverable/ Other Non- Completes Cooperation Sent Response Not Applicable Responses Rate Attorneys Criminal District Attorneys 5963 3735 108 3 2117 36.2% Defense Attorneys 9005 5407 125 0 3473 39.1% Other Attorneys Criminal 310 260 2 1 47 15.3% Civil Attorneys for Litigants 9795 4329 410 17 5039 53.7% Other Attorneys Civil 6107 3564 63 4 2476 41.0% GAL 101 43 5 0 53 55.2% Attorneys, Unknown Role Type 193 60 22 0 111 64.9% Total Attorneys 31474 17398 735 25 13316 43.3% Non-attorneys Criminal Victim 149 85 40 3 21 19.3% Witness 13212 6730 4190 587 1705 18.9% Other 5595 3441 1430 55 667 16.0% Law Enforcement 13854 7651 3233 295 2674 25.2% Defendant 40047 19046 17527 241 3226 14.3% Civil Litigant 23266 13519 5107 291 4337 23.9% Witness 618 306 139 15 158 33.0% Other 679 317 150 18 194 36.7% Non-Attorneys, Unknown Role Type 2763 1447 1003 4 309 17.6% Jurors 48708 18523 2771 544 26770 58.3% Employees 905 283 121 66 435 55.5% Total Non-attorneys 149796 71348 35711 2119 40496 35.5% Grand Total: 181270 88746 36446 2144 53812 37.2% 2011 Interim Judicial Performance Survey 24 ## Page 28 Projectability Most surveys seen by the public are surveys that are intended to be projectable, that is the results from the sample of people surveyed can be used to estimate a percentage or value of the population sampled with a known probability of error. For example, a pre- election poll of 500 likely Colorado voters is used to estimate the percentage of voters who will vote for Candidate A versus Candidate B on election day, plus or minus some number of percentage points. The plus or minus amount is usually what is known as the 95%-confidence interval (the known probability of error), or what the media often refers to as the margin-of-error. Neither of the two surveys that make up this report, Attorneys Regarding Trial Judges and the Non-Attorneys Regarding Trial Judges, are projectable with a known probability of error because the results are calculated from a self-selecting sample that is self-selecting based on the content and subject matter of the survey. In other words, the potential respondent knows the purpose and content of the survey, and based on that, decides whether to respond to the survey. While projectability within a known probability of error is a highly desirable attribute of a survey, it is often not feasible to achieve. Commercial market research often uses nonprojectable (and small) samples-the most well known of which are for focus groups. Moreover, the federal courts have long accepted, and do not expect, projectable samples for market confusion surveys used in trademark litigation. In other words, one can still use the results of the Judicial Performance Evaluation Survey to estimate how everyone who has observed a justice or judge in the courtroom would grade him or her, just not with a known probability of error. The Judicial Performance Evaluation Survey is a valuable means, perhaps the only practical means, for the Judicial Performance Commissions to have a summary of structured interviews with a number of people who have courtroom familiarity with the judge being evaluated, and who most often—albeit not always—are responding out of a desire to improve the performance of our state's judicial system. 25 ## Page 29 Survey of Attorneys Regarding Trial Judges All District Judges Average Sample Size = 13316 A B C D Fail DK/NA Grade 1. Case Management: 1a.Promptly issuing a decision on the case after trial. 50% 20% 7% 3% 2% 19% 3.40 1b.Maintaining appropriate control over proceedings. 61% 24% 9% 3% 2% 2% 3.41 1c.Promptly ruling on pre-trial motions. 46% 25% 10% 4% 2% 12% 3.24 1d.Setting reasonable schedules for cases. 51% 27% 10% 4% 3% 4% 3.26 Overall Case Management 3.33 2. Application and Knowledge of Law: 2a.Being able to identify and analyze relevant facts. 54% 26% 10% 5% 2% 2% 3.29 2b.Basing decisions on evidence and arguments. 47% 24% 11% 6% 4% 8% 3.14 2c.Willing to reconsider error in fact or law. 38% 20% 10% 6% 4% 21% 3.02 2d.Issuing consistent sentences when the circumstances are 35% 23% 9% 4% 3% 26% 3.14 similar. Overall Application and Knowledge of Law 3.15 3. Communications: 3a.Making sure all participants understand the proceedings. 64% 24% 7% 2% 1% 2% 3.52 3b.Providing written communications that are clear, thorough 49% 24% 9% 4% 2% 12% 3.30 and well reasoned. Overall Communications 3.41 4. Demeanor: 4a. Giving proceedings a sense of dignity. 67% 21% 7% 2% 2% 1% 3.49 4b. Treating parties with respect. 66% 19% 7% 4% 3% 1% 3.41 4c. Conducting his/her courtroom in a neutral manner. 60% 20% 9% 5% 4% 2% 3.29 4d. Consistently applying laws and rules. 54% 23% 10% 5% 3% 5% 3.24 Overall Demeanor 3.36 5. Diligence: 5a.Using good judgment in application of relevant law and 52% 25% 11% 6% 4% 2% 3.18 rules. 5b.Doing the necessary homework and being prepared for 56% 24% 9% 4% 2% 5% 3.33 his/her cases. 5c.Being willing to handle cases on the docket even when 55% 19% 7% 3% 2% 14% 3.41 they are complicated and time consuming. Overall Diligence 3.31 Overall Average Grade: 3.30 2011 Interim Judicial Performance Survey 26 ## Page 30 Survey of Attorneys Regarding Trial Judges Average All District Judges Grade Sample Size = 13316 Would you say the judge is: Very biased in favor of the prosecution 11% Somewhat biased in favor of the prosecution 26% Completely neutral 47% Somewhat biased in favor of the defense 8% Very biased in favor of the defense 2% Don't know or not sure 4% 8. How strongly do you recommend that the Judge be retained in office, or not be retained in office? [Percentages excluding undecided responses.] Strongly recommend retain 72% Somewhat recommend retain 16% Somewhat recommend not retain 6% Strongly recommend not retain 6% Total Retain 88% Total Not Retain 12% [Percentages including undecided responses.] Strongly recommend retain 69% Somewhat recommend retain 15% Undecided or Don't Know 4% Somewhat recommend not retain 6% Strongly recommend not retain 6% Total Retain 84% Undecided/Don't Know 4% Total Not Retain 12% 2011 Interim Judicial Performance Survey 27 ## Page 31 Survey of Non-Attorneys Regarding Trial Judges All District Judges Average Sample Size = 40496 A B C D Fail DK/NA Grade 1. Demeanor: 1a.Giving court proceedings a sense of dignity. 80% 14% 3% 1% 1% 1% 3.70 1b.Treating participants in the case politely and with respect. 82% 11% 3% 1% 2% 1% 3.72 1c.Conducting court in a neutral manner. 80% 12% 3% 2% 2% 1% 3.67 1d.Having a sense of compassion and human understanding 75% 14% 3% 2% 3% 2% 3.61 for those who appear before the court. Overall Demeanor 3.68 2. Fairness: 2a.Giving participants an opportunity to be heard. 80% 12% 3% 2% 2% 1% 3.69 2b.Treating those involved in the case without bias. 79% 12% 3% 2% 3% 2% 3.65 2c.Treating fairly people who represent themselves. 51% 7% 2% 1% 2% 38% 3.66 2d.Giving each side enough time to present his or her case. 78% 12% 3% 1% 2% 3% 3.69 Overall Fairness 3.67 3. Communications: 3a.Making sure participants understand the proceedings, and 81% 12% 3% 1% 1% 1% 3.72 what is going on in the courtroom. 3b.Using language that everyone can understand. 81% 14% 3% 1% 1% 1% 3.74 3c.Speaking clearly so everyone in the courtroom can hear 82% 12% 3% 1% 1% 1% 3.75 what is being said. Overall Communications 3.74 4. Diligence: 4a.Beginning court on time 67% 21% 6% 2% 2% 2% 3.54 4b.Maintaining appropriate control over proceedings. 82% 12% 3% 1% 1% 1% 3.75 4c.Setting reasonable schedules for cases. 69% 14% 4% 1% 2% 10% 3.64 4d.Being prepared for cases. 78% 12% 3% 1% 2% 5% 3.71 4e.Managing court proceedings so that there is little wasted 71% 19% 5% 2% 2% 2% 3.58 time. Overall Diligence 3.64 5. Application of Law: 5a.Giving reasons for rulings. 71% 14% 4% 2% 3% 7% 3.60 5b.Willing to make decisions without regard to possible 66% 10% 3% 1% 3% 18% 3.64 outside pressure. 5c.Being able to identify and analyze relevant facts. 73% 12% 3% 2% 3% 8% 3.63 Overall Application of Law 3.62 Overall Average Grade: 3.67 2011 Interim Judicial Performance Survey ## Page 32 Survey of Non-Attorneys Regarding Trial Judges Average All District Judges Grade Sample Size = 40496 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 8% Competely neutral 86% Biased in favor of the defense total 6% Average 0.07 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 8% Competely neutral 82% Lenient sentencing total 10% Average 0.04 2011 Interim Judicial Performance Survey ## Page 33 QQuueessttiioonnnnaaiirreess ## Page 34 Colorado Judicial Performance Attorneys Regarding Trial Judges Survey Questions _ Which of the following types of cases have you observed Judge (Last Name)’s performance? Please circle all that apply. (Only respondents who indicate they have observed the judge in “criminal other than traffic” cases will be asked question 2c and question 6.) Civil . 1 Criminal other than traffic . 2 Traffic . 3 Domestic . 4 Juvenile . 5 Probate . 6 Other . 9 1. Case Management: a. Promptly issuing a decision on the case after trial. A B C D F DK/NS b. Maintaining appropriate control over proceedings. A B C D F DK/NS c. Promptly ruling on pre-trial motions. A B C D F DK/NS d. Setting reasonable schedules for cases. A B C D F DK/NS 2. Application and Knowledge of Law: a. Being able to identify and analyze relevant facts. A B C D F DK/NS b. Basing decisions on evidence and arguments. A B C D F DK/NS c. Willing to reconsider error in fact or law. A B C D F DK/NS d. [Criminal only] Issuing consistent sentences when the circumstances are similar. A B C D F DK/NS 3. Communications: a. Makings sure all participants understand the proceedings. A B C D F DK/NS b. Providing written communications that are clear, thorough and well reasoned. A B C D F DK/NS 4. Demeanor: a. Giving proceedings a sense of dignity. A B C D F DK/NS b. Treating participants with respect. A B C D F DK/NS c. Conducting his/her courtroom in a neutral manner. A B C D F DK/NS d. Consistently applying laws and rules. A B C D F DK/NS 5. Diligence: a. Using good judgment in application of relevant law and rules. A B C D F DK/NS b. Doing the necessary “homework” and being prepared for his/her cases. A B C D F DK/NS c. Being willing to handle cases on the docket even when they are complicated and time consuming. A B C D F DK/NS 1 ## Page 35 Having observed Judge (Last Name) in a criminal case, would you say the judge is: (This question is asked only if respondent indicated at the beginning of the survey he/she observed the judge in a criminal case.) Very biased in favor of the prosecution . 1 Somewhat biased in favor of the prosecution . 2 Completely Neutral . 3 Somewhat biased in favor of the defense . 4 Very biased in favor of the defense . 5 Don’t Know/Not Sure . 9 6. What would you say are Judge (Last Name)’s strengths? _ _ _ 7. What would you say are Judge (Last Name)’s weaknesses? _ _ _ 8. Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge (Last Name) be retained in office, or not retained in office? Strongly recommend he be retained in office . 5 Somewhat recommend he be retained in office . 4 Undecided or don’t know enough to make recommendation . 3 Somewhat recommend he not be retained in office . 2 Strongly recommend he not be retained in office . 1 2 ## Page 36 9. And what would you say are Judge [Last Name]’s weaknesses? ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ Commission on Judicial Performance ___________________________________________________________ ___________________________________________________________ Evaluation of 10. Keeping in mind your responses to each of the previous questions, how JUDGE [FULL NAME] strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? Strongly recommend he/she be retained in office ................................ 5 Somewhat recommend he/she be retained in office ............................ 4 Undecided or don’t know enough to make recommendation ............. 3 If we have made a mistake and you either were not in Judge [Last Somewhat recommend he/she not be retained in office ..................... 2 Name]’s courtroom in the past 18 months, or you feel that you do not Strongly recommend he/she not be retained in office ......................... 1 have sufficient experience with Judge [Last Name] to have an opinion the judge’s judicial performance, please just return this questionnaire, unanswered, in the enclosed postage-paid envelope, to stop any further requests to evaluate Judge [Last Name]. Thank you for taking the time to complete this questionnaire. Please place it in the self-addressed, postage-paid envelope provided and place it in the mail. Your participation in this survey is very much appreciated. Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please circle the number corresponding to “Don’t Know/Not Applicable”—DK/NA). DK 1. Demeanor: A B C D F N/A a. Giving court proceedings a sense of dignity. 4 3 2 1 0 9 b. Treating participants in the case politely and with respect. 4 3 2 1 0 9 c. Conducting his/her courtroom in a neutral manner. 4 3 2 1 0 9 d. Having a sense of compassion and human understanding for those who appear before him/her. 4 3 2 1 0 9 ## Page 37 DK 6. [If you were in [Last Name]’s courtroom during a criminal case or 2. Fairness: A B C D F N/A cases please answer this question, otherwise skip to the next a. Giving participants an opportunity to be heard. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Treating those involved in the case without bias. 4 3 2 1 0 9 number how biased you think Judge [Last Name] is toward the defense or c. Treating fairly people who represent themselves. 4 3 2 1 0 9 the prosecution. If you feel Judge [Last Name] is completely unbiased, circle “0.” d. Giving each side enough time to present his or her case. 4 3 2 1 0 9 Bias toward Completely Bias toward Defense Neutral Prosecution DK 5 4 3 2 1 0 1 2 3 4 5 3. Communications: A B C D F N/A a. Makings sure participants understand the 7. [If you were in [Last Name]’s courtroom during a criminal case or proceedings, and what’s going on in the cases please answer this question, otherwise skip to the next courtroom. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Using language that everyone can understand. 4 3 2 1 0 9 number how lenient or how harsh you think the sentences generally handed c. Speaking clearly so everyone in the courtroom down by [Last Name] are. If you feel Judge [Last Name] generally hands can hear what’s being said. 4 3 2 1 0 9 down appropriate sentences, circle “0.” DK Sentences Appropriate Sentences 4. Diligence: A B C D F N/A Too Light Sentences Too Harsh a. Beginning court on time. 4 3 2 1 0 9 5 4 3 2 1 0 1 2 3 4 5 b. Maintaining appropriate control over proceedings. 4 3 2 1 0 9 c. Setting reasonable schedules for cases. 4 3 2 1 0 9 d. Being prepared for his/her cases. 4 3 2 1 0 9 Though your name will never be associated with your answers, because the judge will e. Managing court proceedings so that there is see a typed transcript of the comments that you and others write, it is important that little wasted time. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. 8. What would you say are Judge [Last Name]’s strengths? DK ___________________________________________________________ 5. Application of Law: A B C D F N/A ___________________________________________________________ a. Giving reasons for rulings. 4 3 2 1 0 9 ___________________________________________________________ b. Willing to make decision without regard to ___________________________________________________________ possible outside pressure. 4 3 2 1 0 9 ___________________________________________________________ c. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 ___________________________________________________________ Continued on Back Page - 2014 Retention Survey Report(PDF on OJPE)
Read full retention survey textexpand
## Page 1 State of Colorado Logo COMMISSION ON JUDICIAL PERFORMANCE TThhee HHoonnoorraabbllee DDoouuggllaass RR.. VVaannnnooyy 2014 Judicial Performance Survey Report 13th Judicial District ## Page 2 March 26, 2014 The Honorable Douglas R. Vannoy Morgan Combined Court 400 Warner Street Ft. Morgan, CO 80701 Dear Judge Vannoy: I am pleased to make available to you the attached copy of your 2014 Judicial Performance Survey Report. This report includes the survey results from three important stakeholder groups: 1) attorneys who have had cases in your court or who are knowledgeable about your judicial performance; 2) appellate judges; and 3) non-attorneys who have observed your performance in court or who have knowledge of your performance as a judge. In addition to this introduction, the report is divided into six main sections: 1. A brief summary of the results of the attorney and non-attorney surveys. 2. The numerical results of the survey of attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments attorneys made about your judicial performance. In some instances the comments have been redacted to eliminate respondent identifying information. 3. The numerical results of the survey of appellate judges in tabular form, and any comments the justices and judges might have made about your judicial performance. 4. The numerical results of the survey of non-attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments these respondents made on the subject of your judicial performance. In few instances the comments have been redacted to eliminate respondent identifying information. 5. The fifth section of the report discusses the methodology of the surveys. 6. The final section provides copies of the questions or questionnaires that were used for each survey. If you have any questions about the methodology and how the survey was conducted, please feel free to contact me at 505-821-5454 or by email at sanderoff@rpinc.com (please put the words “Judicial Performance” in the subject line), and for any other questions you might have about the survey please call the Executive Director of the Office of Judicial Performance Evaluation, Kent Wagner, at 303-928-7779. Best regards, Brian Sanderoff President ## Page 3 Summary of Results Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. On average, Judge Douglas R. Vannoy received an overall combined average grade of 3.47 in the 2014 Judicial Performance Survey. This is calculated by adding the overall average grade received from attorney respondents, 3.48, to the overall average grade received from non-attorney respondents, 3.45, divided by two. The average combined grade for all district judges standing for retention in 2014 is 3.50 (not shown below). Judge Vannoy Average Grades (All Years) Combined Attorney Non-attorney Overall Grade 3.47 3.48 3.45 Sample Size - 95 247 Table 1 The results presented in this report are based on data collected in 2008, 2009, 2010, 2011, 2012 and 2013. (See Methodology section for description of sampling process.) Table 2 shows Judge Vannoy’s overall average grades for up to six years (for each year in which survey results are available.) Provisional judges will not have samples for the years prior to their appointment. Judge Vannoy Average Grades by Year Combined Attorney Non-Attorney Average Average Sample Average Sample Year Score Score Size Score Size 2008 3.75 3.97 2 3.53 41 2009 3.53 3.51 25 3.55 81 2010 3.41 3.49 42 3.33 39 2011 NA NA NA NA NA 2012 NA NA NA NA NA 2013 3.38 3.38 26 3.38 86 Overall 3.47 3.48 95 3.45 247 Table 2 1 ## Page 4 Comparison of Jurors vs. Non-Jurors Among Non-Attorney Population Among the non-attorney population, jurors tend to grade judges much higher than non- jurors. The juror overall average grade for all district judges standing for retention in 2014 is 3.80, while the overall average grade awarded by non-jurors is 3.28. The effect of this is that judges with a higher percentage of jurors in their sample tend to have higher average grades in the non-attorney survey than those judges with a small percentage of jurors. The number of jurors in a judge’s sample is, of course, closely related to the number of jury trials the judge presides over. The table below shows Judge Vannoy’s non-attorney results broken out by jurors and non-jurors. It also shows the overall average juror and non-juror grades for all district judges standing for retention in 2014 (see two columns on far right). Average Grades for Jurors vs. Non-Jurors (All Years) All District Judge Vannoy Judges* Jurors Non-Jurors Average Sample Average Sample Juror Non-Juror Score Size % Score Size % Average Average 3.75 110 45% 3.22 137 55% 3.80 3.28 Table 3 * Includes only the District judges evaluated during this retention cycle. 2 ## Page 5 SSuurrvveeyy ooff AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee DDoouuggllaass RR.. VVaanooyy ((SSaammppllee SSiizzee 9955)) ## Page 6 Survey of Attorneys Regarding District Judges Average (0.0 to 4.0 scale) Judge Douglas R. Vannoy Douglas R. All District Sample Size = 95 A B C D Fail DK/NA Vannoy Judges* 1. Case Management: 1a. Promptly issuing a decision on the case after trial. 58% 25% 4% 0% 0% 13% 3.61 3.44 1b. Maintaining appropriate control over proceedings. 65% 25% 6% 2% 0% 1% 3.55 3.39 1c. Promptly ruling on pre-trial motions. 56% 24% 8% 1% 0% 11% 3.51 3.30 1d. Setting reasonable schedules for cases. 48% 37% 9% 0% 0% 5% 3.41 3.28 Overall Case Management 3.52 3.35 2. Application and Knowledge of Law: 2a. Being able to identify and analyze relevant facts. 74% 19% 5% 0% 1% 1% 3.66 3.29 2b. Basing decisions on evidence and arguments. 64% 26% 7% 1% 0% 1% 3.55 3.17 2c. Willing to reconsider error in fact or law. 41% 27% 16% 4% 0% 12% 3.19 2.96 2d. Issuing consistent sentences when the circumstances are 51% 27% 8% 3% 0% 10% 3.40 3.12 similar. Overall Application and Knowledge of Law 3.45 3.14 3. Communications: 3a. Making sure all participants understand the proceedings. 54% 36% 10% 0% 0% 0% 3.45 3.50 3b. Providing written communications that are clear, thorough 63% 21% 9% 0% 0% 7% 3.59 3.30 and well reasoned. Overall Communications 3.52 3.40 4. Demeanor: 4a. Giving proceedings a sense of dignity. 72% 20% 6% 1% 0% 0% 3.64 3.47 4b. Treating participants with respect. 52% 30% 11% 6% 1% 0% 3.26 3.40 4c. Conducting the courtroom in a neutral manner. 56% 26% 15% 3% 0% 0% 3.35 3.28 4d. Consistently applying laws and rules. 60% 23% 10% 3% 2% 2% 3.38 3.22 Overall Demeanor 3.41 3.34 5. Diligence: 5a. Using good judgment in application of relevant law and 55% 29% 9% 4% 1% 2% 3.36 3.16 rules. 5b. Doing the necessary "homework" and being prepared for 72% 18% 4% 2% 0% 3% 3.66 3.34 cases. 5c. Being willing to handle cases on the docket even when 62% 18% 9% 1% 1% 10% 3.53 3.43 they are complicated and time consuming. Overall Diligence 3.52 3.31 Overall Average Grade: 3.48 3.30 * Includes only the District judges evaluated during this retention cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A=4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2014 Judicial Performance Survey Report 3 ## Page 7 Survey of Attorneys Regarding District Judges Percentage Judge Douglas R. Vannoy Douglas R. All District Vannoy Judges* Would you say the judge is: Very biased in favor of the prosecution 3% 11% Somewhat biased in favor of the prosecution 22% 27% Completely neutral 53% 46% Somewhat biased in favor of the defense 17% 9% Very biased in favor of the defense 2% 2% Don't know or not sure 3% 5% How strongly do you recommend that the Judge be retained in office, or not be retained in office? Strongly recommend retain 58% 56% Recommend retain 19% 24% Neither recommend nor not recommend retain 19% 8% Recommend not retain 0% 5% Strongly recommend not retain 4% 6% Total Retain 77% 80% Neither 19% 8% Total Not Retain 4% 11% * Includes only the District judges evaluated during this retention cycle. 2014 Judicial Performance Survey Report 4 ## Page 8 Judge Douglas R. Vannoy Survey of Attorneys Regarding District Judges Average Grades 3.48 Overall Average Grade 3.30 3.52 Q1. Overall Case Management 3.35 1a. Promptly issuing a decision on the 3.61 case after trial. 3.44 3.55 1b. Maintaining appropriate control over proceedings. 3.39 3.51 1c. Promptly ruling on pre-trial motions. 3.30 1d. Setting reasonable schedules for cases. 3.41 3.28 3.45 Q2. Overall App & Knowledge of Law 3.14 3.66 2a. Being able to identify and analyze relevant facts. 3.29 3.55 2b. Basing decisions on evidence and arguments. 3.17 3.19 2c. Willing to reconsider error in fact or law. 2.96 3.40 2d. [Criminal only] Issuing consistent sentences 3.12 when circumstances are similar. 3.52 Q3. Overall Communication 3.40 3.45 3a. Making sure all participants understand 3.50 the proceedings. 3.59 3b. Providing written communications that are 3.30 clear, thorough and well reasoned. 2.0 2.5 3.0 3.5 4.0 Douglas R. Vannoy All District Judges* * Includes only the District judges evaluated during this retention cycle. Judge Douglas R. Vannoy 5 2014 Judicial Performance Survey Report ## Page 9 * Includes only the District judges evaluated during this retention cycle. Judge Douglas R. Vannoy Survey of Attorneys Regarding District Judges Average Grades 3.41 Q4. Overall Demeanor 3.34 3.64 4a. Giving proceedings a sense of dignity. 3.47 3.26 4b. Treating participants with respect. 3.40 4c. Conducting the courtroom in a 3.35 neutral manner. 3.28 3.38 4d. Consistently applying laws and rules. 3.22 3.52 Q5. Overall Diligence 3.31 5a. Using good judgment in application of 3.36 relevant laws and rules. 3.16 5b. Doing the necessary 'homework' and 3.66 being prepared for cases. 3.34 5c. Being willing to handle cases on the docket even 3.53 when they are complicated and time consuming. 3.43 2.0 2.5 3.0 3.5 4.0 Biased in favor of prosecution/defense. 3% Very biased in favor of the prosecution 11% 22% Somewhat biased in favor of the prosecution 27% 53% Completely Neutral 46% 17% Somewhat biased in favor of the defense 9% 2% Very biased in favor of the defense 2% 3% Don't know/not sure 5% 0% 10% 20% 30% 40% 50% 60% Douglas R. Vannoy All District Judges* * Includes only the District judges evaluated during this retention cycle. 6 2014 Judicial Performance Survey Report ## Page 10 * Includes only the District judges evaluated during this retention cycle. Judge Douglas R. Vannoy Survey of Attorneys Regarding District Judges How strongly do you recommend that Judge Vannoy be retained or not retained in office? 58% Strongly recommend retain 56% 19% Recommend retain 24% 19% All Dist Neither retain nor not retain 8% Judge Vannoy Judges* Total Retain 77% 80% 0% Neither 19% 8% Recommend not retain 5% Total Not Retain 4% 11% 4% Strongly recommend not retain 6% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Douglas R. Vannoy All District Judges* * Includes only the District judges evaluated during this retention cycle. 7 2014 Judicial Performance Survey Report ## Page 11 SSuurrvveeyy ooff AApeelaattee JJuuddggeess RReeggaarrddiinngg JJuuddggee DDoouuggllaass RR.. VVaanooyy ((SSaammppllee SSiizzee 1166)) ## Page 12 Survey of Appellate Judges Regarding District Judges Average Judge Douglas R. Vannoy All District No Douglas R. Judges* Evaluations of Judge Vannoy = 16 A B C D Fail Grade Vannoy Judge Vannoy in terms of overall performance as a judge. 19% 31% 0% 0% 0% 50% 3.38 3.46 * Includes only the District judges evaluated during this retention cycle. 2014 Judicial Performance Survey Report 9 ## Page 13 SSuurrvveeyy ooff NNoonn--AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee DDoouuggllaass RR.. VVaanooyy ((SSaammppllee SSiizzee 224477)) ## Page 14 Survey of Non-Attorneys Regarding District Judges Average (0.0 to 4.0 scale) Judge Douglas R. Vannoy Douglas R. All District Sample Size = 247 A B C D Fail DK/NA Vannoy Judges* 1. Demeanor: 1a. Giving court proceedings a sense of dignity. 69% 21% 5% 1% 2% 2% 3.56 3.72 1b. Treating participants in the case politely and with respect. 64% 22% 9% 2% 2% 1% 3.45 3.73 1c. Conducting the courtroom in a neutral manner. 63% 23% 7% 2% 4% 2% 3.43 3.67 1d. Having a sense of compassion and human understanding 57% 26% 9% 3% 3% 2% 3.33 3.62 for those who appear before the judge. Overall Demeanor 3.44 3.69 2. Fairness: 2a. Giving participants an opportunity to be heard. 68% 21% 5% 2% 4% 1% 3.48 3.70 2b. Treating those involved in the case without bias. 64% 21% 7% 2% 5% 2% 3.41 3.66 2c. Treating fairly people who represent themselves. 43% 15% 4% 1% 2% 34% 3.45 3.68 2d. Giving each side enough time to present his or her case. 65% 22% 4% 1% 3% 6% 3.53 3.70 Overall Fairness 3.47 3.69 3. Communications: 3a. Making sure participants understand the proceedings, and 68% 21% 7% 0% 2% 1% 3.54 3.74 what's going on in the courtroom. 3b. Using language that everyone can understand. 71% 19% 7% 0% 2% 1% 3.58 3.75 3c. Speaking clearly so everyone in the courtroom can hear 65% 22% 8% 2% 2% 1% 3.48 3.78 what's being said. Overall Communications 3.53 3.76 4. Diligence: 4a. Beginning court on time. 57% 22% 11% 5% 3% 3% 3.28 3.61 4b. Maintaining appropriate control over proceedings. 70% 20% 5% 1% 1% 2% 3.61 3.76 4c. Setting reasonable schedules for cases. 58% 19% 9% 4% 2% 8% 3.38 3.67 4d. Being prepared for cases. 68% 18% 4% 3% 2% 4% 3.52 3.73 4e. Managing court proceedings so that there is little wasted 58% 23% 10% 4% 3% 2% 3.32 3.61 time. Overall Diligence 3.42 3.68 5. Application of Law: 5a. Giving reasons for rulings. 61% 17% 9% 2% 4% 5% 3.37 3.63 5b. Willing to make decision without regard to possible outside 57% 16% 5% 2% 4% 16% 3.42 3.67 pressure. 5c. Being able to identify and analyze relevant facts. 64% 19% 5% 1% 4% 7% 3.49 3.64 Overall Application of Law 3.43 3.65 Overall Average Grade: 3.45 3.69 * Includes only the District judges evaluated during this retention cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A=4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2014 Judicial Performance Survey Report 11 ## Page 15 Survey of Non-Attorneys Regarding District Judges Percentage Judge Douglas R. Vannoy Douglas R. All District Vannoy Judges* 6. Average Bias [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 14% 8% Competely neutral 74% 86% Biased in favor of the defense total 14% 7% [A positive average indicates bias toward prosecution, and a Average 0.03 0.05 negative average indicates a bias toward the defense.] 7. Average Sentencing [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 10% 8% Competely neutral 67% 82% Lenient sentencing total 23% 11% [A positive average indicates sentences are harsh, and a Average -0.23 0.01 negative average indicates sentences are lenient.] How strongly do you recommend that the Judge be retained, or not be retained in office? Strongly recommend retain 63% 75% Recommend retain 18% 13% Neither recommend nor not recommend retain 10% 6% Recommend not retain 4% 2% Strongly recommend not retain 5% 4% Total Retain 81% 88% Neither 10% 6% Total Not Retain 9% 6% * Includes only the District judges evaluated during this retention cycle. 2014 Judicial Performance Survey Report 12 ## Page 16 Judge Douglas R. Vannoy Survey of Non-Attorneys Regarding District Judges Average Grades 3.45 Overall Average Grade 3.69 3.44 Q1. Overall Demeanor 3.69 3.56 1a. Giving proceedings a sense of dignity. 3.72 1b. Treating participants politely and with respect. 3.45 3.73 1c. Conducting the courtroom in a neutral 3.43 manner. 3.67 1d. Having a sense of compassion and human 3.33 understanding for those who appear before the judge. 3.62 3.47 Q2. Overall Fairness 3.69 2a. Giving participants an opportunity to be 3.48 heard. 3.70 2b. Treating those involved in the 3.41 case without bias. 3.66 2c. Treats people fairly who represent 3.45 themselves. 3.68 2d. Giving each side enough time to present his 3.53 or her case. 3.70 3.53 Q3. Overall Communications 3.76 3a. Making sure participants understand the 3.54 proceedings, and what's going on in the courtroom. 3.74 3b. Using language that everyone can 3.58 understand. 3.75 3c. Speaking clearly so everyone in the courtroom 3.48 can hear what's being said. 3.78 2.0 2.5 3.0 3.5 4.0 Douglas R. Vannoy All District Judges* * Includes only the District judges evaluated during this retention cycle. Judge Douglas R. Vannoy 13 2014 Judicial Performance Survey Report ## Page 17 Judge Douglas R. Vannoy Survey of Non-Attorneys Regarding District Judges Average Grades 3.42 Q4. Overall Diligence 3.68 3.28 4a. Beginning court on time. 3.61 4b. Maintaining appropriate control over 3.61 proceedings. 3.76 4c. Setting reasonable schedules for cases. 3.38 3.67 4d. Being prepared for cases. 3.52 3.73 4e. Managing court proceedings so that there is 3.32 little wasted time. 3.61 3.43 Q5. Overall Application of Law 3.65 3.37 5a. Giving reasons for rulings. 3.63 5b. Willing to make decision without regard to 3.42 possible outside pressure. 3.67 5c. Being able to identify and analyze 3.49 relevant facts. 3.64 2.0 2.5 3.0 3.5 4.0 Q6 Biased in favor of prosecution/defense. 1 0.03 Douglas R. Vannoy 0.05 All District Judges* -5 -4 -3 -2 -1 0 1 2 3 4 5 Defense Prosecution 1-A negative average score indicates bias toward the defense, and a positive average score indicates bias toward prosecution. Q7 Lenience or Harshness in Sentencing. 2 -0.23 Douglas R. Vannoy 0.01 All District Judges* -5 -4 -3 -2 -1 0 1 2 3 4 5 Lenient Harsh 2-A negative average score indicates sentences are lenient, and a positive average score indicates sentences are harsh. Douglas R. Vannoy All District Judges* * Includes only the District judges evaluated during this retention cycle. 14 2014 Judicial Performance Survey Report ## Page 18 * Includes only the District judges evaluated during this retention cycle. Judge Douglas R. Vannoy Survey of Non-Attorneys Regarding District Judges How strongly do you recommend that Judge Vannoy be retained or not retained in office? 63% Strongly recommend retain 75% 18% Recommend retain 13% 10% Neither retain nor not retain All Dist 6% Judge Vannoy Judges* 4% Total Retain 81% 88% Recommend not retain 2% Neither 10% 6% Total Not Retain 9% 6% 5% Strongly recommend not retain 4% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Douglas R. Vannoy All District Judges* * Includes only the District judges evaluated during this retention cycle. 15 2014 Judicial Performance Survey Report ## Page 19 MMeetthhooddoollooggyy ## Page 20 MMeetthhooddoollooggyy The results shown in the 2014 Judicial Performance Survey Report are based on three surveys: The Survey of Attorneys Regarding Trial Judges, the Survey of Appellate Judges Regarding District Judges, and the Survey of Non-Attorneys Regarding Trial Judges. Below is a description of the methodology used in the three surveys. I Attorneys Regarding District Judges a. Sample: Research & Polling, Inc. received case data with the names of attorneys who had likely been in each judge’s courtroom from the following primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Colorado Public Defender’s Office Denver County Courts District Attorney’s Office, Second Judicial District (Denver) The data from these different sources are combined, duplicates removed, and addresses corrected. Only judges that are due to receive a retention evaluation in 2014 were evaluated during this reporting cycle. The intent was to increase the number of completed attorney evaluations for each judge by excluding those not due to receive a retention evaluation in 2014. The number of possible judges that attorney respondents could evaluate was 10. Attorneys are first mailed a letter inviting them to complete the survey online. The letter provides the link to the online survey, as well as a unique password to access the survey. Approximately one week later, attorneys are sent an email invitation to complete the online survey, which also provides the Web address and their unique password. About a week after the first email is sent, a reminder email is sent, providing the same information. Potential respondents who do not complete the survey after the second email are then telephoned and asked to either complete the survey by phone, or to complete it online. Since 2010, the Judicial Performance Survey reports are based on a moving average, or rolling sample, of data collected over a period of time equal to the justice’s or judge’s term of office: ten years for a Supreme Court justice, eight years for a COA judge, six years for a district judge, and four years for a county judge. To use a district judge as an example: as survey data is collected it is pooled together for six years. After six years, as new data is added to the judge’s survey results, the oldest data in the pool is deleted. 17 ## Page 21 b. Questions: Respondents evaluated judges on 17 aspects of judicial performance using a grade scale of A, B, C, D, or F. (See Questionnaire section.) These grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the judge be retained or not retained in office. For this evaluation cycle, the “Don’t know enough to make a recommendation” response category was excluded from the retention question. c. Analysis: The Attorneys Regarding District Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all district judges standing for retention in 2014 and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all district retention judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the question about recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all district retention judges. The next page displays the question averages in horizontal bar-graph form. The percentage distribution to the retention question is then presented in the graph on the next page. The last part of the Attorneys Regarding District Judges section of the report lists the comments the attorneys made about the judge’s strengths and weaknesses. d. Comments: Respondents were also asked what they considered to be the judge’s strengths and weaknesses. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. Most spelling and typographical errors have been corrected. 18 ## Page 22 e. Cooperation Rate: The overall cooperation rate for the Attorneys Regarding Trial Judges Survey is calculated as the number of completed survey evaluations divided by the number of possible evaluations resulting in an overall response rate of 47.0% for district judges and 40.5% for county judges. An equivalent response rate for an individual judge is computed in the same manner. Undeliverable surveys have been excluded from the cooperation rates. II Appellate Judges Regarding District Judges a. Sample: Twenty-seven appellate judges (Supreme Court and Court of Appeals) were sent a questionnaire asking them to evaluate the district judges eligible to stand for retention in November 2014. b. Questions: The questionnaire consisted of one question about each district judge concerning overall performance (see Questionnaire section). The A through F responses were converted to a numerical scores where A = 4, B = 3, C = 2, D = 1 and Fail = 0. c. Analysis: The Appellate Judges Regarding District Judges section shows a table of the percentage distribution for the one question, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for that question. For comparison purposes, the average grade was also computed for all district judges eligible to stand for retention in 2014 and is shown in the furthest right column on the page. The second part of the Appellate Judges Regarding District Judges lists the judges’ and justices’ comments, if any. d. Comments: In addition to the A through F questions, the appellate judge respondents were given the opportunity to write a comment about each district judge. By statute, these comments are confidential and only provided to the district judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the district judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. An effort has been made to correct spelling and typographical errors. 19 ## Page 23 e. Cooperation Rate: In 2014, a questionnaire was sent to 27 Supreme Court justices and Court of Appeals judges. Sixteen questionnaires were returned, though not all 16 showed grades for every district judge. III Non-Attorneys Regarding District Judges a. Sample: Research & Polling, Inc. received case data with the names of non-attorneys who had likely been in each judge’s courtroom from the following primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Colorado Public Defender’s Office Denver County Courts District Attorney’s Office, Second Judicial District (Denver) The data from these different sources are combined, duplicates removed, and addresses corrected. Only the judges standing for retention in 2014 were evaluated. The intent was to increase the number of completed non-attorney evaluations for each retention judge by excluding those not standing for retention. All non-attorneys with courtroom experience were surveyed (i.e. court employees, court interpreters, probation officers, witnesses, law enforcement, jurors, crime victims, etc.). The only exception to this were the criminal defendants and civil litigants for which RPI selected a random sample. Court staff, probation officers, and court interpreters were asked to complete the survey online. They are sent an email invitation to complete the online survey, which also provides the Web address and their unique password. About a week after the first email is sent, a reminder email is sent, providing the same information. Other non-attorneys were surveyed via standard mail. First, they were mailed an initial postcard informing the recipient that he or she would be receiving a questionnaire. Two to three weeks after the postcard was mailed, the potential respondent was sent a personalized introductory letter and a questionnaire with a postage-paid return envelope. If the person did not respond, a second questionnaire and letter were sent approximately four weeks later. Questionnaires are barcoded, and if a respondent mailed back two questionnaires, the second one was deleted from the data file. Since 2010, the non-attorney section of the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the judge’s term of office: six years for a district judge and four years for a county judge. To use a district judge as an example: as survey data is collected it is pooled together for six years. After six years, as new data is added to the judge’s survey results, the oldest data in the pool is deleted. 20 ## Page 24 b. Questions: Respondents evaluated judges on 19 aspects of judicial performance using a grade scale of A, B, C, D, or F. (See Questionnaire section.) These grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the judge be retained or not retained in office. A copy of the questionnaire is included in the last section of this report. c. Analysis: The Non-Attorneys Regarding District Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all district judges standing for retention in 2014 and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all district retention judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the questions about prosecution or defense bias and recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all district retention judges. The next page displays the question averages in horizontal bar-graph form. The percentage distribution of the prosecution-defense bias and retention questions are then presented in the graph on the next page. The last part of the Non-Attorneys Regarding District Judges section of the report lists the comments the non-attorneys made about the judge’s strengths and weaknesses. d. Comments: In addition to the A through F questions, non-attorney respondents were asked what they considered to be the judge’s strengths and weaknesses. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. 21 ## Page 25 The number to the left of each comment refers to the same non-attorney respondent in both the strengths section and the weaknesses section. e. Cooperation Rate: The estimated cooperation rate for the non-attorney survey is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses and refusals, undeliverables, and other responses. The table presents the estimated overall cooperation rate as well as the cooperation rate by the different types of respondents. The true cooperation rates are likely higher than shown because of the percentage of people who were mailed questionnaires about judges with whom they may not have had sufficient experience. This is due, in part, to many cases being disposed of without the parties having appeared in court, as well as in the case of law enforcement, the data includes all those who were subpoenaed for a case, not just those who appeared. A table of the response counts by respondent type for Judge Vannoy is shown on the following page, and on the next page is a table of the overall cooperation rates for both the Attorney and Non-Attorney Regarding District Judges surveys for all district judges. 22 ## Page 26 Judge Douglas R. Vannoy Judge Response Counts by Type of Respondent Total No Undeliverable/ Other Non- Coop Role Type Sent Response Not Applicable Responses Completes Rate Attorneys Criminal District Attorneys 35 14 1 0 20 58.8% Defense Attorneys 68 34 7 0 27 44.3% Other Attorneys Criminal 4 2 1 0 1 33.3% Civil Attorneys for Litigants 48 19 1 0 28 59.6% Other Attorneys Civil 33 12 3 0 18 60.0% GAL 1 0 0 0 1 100.0% Total Attorneys 189 81 13 0 95 54.0% Non-attorneys Criminal Witness 93 49 22 4 18 25.4% Law Enforcement 128 40 34 5 49 52.1% Defendant 427 212 182 3 30 12.2% Civil Litigant 225 144 50 5 26 14.9% Other 3 1 0 0 2 66.7% Jurors 239 101 18 10 110 49.8% Employees, including Interpreters 10 3 0 0 7 70.0% Probation Officers 7 2 0 0 5 71.4% Total Non-attorneys 1132 552 306 27 247 29.9% Grand Total: 1321 633 319 27 342 34.1% Note: “Undeliverable/Not Applicable” surveys are removed from the “Total Sent” prior to calculating the cooperation rate. 2014 Judicial Performance Survey Report 23 ## Page 27 Total Response Counts by Type of Respondent for All District Judges* Total No Undeliverable/ Other Non- Completes Cooperation Sent Response Not Applicable Responses Rate Attorneys Criminal District Attorneys 3105 1702 353 0 1050 38.2% Defense Attorneys 4381 2309 386 0 1686 42.2% Other Attorneys Criminal 164 88 10 0 66 42.9% Civil Attorneys for Litigants 3667 1426 237 0 2004 58.4% Other Attorneys Civil 4136 1945 378 0 1813 48.2% GAL 34 11 2 0 21 65.6% Total Attorneys 15487 7481 1366 0 6640 47.0% Non-attorneys Criminal Victim 55 28 18 0 9 24.3% Witness 5936 3024 1701 304 907 21.4% Other 58 32 13 3 10 22.2% Law Enforcement 5118 2861 1236 140 881 22.7% Defendant 17993 7871 8866 117 1139 12.5% Civil Litigant 8137 4580 1905 149 1503 24.1% Witness 122 51 34 3 34 38.6% Other 221 78 56 8 79 47.9% Jurors 17789 7033 1065 254 9437 56.4% Employees, including Interpreters 1120 450 172 21 477 50.3% Probation Officers 65 19 0 5 41 63.1% Total Non-attorneys 56614 26027 15066 1004 14517 34.9% Grand Total: 72101 33508 16432 1004 21157 38.0% * Includes only the District judges evaluated during this retention cycle. Note: “Undeliverable/Not Applicable” surveys are removed from the “Total Sent” prior to calculating the cooperation rate. 2014 Judicial Performance Survey Report 24 ## Page 28 Survey of Attorneys Regarding District Judges All District Judges* Average Grade Sample Size = 6640 A B C D Fail DK/NA (0.0 to 4.0 scale) 1. Case Management: 1a.Promptly issuing a decision on the case after trial. 50% 20% 6% 2% 1% 20% 3.44 1b.Maintaining appropriate control over proceedings. 60% 24% 9% 3% 2% 2% 3.39 1c.Promptly ruling on pre-trial motions. 48% 26% 9% 3% 2% 12% 3.30 1d.Setting reasonable schedules for cases. 53% 27% 9% 4% 3% 4% 3.28 Overall Case Management 3.35 2. Application and Knowledge of Law: 2a.Being able to identify and analyze relevant facts. 55% 25% 10% 4% 3% 2% 3.29 2b.Basing decisions on evidence and arguments. 52% 24% 11% 6% 4% 3% 3.17 2c.Willing to reconsider error in fact or law. 36% 19% 10% 6% 6% 24% 2.96 2d.Issuing consistent sentences when the circumstances are 41% 26% 11% 5% 4% 14% 3.12 similar. Overall Application and Knowledge of Law 3.14 3. Communications: 3a.Making sure all participants understand the proceedings. 63% 24% 7% 2% 1% 3% 3.50 3b.Providing written communications that are clear, thorough 51% 23% 9% 4% 2% 10% 3.30 and well reasoned. Overall Communications 3.40 4. Demeanor: 4a. Giving proceedings a sense of dignity. 67% 20% 7% 3% 3% 1% 3.47 4b. Treating participants with respect. 66% 17% 8% 4% 4% 1% 3.40 4c. Conducting the courtroom in a neutral manner. 60% 19% 9% 5% 5% 2% 3.28 4d. Consistently applying laws and rules. 54% 22% 10% 5% 4% 5% 3.22 Overall Demeanor 3.34 5. Diligence: 5a.Using good judgment in application of relevant law and 51% 25% 11% 6% 4% 2% 3.16 rules. 5b.Doing the necessary "homework" and being prepared for 57% 23% 9% 4% 3% 5% 3.34 cases. 5c.Being willing to handle cases on the docket even when they 55% 18% 6% 3% 2% 15% 3.43 are complicated and time consuming. Overall Diligence 3.31 Overall Average Grade: 3.30 * Includes only the District judges evaluated during this retention cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2014 Judicial Performance Survey Report 25 ## Page 29 Survey of Attorneys Regarding District Judges Average Grade All District Judges* (0.0 to 4.0 scale) Would you say the judge is: Very biased in favor of the prosecution 11% Somewhat biased in favor of the prosecution 27% Completely neutral 46% Somewhat biased in favor of the defense 9% Very biased in favor of the defense 2% Don't know or not sure 5% How strongly do you recommend that the Judge be retained in office, or not be retained in office? Strongly recommend retain 56% Recommend retain 24% Neither recommend nor not recommend retain 8% Recommend not retain 5% Strongly recommend not retain 6% Total Retain 80% Neither 8% Total Not Retain 11% * Includes only the District judges evaluated during this retention cycle. 2014 Judicial Performance Survey Report 26 ## Page 30 Survey of Non-Attorneys Regarding District Judges All District Judges* Average Grade Sample Size = 14517 A B C D Fail DK/NA (0.0 to 4.0 scale) 1. Demeanor: 1a.Giving court proceedings a sense of dignity. 81% 13% 3% 1% 1% 1% 3.72 1b.Treating participants in the case politely and with respect. 83% 10% 3% 1% 2% 0% 3.73 1c.Conducting the courtroom in a neutral manner. 81% 11% 3% 2% 3% 1% 3.67 1d.Having a sense of compassion and human understanding 77% 13% 3% 2% 3% 2% 3.62 for those who appear before the judge. Overall Demeanor 3.69 2. Fairness: 2a.Giving participants an opportunity to be heard. 81% 11% 3% 1% 2% 1% 3.70 2b.Treating those involved in the case without bias. 80% 11% 3% 2% 3% 2% 3.66 2c.Treating fairly people who represent themselves. 53% 6% 2% 1% 2% 36% 3.68 2d.Giving each side enough time to present his or her case. 79% 11% 3% 1% 2% 3% 3.70 Overall Fairness 3.69 3. Communications: 3a.Making sure participants understand the proceedings, and 82% 11% 3% 1% 1% 1% 3.74 what's going on in the courtroom. 3b.Using language that everyone can understand. 82% 13% 3% 1% 1% 1% 3.75 3c.Speaking clearly so everyone in the courtroom can hear 84% 11% 3% 1% 1% 1% 3.78 what's being said. Overall Communications 3.76 4. Diligence: 4a.Beginning court on time. 71% 19% 5% 1% 1% 2% 3.61 4b.Maintaining appropriate control over proceedings. 83% 11% 3% 1% 1% 1% 3.76 4c.Setting reasonable schedules for cases. 72% 13% 4% 1% 2% 9% 3.67 4d.Being prepared for cases. 80% 10% 3% 1% 2% 5% 3.73 4e.Managing court proceedings so that there is little wasted 73% 17% 5% 2% 2% 2% 3.61 time. Overall Diligence 3.68 5. Application of Law: 5a.Giving reasons for rulings. 73% 13% 4% 1% 3% 7% 3.63 5b.Willing to make decision without regard to possible outside 68% 9% 2% 1% 2% 17% 3.67 pressure. 5c.Being able to identify and analyze relevant facts. 75% 11% 3% 2% 3% 7% 3.64 Overall Application of Law 3.65 Overall Average Grade: 3.69 * Includes only the District judges evaluated during this retention cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2014 Judicial Performance Survey Report 27 ## Page 31 Survey of Non-Attorneys Regarding District Judges Average Grade All District Judges* (0.0 to 4.0 scale) 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 8% Competely neutral 86% Biased in favor of the defense total 7% Average 0.05 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 8% Competely neutral 82% Lenient sentencing total 11% Average 0.01 How strongly do you recommend that the Judge be retained, or not be retained in office? Strongly recommend retain 75% Recommend retain 13% Neither recommend nor not recommend retain 6% Recommend not retain 2% Strongly recommend not retain 4% Total Retain 88% Neither 6% Total Not Retain 6% * Includes only the District judges evaluated during this retention cycle. 2014 Judicial Performance Survey Report 28 ## Page 32 Survey of Appellate Judges Regarding District Judges All District Judges* DK/ Sample Size = 16 A B C D Fail NA All district judges eligible to stand for retention in 2014. 23% 16% 2% 1% 0% 58% Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 2014 Judicial Performance Survey Report 29 ## Page 33 QQuueessttiioonnnnaaiirreess ## Page 34 Colorado Judicial Performance Attorneys Regarding Trial Judges Survey Questions _ Which of the following types of cases have you observed Judge (Last Name)’s performance? Please circle all that apply. (Only respondents who indicate they have observed the judge in “criminal other than traffic” cases will be asked question 2d and the “bias” question between 5 and 6.) Civil . 1 Criminal other than traffic . 2 Traffic . 3 Domestic . 4 Juvenile . 5 Probate . 6 Other . 9 Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge [Last Name] on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. 1. Case Management: a. Promptly issuing a decision on the case after trial. A B C D F DK/NA b. Maintaining appropriate control over proceedings. A B C D F DK/NA c. Promptly ruling on pre-trial motions. A B C D F DK/NA d. Setting reasonable schedules for cases. A B C D F DK/NA 2. Application and Knowledge of Law: a. Being able to identify and analyze relevant facts. A B C D F DK/NA b. Basing decisions on evidence and arguments. A B C D F DK/NA c. Willing to reconsider error in fact or law. A B C D F DK/NA d. [Criminal only] Issuing consistent sentences when the circumstances are similar. A B C D F DK/NA 3. Communications: a. Making sure all participants understand the proceedings. A B C D F DK/NA b. Providing written communications that are clear, thorough and well reasoned. A B C D F DK/NA 4. Demeanor: a. Giving proceedings a sense of dignity. A B C D F DK/NA b. Treating participants with respect. A B C D F DK/NA c. Conducting his/her courtroom in a neutral manner. A B C D F DK/NA d. Consistently applying laws and rules. A B C D F DK/NA 1 ## Page 35 5. Diligence: a. Using good judgment in application of relevant law and rules. A B C D F DK/NA b. Doing the necessary “homework” and being prepared for his/her cases. A B C D F DK/NA c. Being willing to handle cases on the docket even when they are complicated and time consuming. A B C D F DK/NA Having observed Judge (Last Name) in a criminal case, would you say the judge is: (This question is asked only if respondent indicated at the beginning of the survey he/she observed the judge in a criminal case.) Very biased in favor of the prosecution . 1 Somewhat biased in favor of the prosecution . 2 Completely Neutral . 3 Somewhat biased in favor of the defense . 4 Very biased in favor of the defense . 5 Don’t Know/Not Sure . 9 6. What would you say are Judge (Last Name)’s strengths? _ _ _ 7. What would you say are Judge (Last Name)’s weaknesses? _ _ _ 8. Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge (Last Name) be retained in office, or not be retained in office? Strongly recommend retain in office . 5 Recommend retain in office . 4 Neither recommend nor not recommend retain in office . 3 Recommend not retain in office . 2 Strongly recommend not retain in office . 1 2 ## Page 36 9. And what would you say are Judge [Last Name]’s weaknesses? _ _ _ _ Commission on Judicial Performance _ _ Evaluation of 10. Keeping in mind your responses to each of the previous questions, how JUDGE [FULL NAME] strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? Strongly recommend he/she be retained in office . 5 Recommend he/she be retained in office . 4 Neither recommend nor not recommend h/s be retained in office .. 3 If we have made a mistake and you either were not in Judge [Last Recommend he/she not be retained in office. 2 Name]’s courtroom or you feel that you do not have sufficient Strongly recommend he/she not be retained in office . 1 experience with Judge [Last Name] to have an opinion on the judge’s judicial performance, please just return this questionnaire, unanswered, in the enclosed postage-paid envelope, to stop any further requests to evaluate Judge [Last Name]. Thank you for taking the time to complete this questionnaire. Please place it in the self-addressed, postage-paid envelope provided and place it in the mail. Your participation in this survey is very much appreciated. Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please circle the number corresponding to “Don’t Know/Not Applicable”—DK/NA). DK 1. Demeanor: A B C D F N/A a. Giving court proceedings a sense of dignity. 4 3 2 1 0 9 b. Treating participants in the case politely and with respect. 4 3 2 1 0 9 c. Conducting his/her courtroom in a neutral manner. 4 3 2 1 0 9 d. Having a sense of compassion and human understanding for those who appear before him/her. 4 3 2 1 0 9 Barcode ## Page 37 DK 6. [If you were in [Last Name]’s courtroom during a criminal case or 2. Fairness: A B C D F N/A cases please answer this question, otherwise skip to the next a. Giving participants an opportunity to be heard. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Treating those involved in the case without bias. 4 3 2 1 0 9 number how biased you think Judge [Last Name] is toward the defense or c. Treating fairly people who represent themselves. 4 3 2 1 0 9 the prosecution. If you feel Judge [Last Name] is completely unbiased, circle “0.” d. Giving each side enough time to present his or her case. 4 3 2 1 0 9 Bias toward Completely Bias toward Defense Neutral Prosecution DK 5 4 3 2 1 0 1 2 3 4 5 3. Communications: A B C D F N/A a. Makings sure participants understand the 7. [If you were in [Last Name]’s courtroom during a criminal case or proceedings, and what’s going on in the cases please answer this question, otherwise skip to the next courtroom. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Using language that everyone can understand. 4 3 2 1 0 9 number how lenient or how harsh you think the sentences generally handed c. Speaking clearly so everyone in the courtroom down by [Last Name] are. If you feel Judge [Last Name] generally hands can hear what’s being said. 4 3 2 1 0 9 down appropriate sentences, circle “0.” DK Sentences Appropriate Sentences 4. Diligence: A B C D F N/A Too Light Sentences Too Harsh a. Beginning court on time. 4 3 2 1 0 9 b. Maintaining appropriate control over 5 4 3 2 1 0 1 2 3 4 5 proceedings. 4 3 2 1 0 9 c. Setting reasonable schedules for cases. 4 3 2 1 0 9 d. Being prepared for his/her cases. 4 3 2 1 0 9 Though your name will never be associated with your answers, because the judge will e. Managing court proceedings so that there is see a typed transcript of the comments that you and others write, it is important that little wasted time. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. 8. What would you say are Judge [Last Name]’s strengths? DK ___________________________________________________________ 5. Application of Law: A B C D F N/A ___________________________________________________________ a. Giving reasons for rulings. 4 3 2 1 0 9 ___________________________________________________________ b. Willing to make decision without regard to ___________________________________________________________ possible outside pressure. 4 3 2 1 0 9 ___________________________________________________________ c. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 ___________________________________________________________ Continued on Back Page ## Page 38 Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the following district judges in terms of each one’s overall performance as a judge by circling the appropriate letter grade. If you feel that you don’t have enough information about a judge to mark a specific grade, please put a check in the box under “No Grade.” If there are any judges you would like to add a comment about, please do so by filling out comment section on pages 3 and 4, or by enclosing a separate sheet with your comments when you return this questionnaire. Please start each comment with the judge’s name and district. Thank you. 1st Judicial District No Grade 4th Judicial District (cont.) No Grade Randall C. Arp ............... A B C D F Barbara L. Hughes ........ A B C D F Jack W. Berryhill............ A B C D F Thomas K. Kane ........... A B C D F Margie L. Enquist .......... A B C D F Thomas L. Kennedy ...... A B C D F Ann Gail Meinster .......... A B C D F Michael P. McHenry ...... A B C D F Lily W. Oeffler ................ A B C D F David Prince .................. A B C D F Tamara S. Russell ......... A B C D F Gregory R. Werner........ A B C D F Chistopher C. Zenisek ... A B C D F 5th Judicial District 2nd Judicial District Frederick W. Gannett .... A B C D F Martin F. Egelhoff .......... A B C D F Russell H. Granger ....... A B C D F J. Eric Elliff ..................... A B C D F Mark D. Thompson ....... A B C D F A. Bruce Jones .............. A B C D F 6th Judicial District Elizabeth Leith ............... A B C D F Suzanne F. Carlson ...... A B C D F John W. Madden, IV ...... A B C D F 7th Judicial District Robert L. McGahey, Jr. . A B C D F Mary Deganhart ............ A B C D F Sheila A. Rappaport ...... A B C D F Charles R. Greenacre ... A B C D F Elizabeth A. Starrs ........ A B C D F J. Steven Patrick ........... A B C D F Michael J. Vallejos ........ A B C D F James W. Schum .......... A B C D F 4th Judicial District 8th Judicial District William B. Bain .............. A B C D F Julie Kunce Field........... A B C D F Edward S. Colt, II .......... A B C D F Thomas R. French ........ A B C D F Jann P. DuBois.............. A B C D F Stephen E. Howard ....... A B C D F 1 ## Page 39 9th Judicial District No Grade 20th Judicial District (cont.) No Grade Denise Lynch................. A B C D F Ingrid S. Bakke .............. A B C D F 10th Judicial District Maria E. Berkenkotter ... A B C D F William D. Alexander ..... A B C D F Patrick D. Butler ............ A B C D F Victor I. Reyes ............... A B C D F Judith L. LaBuda ........... A B C D F Andrew R. Macdonald .. A B C D F 11th Judicial District David M. Thorson .......... A B C D F 21st Judicial District David A. Bottger ............ A B C D F 12th Judicial District Thomas M. Deister........ A B C D F Michael A. Gonzales ..... A B C D F Brian J. Flynn ................ A B C D F 13th Judicial District 22nd Judicial District Kevin L. Hoyer ............... A B C D F Douglas S. Walker ........ A B C D F Douglas R. Vannoy ....... A B C D F 14th Judicial District Shelley A. Hill ................ A B C D F 17th Judicial District Please use the following pages or attach a Robert W. Kiesnowski, Jr. A B C D F sheet for comments you would like to make John E. Popovich, Jr. .... A B C D F about any of these district judges. Ted C. Tow, III ............... A B C D F Mark D. Warner ............. A B C D F Francis C. Wasserman .. A B C D F Craig R. Welling ............ A B C D F 18th Judicial District Michelle A. Amico .......... A B C D F F. Stephen Collins ......... A B C D F Paul A. King................... A B C D F Charles M. Pratt ............ A B C D F Gerald J. Rafferty .......... A B C D F Theresa M. Slade .......... A B C D F Elizabeth B. Volz ........... A B C D F John L. Wheeler ............ A B C D F Vincent R. White ........... A B C D F 19th Judicial District Timothy G. Kerns .......... A B C D F Marcelo Kopcow ............ A B C D F 2 ## Page 40 Though your name will never be associated with your answers, because each district judge will see a typed transcript of the comments people wrote about him or her, it is important that you do not include information in the comments below that would unintentionally identify you as the author. Judge Name Comments _:_ _ _ _ _ _ _:_ _ _ _ _ _ _:_ _ _ _ _ _ _:_ _ _ _ _ _ 3 ## Page 41 Though your name will never be associated with your answers, because each district judge will see a typed transcript of the comments people wrote about him or her, it is important that you do not include information in the comments below that would unintentionally identify you as the author. Judge Name Comments _:_ _ _ _ _ _ _:_ _ _ _ _ _ _:_ _ _ _ _ _ _:_ _ _ _ _ _ Barcode Goes Here 4
- 2008 cycle
- 2008 Retention Survey Report(PDF on OJPE)
Read full retention survey textexpand
## Page 1 State off Colorado LLogo COOMMISSIOON ON JUUDICIALL PERFORRMANCEE DDooouuggllaassss RR.. VVVVaannnnooyyyy 22008 Juudicial PPerformmance Suurvey ## Page 2 April 30, 2008 The Honorable Douglas R. Vannoy Morgan County Justice Center P.O. Box 130, 400 Warner Ft. Morgan, CO. 80701 Dear Judge Vannoy: Every two years the Colorado Judicial Performance Commission conducts a survey of people who have been in the courtroom of judges who face a retention vote in the next general election. The 2008 survey was conducted by Talmey-Drake Research & Strategy, Inc., who attempted to contact over 57,000 people statewide who had been in these courtrooms in one capacity or another. Over 12,400 people responded—3,084 to the attorney survey and 9,317 to the non-attorney survey. This report contains the results of those who were in your courtroom and who responded to the survey. In addition to this introduction, the report is divided into five main sections: • Attorney Results & Comments: This section contains graphs displaying the average grade you received overall (the combined average from questions 1a through 5e), each section and each question. Following the graphs, are a series of tables showing the percentage distribution of responses to each question. Attorney respondents were also asked to comment about your performance. These comments have been transcribed, and in some instances redacted to eliminate respondent identifying information. A copy of the attorney questionnaire is at the back of this report. • Appellate Judges & Comments: New to the 2008 Judicial Performance Evaluation is a survey of Court of Appeals judges and Supreme Court justices regarding the overall performance of district judges. • Non-attorney Results & Comments: Similar to the Attorney section, this portion of the report contains graphs (again including the overall average of questions 1a through 5c on the non-attorney questionnaire), the percentage distribution of responses by non-attorneys to each substantive question in the survey. The non-attorney respondents were also asked to comment about your performance. Again, these comments have been transcribed, and in some instances redacted to eliminate respondent identifying information. A copy of the non-attorney questionnaire is also at the back of this report. • Methodology: The third section of the report discusses the methodology of the survey. • Questionnaires: And the final section provides copies of the questionnaires that were used. 100 Arap ahoe, Suite One, Boulder, CO 80302 Phone 303.443.5300 Fax 303.447.9386 ## Page 3 TThe Honorabble Douglas RR. Vannoy AApril, 30 20088 PPage 2 If you havve any questtions about tthe methodoology and hoow the surveey was coonducted, pllease feel freee to contactt me at 303-4443-5300 ext 1, and for anny other questions youu might have about the ssurvey pleasse call the Exxecutive Dirrector of the CColorado Juddicial Performmance Progrram, Jane Hoowell, at 3033-837-3665. Beest regards, Paaul A. Talmeey Prresident ennc: ## Page 4 AAttttoorrnneeyy SSuurrvveeyy ((SSaammppllee SSiizzee 4400)) ## Page 5 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Average Grades: Overall and by Section 33..66 Overall Average 3.4 3.4 3.5 Q1. Overall Case 33.44 Management 3.4 3.7 Q2. Overall App & 3.4 Knowldge of Law 3.3 3.7 Q3. Overall 3.6 Communications 3.7 3.5 Q4. Overall Demeanor 3.5 3.5 3.7 Q5. Overall Diligence 3.4 3.4 1.0 1.5 2.0 2.5 3.0 3.5 4.0 AAvveerraaggee GGrraaddee Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 1 ## Page 6 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Average Grades: Case Management 3.5 Q1. Overall Case Management 3.4 3.4 3.9 1a. Promptly making rulings 3.6 during trial 3.6 33.55 1b. Beginning court on time 3.6 3.5 3.2 1c. Allotting appropriate amount 3.4 of time for cases 3.4 3.4 1d. Keeping cases moving 3.4 according to schedule 3.5 2.6 1e. [Civil only] Assisting parties to 3.0 reach agreement 3.0 3.8 1f. Maintaining appropriate 3.5 control over proceedings 3.5 3.7 1g. Promptly ruling on pre-trial 3.3 motions 3.3 3.8 1h. Promptly issuing a decision 3.5 on the case after trial 3.5 3.6 1i. Setting reasonable schedules 3.3 for cases 33.44 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 2 ## Page 7 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Average Grades: Application and Knowledge of Law 3.7 Q2. Overall App & Knowldge of 3.4 LLaaww 3.3 3.8 2a. Basing decisions on evidence 3.3 and arguments 3.3 3.7 2b. Giving reasons for rulings 3.4 3.4 3.4 2c. [Civil only] Issuing written 3.2 findings of fact and law 3.2 3.2 2d. Willing to reconsider error in 3.0 ffaacctt oorr llaaww 2.9 3.8 2e. Having knowledge of relevant 3.4 substantive law 3.3 3.9 2f. Having knowledge of rules of 3.5 pprroocceedduurree aanndd eevviiddeennccee 3.4 3.8 2g. Being able to identify and 3.4 analyze relevant facts 3.4 3.4 2h. [Criminal only] Issuing consistent sentences when the 3.3 circumstances are similar 3.3 3.7 2i. Willing to make decision without regard to possible 3.4 criticism 3.4 3.7 2j. Making decisions without fear 3.5 ooff bbeeiinngg aappppeeaalleedd 3.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 3 ## Page 8 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Average Grades: Communications 3.7 Q3. Overall Communications 3.6 3.7 33.88 3a. Speaking clearly 3.7 3.7 3.6 3b. Making sure all participants 3.6 understand the proceedings 3.6 3.8 3c. Using understandable 3.7 language 3.7 3.5 3d. Providing written communications that are 3.3 clear, thorough and well reasoned 3.3 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 4 ## Page 9 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Average Grades: Demeanor 3.5 Q4. Overall Demeanor 3.5 3.5 3.8 4a. Giving proceedings a sense 3.5 of dignity 3.5 3.2 4b. Treating everyone involved 3.4 politely 33.44 3.0 4c. Having empathy with the 3.3 parties involved 3.3 3.3 4d. Treating participants with 3.4 respect 3.5 3.6 4e. Presenting a neutral 3.4 presence on the bench 3.4 3.6 4f. Being consistent in [his/her] 3.4 behavior 3.5 33.66 4g. Conducting [his/her] 3.4 courtroom in a neutral manner 3.4 3.5 4h. Giving all participants an 3.5 opportunity to be heard 3.6 3.8 44ii. CCoonnssiisstteennttllyy aappppllyyiinngg llaawwss 3.4 and rules 3.4 3.9 4j. Not engaging in ex parte 3.7 communications 3.7 3.8 44kk. TTrreeaattiinngg pprroo ssee ppaarrttiieess ffaaiirrllyy 33.77 3.6 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 5 ## Page 10 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Average Grades: Diligence 3.7 Q5. Overall Diligence 3.4 3.4 3.8 55aa. MMaakkiinngg ttoouugghh ddeecciissiioonnss wwhheenn 3.4 necessary 3.4 3.7 5b. Using good judgment in apppplication of relevant law and 3.3 rules 3.3 3.7 5c. Doing the necessary 'homework' and being prepared 3.4 for [[his/her]] cases 3.4 3.6 5d. Being willing to handle cases on the docket even when they are 3.5 complicated and time consuming 33.55 3.6 5e. Providing prompt access to 3.5 the court in emergency matters 3.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 6 ## Page 11 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Q6. Average: How biased do you think Judge Vannoy is toward the defense or prosecution? Dougglas R. Vannoyy 0.3 All District Judges 0.4 All Trial Judges 0.7 5 4 3 2 1 0 1 2 3 4 5 (cid:205)Defense Prosecution (cid:206) Judicial Performance Survey 2008 Page 7 ## Page 12 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Q7. Average: How lenient or how harsh are Judge Vannoy's sentences? Douglas R. Vannoy 0.2 All District Judges 0.1 All Trial Judges 0.3 5 4 3 2 1 0 1 2 3 4 5 (cid:205)Lenient Harsh (cid:206) Judicial Performance Survey 2008 Page 8 ## Page 13 Douglas R. Vannoy AAttttoorrnneeyy SSuurrvveeyy Retention Recommendation 110000%% 90% 87% 85% 80% 77%77% 7744%%7744%% 70% 60% 50% 40% 30% 20% 13% 13%13% 12% 10% 8% 8% 6%6% 6%6% 4%4% 4%4% 4%4% 3% 3% 3% 3% 3% 0% Including Undecided Excluding Undecided Judge Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 9 ## Page 14 Douglas R. Vannoy Attorney Survey 1a. How would you grade Judge Vannoy on "Promptly making rulings during trial?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 89% 59% 57% B 5% 17% 18% C 3% 3% 3% D 0% 1% 1% Fail 0% 1% 1% No Grade 3% 19% 21% Average 3.9 3.6 3.6 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 1 ## Page 15 Douglas R. Vannoy Attorney Survey 1b. How would you grade Judge Vannoy on "Beginning court on time?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 54% 66% 62% B 44% 23% 25% C 0% 5% 7% D 3% 2% 2% Fail 0% 1% 1% No Grade 0% 3% 2% Average 3.5 3.6 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 2 ## Page 16 Douglas R. Vannoy Attorney Survey 1c. How would you grade Judge Vannoy on "Allotting appropriate amount of time for cases?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 40% 55% 56% B 40% 27% 28% C 13% 9% 8% D 3% 3% 2% Fail 0% 1% 1% No Grade 5% 5% 4% Average 3.2 3.4 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 3 ## Page 17 Douglas R. Vannoy Attorney Survey 1d. How would you grade Judge Vannoy on "Keeping cases moving according to schedule?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 45% 58% 58% B 45% 27% 28% C 10% 7% 7% D 0% 3% 2% Fail 0% 1% 1% No Grade 0% 4% 4% Average 3.4 3.4 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 4 ## Page 18 Douglas R. Vannoy Attorney Survey 1e. How would you grade Judge Vannoy on "[Civil only] Assisting parties to reach agreement?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 10% 23% 23% B 30% 17% 17% C 17% 10% 8% D 10% 4% 3% Fail 0% 2% 2% No Grade 33% 44% 47% Average 2.6 3.0 3.0 Letter Grade C+ B B Judicial Performance Survey 2008 Page 5 ## Page 19 Douglas R. Vannoy Attorney Survey 1f. How would you grade Judge Vannoy on "Maintaining appropriate control over proceedings?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 83% 64% 66% B 15% 22% 22% C 3% 8% 7% D 0% 3% 2% Fail 0% 1% 1% No Grade 0% 2% 2% Average 3.8 3.5 3.5 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 6 ## Page 20 Douglas R. Vannoy Attorney Survey 1g. How would you grade Judge Vannoy on "Promptly ruling on pre-trial motions?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 70% 45% 44% B 15% 23% 21% C 5% 9% 8% D 0% 3% 3% Fail 0% 2% 1% No Grade 10% 19% 24% Average 3.7 3.3 3.3 Letter Grade A- B B Judicial Performance Survey 2008 Page 7 ## Page 21 Douglas R. Vannoy Attorney Survey 1h. How would you grade Judge Vannoy on "Promptly issuing a decision on the case after trial?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 73% 48% 48% B 20% 17% 16% C 0% 5% 4% D 0% 2% 1% Fail 0% 1% 1% No Grade 8% 27% 29% Average 3.8 3.5 3.5 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 8 ## Page 22 Douglas R. Vannoy Attorney Survey 1i. How would you grade Judge Vannoy on "Setting reasonable schedules for cases?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 58% 53% 54% B 35% 26% 26% C 3% 9% 8% D 0% 3% 3% Fail 0% 2% 2% No Grade 5% 7% 8% Average 3.6 3.3 3.4 Letter Grade B+ B B+ Judicial Performance Survey 2008 Page 9 ## Page 23 Douglas R. Vannoy Attorney Survey 2a. How would you grade Judge Vannoy on "Basing decisions on evidence and arguments?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 85% 54% 54% B 10% 25% 25% C 0% 9% 9% D 5% 4% 4% Fail 0% 3% 3% No Grade 0% 5% 5% Average 3.8 3.3 3.3 Letter Grade A- B B Judicial Performance Survey 2008 Page 10 ## Page 24 Douglas R. Vannoy Attorney Survey 2b. How would you grade Judge Vannoy on "Giving reasons for rulings?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 75% 57% 56% B 23% 25% 25% C 0% 9% 9% D 3% 3% 4% Fail 0% 2% 2% No Grade 0% 4% 4% Average 3.7 3.4 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 11 ## Page 25 Douglas R. Vannoy Attorney Survey 2c. How would you grade Judge Vannoy on "[Civil only] Issuing written findings of fact and law?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 48% 32% 27% B 23% 18% 16% C 6% 7% 6% D 3% 3% 3% Fail 0% 1% 2% No Grade 19% 38% 47% Average 3.4 3.2 3.2 Letter Grade B+ B B Judicial Performance Survey 2008 Page 12 ## Page 26 Douglas R. Vannoy Attorney Survey 2d. How would you grade Judge Vannoy on "Willing to reconsider error in fact or law?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 23% 27% 27% B 23% 18% 18% C 8% 9% 9% D 3% 4% 5% Fail 0% 4% 4% No Grade 45% 37% 38% Average 3.2 3.0 2.9 Letter Grade B B B- Judicial Performance Survey 2008 Page 13 ## Page 27 Douglas R. Vannoy Attorney Survey 2e. How would you grade Judge Vannoy on "Having knowledge of relevant substantive law?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 80% 55% 54% B 18% 28% 28% C 0% 9% 9% D 0% 3% 4% Fail 0% 2% 2% No Grade 3% 3% 4% Average 3.8 3.4 3.3 Letter Grade A- B+ B Judicial Performance Survey 2008 Page 14 ## Page 28 Douglas R. Vannoy Attorney Survey 2f. How would you grade Judge Vannoy on "Having knowledge of rules of procedure and evidence?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 85% 63% 60% B 15% 23% 24% C 0% 7% 8% D 0% 2% 3% Fail 0% 2% 2% No Grade 0% 3% 4% Average 3.9 3.5 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 15 ## Page 29 Douglas R. Vannoy Attorney Survey 2g. How would you grade Judge Vannoy on "Being able to identify and analyze relevant facts?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 83% 58% 58% B 15% 24% 24% C 3% 9% 8% D 0% 3% 4% Fail 0% 2% 2% No Grade 0% 4% 4% Average 3.8 3.4 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 16 ## Page 30 Douglas R. Vannoy Attorney Survey 2h. How would you grade Judge Vannoy on "[Criminal only] Issuing consistent sentences when the circumstances are similar?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 17% 28% 36% B 17% 16% 18% C 3% 5% 5% D 0% 2% 2% Fail 0% 2% 1% No Grade 62% 48% 37% Average 3.4 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2008 Page 17 ## Page 31 Douglas R. Vannoy Attorney Survey 2i. How would you grade Judge Vannoy on "Willing to make decision without regard to possible criticism?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 78% 54% 54% B 15% 20% 20% C 3% 7% 7% D 3% 2% 3% Fail 0% 2% 3% No Grade 3% 15% 14% Average 3.7 3.4 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 18 ## Page 32 Douglas R. Vannoy Attorney Survey 2j. How would you grade Judge Vannoy on "Making decisions without fear of being appealed?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 73% 55% 55% B 20% 19% 20% C 3% 6% 6% D 0% 2% 2% Fail 0% 1% 1% No Grade 5% 17% 16% Average 3.7 3.5 3.5 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 19 ## Page 33 Douglas R. Vannoy Attorney Survey 3a. How would you grade Judge Vannoy on "Speaking clearly?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 82% 75% 76% B 15% 18% 18% C 0% 4% 4% D 3% 1% 1% Fail 0% 0% 0% No Grade 0% 1% 1% Average 3.8 3.7 3.7 Letter Grade A- A- A- Judicial Performance Survey 2008 Page 20 ## Page 34 Douglas R. Vannoy Attorney Survey 3b. How would you grade Judge Vannoy on "Making sure all participants understand the proceedings?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 69% 71% 71% B 26% 20% 21% C 5% 5% 5% D 0% 1% 1% Fail 0% 1% 1% No Grade 0% 2% 2% Average 3.6 3.6 3.6 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 21 ## Page 35 Douglas R. Vannoy Attorney Survey 3c. How would you grade Judge Vannoy on "Using understandable language?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 77% 75% 76% B 23% 20% 19% C 0% 4% 3% D 0% 1% 1% Fail 0% 0% 0% No Grade 0% 1% 1% Average 3.8 3.7 3.7 Letter Grade A- A- A- Judicial Performance Survey 2008 Page 22 ## Page 36 Douglas R. Vannoy Attorney Survey 3d. How would you grade Judge Vannoy on "Providing written communications that are clear, thorough and well reasoned?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 48% 46% 46% B 19% 21% 21% C 0% 7% 7% D 5% 4% 4% Fail 0% 2% 2% No Grade 29% 20% 21% Average 3.5 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2008 Page 23 ## Page 37 Douglas R. Vannoy Attorney Survey 4a. How would you grade Judge Vannoy on "Giving proceedings a sense of dignity?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 85% 69% 69% B 5% 19% 20% C 8% 6% 6% D 0% 2% 2% Fail 0% 2% 2% No Grade 3% 1% 1% Average 3.8 3.5 3.5 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 24 ## Page 38 Douglas R. Vannoy Attorney Survey 4b. How would you grade Judge Vannoy on "Treating everyone involved politely?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 46% 68% 69% B 33% 16% 17% C 13% 7% 7% D 5% 3% 3% Fail 3% 4% 4% No Grade 0% 1% 1% Average 3.2 3.4 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 25 ## Page 39 Douglas R. Vannoy Attorney Survey 4c. How would you grade Judge Vannoy on "Having empathy with the parties involved?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 33% 55% 55% B 44% 22% 22% C 15% 10% 10% D 0% 4% 4% Fail 5% 4% 4% No Grade 3% 5% 4% Average 3.0 3.3 3.3 Letter Grade B B B Judicial Performance Survey 2008 Page 26 ## Page 40 Douglas R. Vannoy Attorney Survey 4d. How would you grade Judge Vannoy on "Treating participants with respect?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 67% 68% B 23% 17% 18% C 13% 8% 7% D 3% 4% 3% Fail 3% 3% 3% No Grade 0% 1% 1% Average 3.3 3.4 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 27 ## Page 41 Douglas R. Vannoy Attorney Survey 4e. How would you grade Judge Vannoy on "Presenting a neutral presence on the bench?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 74% 65% 64% B 15% 19% 20% C 5% 8% 8% D 3% 4% 4% Fail 3% 4% 4% No Grade 0% 2% 1% Average 3.6 3.4 3.4 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 28 ## Page 42 Douglas R. Vannoy Attorney Survey 4f. How would you grade Judge Vannoy on "Being consistent in [his/her] behavior?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 64% 64% 64% B 26% 20% 21% C 3% 7% 7% D 3% 3% 3% Fail 0% 3% 2% No Grade 5% 4% 4% Average 3.6 3.4 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 29 ## Page 43 Douglas R. Vannoy Attorney Survey 4g. How would you grade Judge Vannoy on "Conducting [his/her] courtroom in a neutral manner?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 72% 65% 64% B 15% 18% 20% C 8% 7% 7% D 0% 3% 4% Fail 3% 3% 3% No Grade 3% 3% 2% Average 3.6 3.4 3.4 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 30 ## Page 44 Douglas R. Vannoy Attorney Survey 4h. How would you grade Judge Vannoy on "Giving all participants an opportunity to be heard?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 56% 70% 70% B 38% 18% 19% C 3% 6% 6% D 0% 2% 2% Fail 3% 2% 2% No Grade 0% 2% 1% Average 3.5 3.5 3.6 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 31 ## Page 45 Douglas R. Vannoy Attorney Survey 4i. How would you grade Judge Vannoy on "Consistently applying laws and rules?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 82% 59% 59% B 10% 21% 21% C 5% 8% 8% D 0% 3% 3% Fail 0% 3% 3% No Grade 3% 6% 6% Average 3.8 3.4 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 32 ## Page 46 Douglas R. Vannoy Attorney Survey 4j. How would you grade Judge Vannoy on "Not engaging in ex parte communications?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 82% 67% 64% B 5% 10% 12% C 0% 2% 3% D 0% 1% 1% Fail 0% 1% 1% No Grade 13% 19% 19% Average 3.9 3.7 3.7 Letter Grade A- A- A- Judicial Performance Survey 2008 Page 33 ## Page 47 Douglas R. Vannoy Attorney Survey 4k. How would you grade Judge Vannoy on "Treating pro se parties fairly?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 62% 47% 51% B 18% 9% 11% C 0% 3% 3% D 0% 1% 1% Fail 0% 1% 1% No Grade 21% 40% 33% Average 3.8 3.7 3.6 Letter Grade A- A- B+ Judicial Performance Survey 2008 Page 34 ## Page 48 Douglas R. Vannoy Attorney Survey 5a. How would you grade Judge Vannoy on "Making tough decisions when necessary?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 77% 55% 53% B 18% 21% 22% C 0% 7% 7% D 0% 3% 3% Fail 0% 1% 2% No Grade 5% 12% 13% Average 3.8 3.4 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 35 ## Page 49 Douglas R. Vannoy Attorney Survey 5b. How would you grade Judge Vannoy on "Using good judgment in application of relevant law and rules?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 74% 53% 54% B 21% 26% 26% C 3% 10% 9% D 0% 4% 4% Fail 0% 3% 3% No Grade 3% 4% 4% Average 3.7 3.3 3.3 Letter Grade A- B B Judicial Performance Survey 2008 Page 36 ## Page 50 Douglas R. Vannoy Attorney Survey 5c. How would you grade Judge Vannoy on "Doing the necessary 'homework' and being prepared for [his/her] cases?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 72% 58% 56% B 26% 24% 24% C 0% 7% 8% D 0% 2% 2% Fail 0% 2% 2% No Grade 3% 6% 9% Average 3.7 3.4 3.4 Letter Grade A- B+ B+ Judicial Performance Survey 2008 Page 37 ## Page 51 Douglas R. Vannoy Attorney Survey 5d. How would you grade Judge Vannoy on "Being willing to handle cases on the docket even when they are complicated and time consuming?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 56% 56% 54% B 28% 18% 18% C 0% 5% 6% D 3% 2% 2% Fail 0% 1% 2% No Grade 13% 17% 19% Average 3.6 3.5 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 38 ## Page 52 Douglas R. Vannoy Attorney Survey 5e. How would you grade Judge Vannoy on "Providing prompt access to the court in emergency matters?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 44% 40% 39% B 13% 13% 14% C 3% 5% 4% D 3% 1% 1% Fail 0% 1% 1% No Grade 38% 40% 40% Average 3.6 3.5 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2008 Page 39 ## Page 53 Douglas R. Vannoy Attorney Survey 6. How biased do you think Judge Vannoy is towards the defense or the prosecution? Judge All District All Trial Vannoy Judges 2008 Judges 2008 5 6% 2% 3% ⇑ 4 0% 3% 4% 3 0% 6% 7% 2 13% 9% 10% 1 0% 13% 14% 0 Neutral 75% 54% 53% -1 0% 6% 4% -2 0% 3% 2% -3 0% 2% 2% -4 6% 2% 1% ⇓ -5 0% 1% 0% Average 0.3 0.4 0.7 noitucesorP drawoT esnefeD drawoT Judicial Performance Survey 2008 Page 40 ## Page 54 Douglas R. Vannoy Attorney Survey 7. How lenient or harsh do you think the sentences handed down by Judge Vannoy are? Judge All District All Trial Vannoy Judges 2008 Judges 2008 5 8% 2% 2% ⇑ 4 0% 3% 3% 3 0% 4% 4% 2 0% 7% 8% 1 8% 8% 10% 0 Appropriate 77% 56% 60% -1 0% 5% 4% -2 0% 5% 3% -3 8% 5% 3% -4 0% 2% 1% ⇓ -5 0% 2% 1% Average 0.2 0.1 0.3 hsraH oT thgiL oT Judicial Performance Survey 2008 Page 41 ## Page 55 Douglas R. Vannoy Attorney Survey 12. Do you recommend that Judge Vannoy be retained in office or not be retained in office? Judge All District All Trial Vannoy Judges 2008 Judges 2008 Strongly Recommend 87% 77% 77% Retain in office Somewhat Recommend 8% 13% 13% Retain in office Somewhat Recommend Not 3% 4% 4% Retain in office Strongly Recommend Not Retain in office 3% 6% 6% Judicial Performance Survey 2008 Page 42 ## Page 56 AAppppeellllaattee JJuuddggee SSuurrvveeyy ((SSaammppllee SSiizzee 2200)) ## Page 57 Douglas R. Vannoy Appellate Survey Overall Performance of Judge Vannoy Judge All District Vannoy Judges A 20% 28% B 15% 14% C 0% 3% D 0% 0% Fail 0% 0% No Grade 65% 55% Average 3.6 3.5 Letter Grade B+ B+ Judicial Performance Survey 2004 Page 1 ## Page 58 NNoonn--AAttttoorrnneeyy SSuurrvveeyy ((SSaammppllee SSiizzee 114411)) ## Page 59 Douglas R. Vannoy NNoonn-AAttttoorrnneeyy SSuurrvveeyy Average Grades: Overall and by Section 3.3 Overall Average 3.6 3.6 3.3 QQ11. OOvveerraallll DDeemmeeaannoorr 33.66 3.6 3.3 Q2. Overall Fairness 3.6 3.6 3.4 Q3. Overall 3.7 Communications 3.7 3.3 Q4. Overall Diligence 3.6 3.6 3.3 Q5. Overall Application of 3.6 Law 3.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 AAverage GGradde Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 1 ## Page 60 Douglas R. Vannoy Non-Attorney Survey Average Grades: Demeanor 3.3 Q1. Overall Demeanor 3.6 3.6 33.33 1a. Giving court proceedings a 3.7 sense of dignity 3.6 3.3 1b. Treating participants politely 3.7 and with respect 3.6 3.3 1c. Conducting [his/her] 3.6 courtroom in a neutral manner 3.6 3.2 1d. Having a sense of compassion and human 3.6 understanding for those who appear before the judge 3.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 2 ## Page 61 Douglas R. Vannoy NNoonn-AAttttoorrnneeyy SSuurrvveeyy Average Grades: Fairness 3.3 Q2. Overall Fairness 3.6 3.6 3.4 2a. Giving participants an 3.7 opportunity to be heard 3.6 3.3 2b. Treating those involved with 3.6 the case without bias 3.5 3.3 2c. Treating fairly people who 3.6 represent themselves 3.5 3.3 2d. Giving each side enough 3.7 time to present his or her case 33.66 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 3 ## Page 62 Douglas R. Vannoy Non-Attorney Survey Average Grades: Communications 3.4 Q3. Overall Communications 3.7 3.7 3.3 3a. Making sure all participants understand the 3.7 proceedings, and what's going on in the courtroom 3.6 3.4 3b. Using language that 3.7 everyone can understand 3.7 3.3 3c. Speaking clearly so everyone in the courtroom can 3.7 hear what's being said 3.7 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 4 ## Page 63 Douglas R. Vannoy Non-Attorney Survey Average Grades: Diligence 3.3 Q4. Overall Diligence 3.6 3.6 3.2 44a. BBegiinniing courtt on ttiime 33.55 3.4 3.5 4b. Maintaining appropriate 33..77 conttroll over proceeddiings 3.7 3.3 4c. Setting reasonable 3.6 sscchheedduulleess ffoorr ccaasseess 3.6 3.4 4d. Being prepared for [his/her] 3.7 cases 3.6 3.2 4e. Managing court proceedings so that there is 3.5 little wasted time 3.5 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 5 ## Page 64 Douglas R. Vannoy Non-Attorney Survey Average Grades: Application and Knowledge of Law 3.3 Q5. Overall App of Law 3.6 3.5 3.2 5a. Giving reasons for rulings 3.6 3.5 3.3 5b. Willing to make decision without regard to possible 3.6 outside pressure 3.5 3.3 5c. Being able to identify and 3.6 analyze relevant facts 33.55 1.0 1.5 2.0 2.5 3.0 3.5 4.0 Average Grade Douglas R. Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 6 ## Page 65 Douglas R. Vannoy Non-Attorney Survey Average: How biased do you think Judge Vannoy is toward the defense or prosecution? Douglas R. Vannoy 0.1 All District Judges 0.1 All Trial Judges 0.1 5 4 3 2 1 0 1 2 3 4 5 (cid:205) Defense Prosecution (cid:206) Judicial Performance Survey 2008 Page 7 ## Page 66 Douglas R. Vannoy Non-Attorney Survey Average: How lenient or how harsh are Judge Vannoy's sentences? Dougglas R. Vannoyy -0.2 All District Judges 0.0 All Trial Judges 0.0 5 4 3 2 1 0 1 2 3 4 5 (cid:205) Lenient Harsh (cid:206) Judicial Performance Survey 2008 Page 8 ## Page 67 Douglas R. Vannoy Non-Attorney Survey Retention Recommendation 100% 90% 87% 85% 81% 80% 78% 72% 70% 67% 60% 5500%% 40% 30% 20% 15% 14% 9% 10% 8% 8% 8% 7% 7%7% 7% 6% 5% 5% 5% 4% 4% 4% 2%2% 2%2% 0% Including Undecided Excluding Undecided Judge Vannoy All District Judges All Trial Judges Judicial Performance Survey 2008 Page 9 ## Page 68 Douglas R. Vannoy Non-Attorney Survey 1a. How would you grade Judge Vannoy on "Giving proceedings a sense of dignity?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 55% 76% 73% B 32% 16% 18% C 6% 3% 4% D 4% 2% 2% Fail 4% 1% 2% No Grade 1% 1% 1% Average 3.3 3.7 3.6 Letter Grade B A- B+ Judicial Performance Survey 2008 Page 1 ## Page 69 Douglas R. Vannoy Non-Attorney Survey 1b. How would you grade Judge Vannoy on "Treating participants politely and with respect?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 79% 76% B 22% 13% 14% C 11% 4% 4% D 4% 1% 2% Fail 4% 2% 3% No Grade 0% 1% 1% Average 3.3 3.7 3.6 Letter Grade B A- B+ Judicial Performance Survey 2008 Page 2 ## Page 70 Douglas R. Vannoy Non-Attorney Survey 1c. How would you grade Judge Vannoy on "Conducting [his/her] courtroom in a neutral manner?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 77% 74% B 24% 13% 14% C 6% 4% 5% D 2% 2% 2% Fail 8% 2% 3% No Grade 1% 1% 1% Average 3.3 3.6 3.6 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 3 ## Page 71 Douglas R. Vannoy Non-Attorney Survey 1d. How would you grade Judge Vannoy on "Having a sense of compassion and human understanding for those who appear before the judge?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 52% 71% 69% B 28% 17% 17% C 9% 4% 5% D 5% 2% 2% Fail 6% 3% 4% No Grade 1% 3% 3% Average 3.2 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 4 ## Page 72 Douglas R. Vannoy Non-Attorney Survey 2a. How would you grade Judge Vannoy on "Giving participants an opportunity to be heard?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 62% 77% 75% B 23% 14% 14% C 8% 4% 4% D 3% 2% 2% Fail 4% 2% 3% No Grade 1% 2% 2% Average 3.4 3.7 3.6 Letter Grade B+ A- B+ Judicial Performance Survey 2008 Page 5 ## Page 73 Douglas R. Vannoy Non-Attorney Survey 2b. How would you grade Judge Vannoy on "Treating those involved in the case without bias?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 57% 75% 73% B 28% 14% 14% C 3% 3% 4% D 5% 2% 2% Fail 6% 3% 4% No Grade 1% 3% 3% Average 3.3 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 6 ## Page 74 Douglas R. Vannoy Non-Attorney Survey 2c. How would you grade Judge Vannoy on "Treating fairly people who represent themselves?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 39% 47% 49% B 17% 8% 9% C 5% 2% 3% D 1% 1% 1% Fail 4% 2% 3% No Grade 35% 39% 35% Average 3.3 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 7 ## Page 75 Douglas R. Vannoy Non-Attorney Survey 2d. How would you grade Judge Vannoy on "Giving each side enough time to present his or her case?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 75% 72% B 23% 14% 14% C 7% 3% 4% D 3% 2% 2% Fail 4% 2% 3% No Grade 4% 5% 5% Average 3.3 3.7 3.6 Letter Grade B A- B+ Judicial Performance Survey 2008 Page 8 ## Page 76 Douglas R. Vannoy Non-Attorney Survey 3a. How would you grade Judge Vannoy on "Making sure participants understand the proceedings, and what's going on in the courtroom?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 78% 76% B 21% 13% 14% C 13% 4% 5% D 4% 2% 2% Fail 2% 1% 2% No Grade 1% 2% 2% Average 3.3 3.7 3.6 Letter Grade B A- B+ Judicial Performance Survey 2008 Page 9 ## Page 77 Douglas R. Vannoy Non-Attorney Survey 3b. How would you grade Judge Vannoy on "Using language that everyone can understand?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 61% 78% 76% B 27% 16% 16% C 9% 4% 4% D 1% 1% 1% Fail 2% 1% 1% No Grade 0% 1% 1% Average 3.4 3.7 3.7 Letter Grade B+ A- A- Judicial Performance Survey 2008 Page 10 ## Page 78 Douglas R. Vannoy Non-Attorney Survey 3c. How would you grade Judge Vannoy on "Speaking clearly so everyone in the courtroom can hear what's being said?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 56% 79% 78% B 27% 14% 14% C 13% 4% 4% D 1% 1% 1% Fail 3% 1% 1% No Grade 0% 1% 1% Average 3.3 3.7 3.7 Letter Grade B A- A- Judicial Performance Survey 2008 Page 11 ## Page 79 Douglas R. Vannoy Non-Attorney Survey 4a. How would you grade Judge Vannoy on "Beginning court on time?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 48% 61% 61% B 24% 24% 24% C 16% 7% 8% D 3% 2% 2% Fail 4% 2% 2% No Grade 6% 4% 4% Average 3.2 3.5 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 12 ## Page 80 Douglas R. Vannoy Non-Attorney Survey 4b. How would you grade Judge Vannoy on "Maintaining appropriate control over proceedings?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 78% 77% B 27% 15% 15% C 6% 4% 4% D 2% 1% 1% Fail 1% 1% 1% No Grade 4% 2% 2% Average 3.5 3.7 3.7 Letter Grade B+ A- A- Judicial Performance Survey 2008 Page 13 ## Page 81 Douglas R. Vannoy Non-Attorney Survey 4c. How would you grade Judge Vannoy on "Setting reasonable schedules for cases?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 49% 64% 62% B 22% 17% 17% C 10% 5% 5% D 3% 1% 1% Fail 3% 2% 2% No Grade 13% 12% 13% Average 3.3 3.6 3.6 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 14 ## Page 82 Douglas R. Vannoy Non-Attorney Survey 4d. How would you grade Judge Vannoy on "Being prepared for [his/her] cases?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 59% 73% 71% B 25% 14% 14% C 7% 3% 4% D 1% 1% 1% Fail 4% 2% 2% No Grade 6% 7% 8% Average 3.4 3.7 3.6 Letter Grade B+ A- B+ Judicial Performance Survey 2008 Page 15 ## Page 83 Douglas R. Vannoy Non-Attorney Survey 4e. How would you grade Judge Vannoy on "Managing court proceedings so that there is little wasted time?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 53% 67% 66% B 27% 21% 20% C 10% 6% 7% D 3% 2% 2% Fail 4% 2% 2% No Grade 3% 3% 3% Average 3.2 3.5 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 16 ## Page 84 Douglas R. Vannoy Non-Attorney Survey 5a. How would you grade Judge Vannoy on "Giving reasons for rulings?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 53% 67% 65% B 27% 16% 16% C 8% 4% 5% D 2% 2% 2% Fail 6% 2% 3% No Grade 5% 9% 9% Average 3.2 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 17 ## Page 85 Douglas R. Vannoy Non-Attorney Survey 5b. How would you grade Judge Vannoy on "Willing to make decision without regard to possible outside pressure?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 50% 61% 59% B 23% 11% 12% C 5% 3% 4% D 3% 2% 2% Fail 5% 3% 3% No Grade 14% 20% 20% Average 3.3 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 18 ## Page 86 Douglas R. Vannoy Non-Attorney Survey 5c. How would you grade Judge Vannoy on "Being able to identify and analyze relevant facts?" Judge All District All Trial Vannoy Judges 2008 Judges 2008 A 55% 68% 66% B 21% 13% 14% C 6% 3% 4% D 3% 2% 3% Fail 6% 3% 4% No Grade 9% 10% 10% Average 3.3 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2008 Page 19 ## Page 87 Douglas R. Vannoy Non-Attorney Survey 6. How biased do you think Judge Vannoy is towards the defense or the prosecution? Judge All District All Trial Vannoy Judges 2008 Judges 2008 5 3% 1% 2% ⇑ 4 3% 1% 1% 3 1% 2% 2% 2 2% 2% 2% 1 4% 4% 5% 0 Neutral 78% 84% 82% -1 3% 2% 3% -2 4% 2% 1% -3 3% 1% 1% -4 0% 1% 1% ⇓ -5 2% 1% 1% Average 0.1 0.1 0.1 noitucesorP drawoT esnefeD drawoT Judicial Performance Survey 2008 Page 20 ## Page 88 Douglas R. Vannoy Non-Attorney Survey 7. How lenient or harsh do you think the sentences handed down by Judge Vannoy are? Judge All District All Trial Vannoy Judges 2008 Judges 2008 5 3% 2% 2% ⇑ 4 2% 1% 2% 3 0% 2% 2% 2 1% 2% 2% 1 2% 3% 3% 0 Appropriate 70% 78% 76% -1 8% 5% 5% -2 7% 4% 4% -3 2% 2% 2% -4 3% 1% 1% ⇓ -5 2% 1% 1% Average -0.2 0.0 0.0 hsraH oT thgiL oT Judicial Performance Survey 2008 Page 21 ## Page 89 Douglas R. Vannoy Non-Attorney Survey 12. Do you recommend that Judge Vannoy be retained in office or not be retained in office? Judge All District All Trial Vannoy Judges 2006 Judges 2008 Strongly Recommend 72% 87% 85% Retain in office Somewhat Recommend 15% 7% 8% Retain in office Somewhat Recommend Not 5% 2% 2% Retain in office Strongly Recommend Not Retain in office 9% 4% 5% Judicial Performance Survey 2008 Page 22 ## Page 90 MMeetthhooddoollooggyy ## Page 91 MMeetthhooddoollooggyy Sample: The databases of names and addresses of the people who had likely been in each judge’s courtroom were primarily provided by the Colorado Judicial Department, Colorado District Attorneys’ Council and the Denver County Courts. These three sources provided name and address data in 2005, 2006, 2007 and 2008. Starting in the second quarter of 2007, the data was provided quarterly. Where there were low sample counts, this data was supplemented by contacting district court administrators for additional sample of particular types of potential respondents. The data was then combined, duplicates removed and addresses corrected— quarterly starting in 2007. Depending on the available number of names and the count of already received surveys for a particular judge, either all or a random sample of names were drawn. Included in the data cleaning was the identification of potential respondents in the sample who had appeared in more than two judges’ courtrooms. Due to concerns about respondent fatigue, no more than two questionnaires were intended to be sent to any one respondent—though there were a few instances where one respondent did receive more than two questionnaires. Where a person had been in more than two judges’ courtrooms, the selection criteria for which judges he or she would be sent questionnaires was generally: first, for the judge in whose courtroom the potential respondent had been in most often, and two, the judge with the smallest sample of the judges in whose courtroom the potential respondent had appeared. Survey: Each person whose name was drawn was mailed an initial postcard informing the recipient that he or she would be receiving a questionnaire. Two to three weeks after the post card was mailed, the potential respondent would be sent a personalized introductory letter and a questionnaire with a postage-paid return envelope. Those who did not respond to the first questionnaire were then sent a sent follow-up postcard. If the person did not respond after the follow-up postcard, a second questionnaire and letter were sent and in some instances a second follow-up postcard was sent after the second letter and questionnaire. In order to increase the number of attorney responses, particularly for judges with few attorney responses, telephone interviews were conducted with attorneys who had not responded to the mailed questionnaires. Over 900 interviews were completed by telephone. 1 ## Page 92 Questionnaire: The questionnaire used in the 2008 Judicial Performance Survey asked respondents to use a grade of A, B, C, D, or F (Fail) to assess the judge’s performance in five different areas. For attorney respondents these areas were Case Management, Application and Knowledge of Law, Communications, Demeanor and Diligence, and for non-attorney respondents the five were Demeanor, Fairness, Communications, Diligence and Application of Law. These scores were then converted to a numerical value where A = 4, B = 3, C = 2, D = 1 and Fail = 0. Copies of the questionnaires are included at the end of this report. Response: The estimated response rate is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses & refusals, undeliverables and other responses. The table presents the estimated overall response rate as well as the response rate by the different types of respondents. The true response rates are likely considerably higher than shown because of the relatively high percentage of people who were mailed questionnaires about judges who they had not observed in court. This is due, in part, to many cases being disposed of without the parties having appeared in court, as well as in the case of law enforcement, the data includes all those who were subpoenaed for a case, not just those who appeared. A similar table showing the response counts and estimated cooperation rate for your survey is provided at the end of this methodology section. 2 ## Page 93 Total No Undeliverable/ Other Non- Cooperation Sent Response Not Applicable responses Completes Rate Attorneys Criminal District Attorneys 841 306 93 2 440 58.8% Defense Attorneys 1,082 341 102 2 637 65.0% Other Attorneys Crmnl 809 418 27 3 361 46.2% Civil Attorneys for Litigants 1,395 312 171 13 899 73.4% Other Attorneys Civil 598 280 53 2 263 48.3% Attorneys, Unknown Role 852 289 77 2 484 62.5% Total Attorneys 5,577 1,946 523 24 3,084 61.0% Non-attorneys Criminal Law Enforcement 8,170 5,431 1,417 34 1,288 19.1% Defendant 13,787 9,091 3,737 25 934 9.3% Victim 295 222 63 2 8 3.4% Witness 1,886 1,342 453 5 86 6.0% Other 5,396 3,532 1,301 43 520 12.7% Civil Litigant 6,552 4,390 1,109 21 1,032 19.0% Witness 46 31 5 0 10 24.4% Other 59 29 15 0 15 34.1% Non-attnys, Unknown Role 5,065 2,598 1,843 12 612 19.0% Total Non-attorneys 41,256 26,666 9,943 142 4,505 14.4% Others Appellate Judges 26 6 0 0 20 76.9% Jurors 10,214 4,940 460 22 4,792 49.1% Total Other 10,240 4,946 460 22 4,812 49.2% Total 57,073 33,558 10,926 188 12,401 26.9% 3 ## Page 94 Results: The results of the Survey are in three main sections: Attorney respondents, Appellate Judge respondents and Non-attorney respondents. Within the Attorney and Non-attorney section are subsections of graphs displaying average grades for each section of the questionnaire and each question and tables showing the percentage distribution of grades. The Appellate Judge section is new this year, and shows the percentage distribution of the grades given by the appellate judges on overall performance. Graphs: The graphs visually display the overall average numerical grades received for all grade questions, each section and each question compared to averages for all district judges, and all trial judges for which 2008 surveys were conducted. Questions relating to bias toward the defense or prosecution, sentencing and retention recommendation are also graphed. Percentage Distribution of Grades: This section shows the percentage of each grade received on each question plus the bias, sentencing and retention questions. An average grade point for each graded question is computed and shown in the results section. A letter grade is also assigned to each grade point according to the following scale. A = 4.00 B = 3.00 to 3.33 C = 2.00 to 2.33 D = 1.00 to 1.33 A— = 3.67 to 3.99 B—= 2.67 to 2.99 C—= 1.67 to 1.99 D— = 0.67 to 0.99 B+ = 3.34 to 3.66 C+ = 2.34 to 2.66 D+ = 1.34 to 1.66 Fail = 0.00 to 0.66 This section also includes two comparative columns of results: one comparative column shows the results for that question for district judges surveyed in 2008, along with a second comparative column showing the results for all trial judges in the 2008 survey. Projectability: Most surveys seen by the public are surveys that are intended to be projectable, that is the results from the sample of people surveyed can be used to estimate a percentage or value of the population sampled with a known probability of error. For example, a pre-election poll of 500 likely Colorado voters is used to estimate the percentage of voters who will vote for Candidate A on election day, plus or minus some number of percentage points. The plus or minus amount is usually what is known as the 95%- confidence interval (the known probability of error), or what the media often refers to as the margin-of-error. The Colorado Judicial Performance Evaluation Survey is not projectable with a known probability of error because the results are calculated from a self- selecting sample that is self-selecting based on the content and subject matter of the survey. In other words, the potential respondent knows the purpose and content of the survey, and based on that, decides whether to respond to the survey. 4 ## Page 95 While projectability within a known probability of error is a highly desirable attribute of a survey, it is often not feasible to achieve. Commercial market research often uses nonprojectable (and small) samples—the most well known of which are for focus groups. Moreover, the federal courts have long accepted, and do not expect, projectable samples for market confusion surveys used in trademark litigation. In other words, one can still use the results of the Judicial Performance Evaluation Survey to estimate how everyone who has observed a judge in the courtroom would grade him or her, just not with a known probability of error. The Judicial Performance Evaluation Survey is a valuable means, perhaps the only practical means, for the Judicial Performance Commissions to have a summary of structured interviews with a number of people who have courtroom familiarity with the judge being evaluated, and who most often— albeit not always—are responding out of a desire to improve the performance of our state’s judicial system. 5 ## Page 96 Douglas R. Vannoy Responses by Type Total No Undeliverable/ Other Non- Coop Role Type Sent Response Not Applicable Responses Completes Rate Attorneys Criminal District Attorneys 12 4 2 0 6 60.0% Defense Attorneys 4 1 0 0 3 75.0% Other Attorneys Criminal 12 5 0 0 7 58.3% Civil Attorneys for Litigants 16 1 1 0 14 93.3% Other Attorneys Civil 3 1 0 0 2 66.7% Attorneys, Unknown Role Type 13 3 2 0 8 72.7% Total Attorneys 60 15 5 0 40 27.3% Non-attorneys Criminal Law Enforcement 116 59 21 1 35 36.8% Defendant 156 115 29 0 12 9.4% Witness 32 25 4 0 3 10.7% Other 46 27 10 1 8 22.2% Civil Litigant 105 65 21 0 19 22.6% Witness 3 2 0 0 1 33.3% Other 2 0 2 0 0 0.0% Non-attorneys, Unknown Role Type 27 17 9 0 1 5.6% Total Non-attorneys 487 310 96 2 79 79.3% Others Appellate Judges 26 6 0 0 20 76.9% Jurors 123 57 4 0 62 52.1% Total Others 149 63 4 0 82 43.4% Grand Total: 696 388 105 2 201 34.0% Judicial Performance Survey 2008 Page 1 ## Page 97 QQuueessttiioonnnnaaiirreess ## Page 98 Commission on Judicial Performance 10. And what would you say are Judge [Last Name]’s weaknesses? _ Attorney Questionnaire _ _ Evaluation of _ _ JUDGE [NAME] 11. Is there anything else that you would like to say about Judge [Last Name]? _ Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, _ please grade the judge on the following. (If you feel that you don not have _ experience with the judge in a specific area, or just don’t know, please circle the _ number corresponding to “Don’t Know/Not Applicable”—DK/NS). _ DK 1. Case Management: A B C D F N/A 12. Keeping in mind your responses to each of the previous questions, how a. Promptly making rulings during trial. 4 3 2 1 0 9 strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? b. Beginning court on time. 4 3 2 1 0 9 c. Allotting appropriate amount of time for cases. 4 3 2 1 0 9 Strongly recommend he be retained in office. 5 Somewhat recommend he be retained in office . 4 d. Keeping cases moving according to schedule. 4 3 2 1 0 9 Undecided or don’t know enough to make recommendation . 3 e. [Civil only]1 Assisting parties to reach agreement. 4 3 2 1 0 9 Somewhat recommend he not be retained in office . 2 f. Maintaining appropriate control over proceedings. 4 3 2 1 0 9 Strongly recommend he not be retained in office . 1 g. Promptly ruling on pre-trial motions. 4 3 2 1 0 9 And why do you think that way about retaining or not retaining Judge [Last h. Promptly issuing a decision on the case after trial. 4 3 2 1 0 9 Name]? i. Setting reasonable schedules for cases. 4 3 2 1 0 9 _ DK _ 2. Application and Knowledge of Law: A B C D F N/A _ a. Basing decisions on evidence and arguments. 4 3 2 1 0 9 _ b. Giving reasons for rulings. 4 3 2 1 0 9 _ _ c. [Civil only]1 Issuing written findings of fact and law. 4 3 2 1 0 9 d. Willing to reconsider error in fact or law. 4 3 2 1 0 9 e. Having knowledge of relevant substantive law. 4 3 2 1 0 9 Thank you for your time in completing this questionnaire. f. Having knowledge of rules of procedure Please place it in the self-addressed, postage paid enveloped and evidence. 4 3 2 1 0 9 provided, and place it in the mail. Your participation in this g. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 survey is very much appreciated. h. [Criminal only]2 Issuing consistent sentences when the circumstances are similar. 4 3 2 1 0 9 i. Willing to make decisions without regard to possible criticism. 4 3 2 1 0 9 j. Making decisions without fear of being appealed . 4 3 2 1 0 9 DK 1 Please answer questions 1e & 2c only if you have observed the judge in a civil case. 2 Please answer question 2h only if you have observed the judge in a criminal case. ## Page 99 3. Communications: A B C D F N/A 6. [Criminal cases only] 1 On the scale below, please indicate by circling the a. Speaking clearly. 4 3 2 1 0 9 appropriate number how biased you think Judge [Last Name] is toward b. Makings sure all participants understand the defense or the prosecution. If you feel Judge [Last Name] is the proceedings. 4 3 2 1 0 9 completely unbiased, circle “0.” c. Using understandable language. 4 3 2 1 0 9 Bias toward Completely Bias toward Defense Neutral Prosecution d. Providing written communications that are clear, thorough and well reasoned. 4 3 2 1 0 9 5 4 3 2 1 0 1 2 3 4 5 DK 7. [Criminal cases only]1 On the scale below, please indicate by circling the 4. Demeanor: A B C D F N/A appropriate number how lenient or how harsh you think the sentences a. Giving proceedings a sense of dignity. 4 3 2 1 0 9 generally handed down by Judge [Last Name] are. If you feel Judge [Last b. Treating everyone involved politely. 4 3 2 1 0 9 Name] generally hands down appropriate sentences, circle “0.” c. Having empathy with the parties involved. 4 3 2 1 0 9 Sentences Appropriate Sentences d. Treating participants with respect. 4 3 2 1 0 9 Too Light Sentences Too Harsh e. Presenting a neutral presence on the bench. 4 3 2 1 0 9 5 4 3 2 1 0 1 2 3 4 5 f. Being consistent in his/her behavior 4 3 2 1 0 9 g. Conducting his/her courtroom in a neutral manner. 4 3 2 1 0 9 Though your name will never be associated with your answers, because the judge will h. Giving all participants an opportunity to be heard. 4 3 2 1 0 9 see a typed transcript of the comments that you and others write, it is important that i. Consistently applying laws and rules. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. j. Not engaging in ex parte communications 4 3 2 1 0 9 k. Treating pro se parties fairly. 4 3 2 1 0 9 8. If an associate were assigned to Judge [Last Name] in a case and asked you for advice, what would you say? DK ________________________________________________________ 5. Diligence: A B C D F N/A ________________________________________________________ a. Making tough decisions when necessary. 4 3 2 1 0 9 ________________________________________________________ b. Using good judgment in application of relevant ________________________________________________________ law and rules. 4 3 2 1 0 9 ________________________________________________________ c. Doing the necessary “homework” and being 9. What would you say are Judge [Last Name]’s strengths? prepared for his/her cases. 4 3 2 1 0 9 ___________________________________________________________ d. Being willing to handle cases on the docket even ___________________________________________________________ when they are complicated and time consuming. 4 3 2 1 0 9 ___________________________________________________________ e. Providing prompt access to the court ___________________________________________________________ in emergency matters. 4 3 2 1 0 9 ___________________________________________________________ [Continued on Back Page] {Question 3d is asked only regarding district judges.} 1 Please answer questions 6 & 7 only if you have observed the judge in a criminal case. ## Page 100 12. Keeping in mind your responses to each of the previous questions, how Commission on Judicial Performance strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? Strongly recommend he/she be retained in office ................................ 5 Evaluation of Somewhat recommend he/she be retained in office ............................ 4 JUDGE[NAME] Undecided or don’t know enough to make recommendation ............. 3 Somewhat recommend he/she not be retained in office ..................... 2 Strongly recommend he/she not be retained in office ......................... 1 Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please circle the And why do you think that way about retaining or not retaining Judge number corresponding to “Don’t Know/Not Applicable”—DK/NA). [Last Name]? _____________________________________________________________ DK _____________________________________________________________ 1. Demeanor: A B C D F N/A _____________________________________________________________ _____________________________________________________________ a. Giving court proceedings a sense of dignity. 4 3 2 1 0 9 _____________________________________________________________ b. Treating participants in the case politely _____________________________________________________________ and with respect. 4 3 2 1 0 9 c. Conducting his/her courtroom in a neutral manner. 4 3 2 1 0 9 d. Having a sense of compassion and human Thank you for you time in completing this questionnaire. Please understanding for those who appear place it in the self-addressed, postage paid enveloped provided, before him/her. 4 3 2 1 0 9 and place it in the mail. Your participation in this survey is very much appreciated. DK 2. Fairness: A B C D F N/A a. Giving participants an opportunity to be heard. 4 3 2 1 0 9 b. Treating those involved in the case without bias. 4 3 2 1 0 9 c. Treating fairly people who represent themselves. 4 3 2 1 0 9 d. Giving each side enough time to present his or her case. 4 3 2 1 0 9 DK 3. Communications: A B C D F N/A a. Makings sure participants understand the proceedings, and what’s going on in the courtroom. 4 3 2 1 0 9 b. Using language that everyone can understand. 4 3 2 1 0 9 c. Speaking clearly so everyone in the courtroom can hear what’s being said. 4 3 2 1 0 9 ## Page 101 DK Though your name will never be associated with your answers, because the judge will 4. Diligence: A B C D F N/A see a typed transcript of the comments that you and others write, it is important that a. Beginning court on time. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. b. Maintaining appropriate control over proceedings. 4 3 2 1 0 9 8. If a friend of yours was scheduled to appear before Judge [Last Name] c. Setting reasonable schedules for cases. 4 3 2 1 0 9 as a party in either a civil or criminal case and asked you for advice, what d. Being prepared for his/her cases. 4 3 2 1 0 9 would you tell your friend about Judge [Last Name] ? e. Managing court proceedings so that there is _ little wasted time. 4 3 2 1 0 9 _ _ _ DK _ 5. Application of Law: A B C D F N/A _ a. Giving reasons for rulings. 4 3 2 1 0 9 b. Willing to make decision without regard to 9. What would you say are Judge [Last Name]’s strengths? possible outside pressure. 4 3 2 1 0 9 _ c. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 _ _ _ _ 6. [If you were in [Last Name]’s courtroom during a criminal case or _ cases please answer this question, otherwise skip to the next question.] On the scale below, please indicate by circling the appropriate number how biased you think Judge [Last Name] is toward the defense or 10. And what would you say are Judge [Last Name]’s weaknesses? the prosecution. If you feel Judge [Last Name] is completely unbiased, _ circle “0.” _ _ Bias toward Completely Bias toward _ Defense Neutral Prosecution _ 5 4 3 2 1 0 1 2 3 4 5 _ 7. [If you were in [Last Name]’s courtroom during a criminal case or 11. Is there anything else that you would like to say about Judge cases please answer this question, otherwise skip to the next [Last Name] ? question.] On the scale below, please indicate by circling the appropriate _ number how lenient or how harsh you think the sentences generally handed _ down by [Last Name] are. If you feel Judge [Last Name] generally hands _ down appropriate sentences, circle “0.” _ Sentences Appropriate Sentences _ Too Light Sentences Too Harsh _ 5 4 3 2 1 0 1 2 3 4 5 Continued on Back Page
- 2002 cycle
- 2002 Retention Survey Report(PDF on OJPE)
Read full retention survey textexpand
## Page 1 March 6, 2002 The Honorable Douglas R. Vannoy Morgan County Justice Center P.O. Box 130, 400 Warner Fort Morgan, CO 80701 Dear Judge Vannoy: Every two years the Colorado Judicial Performance Commission conducts a survey of people who have been in the courtroom of judges who face a retention vote in the next general election. The 2002 survey was conducted by Talmey-Drake Research & Strategy, Inc., who attempted to contact over 55,000 people who had been in these courtrooms in one capacity or another. Over 18,000 people responded—3,686 to the attorney survey and 14,925 to the non-attorney survey. This report contains the results of those who were in your courtroom and who responded to the survey. In addition to this introduction, the report is divided into four main sections: • Results: This section contains the average and percentage distribution of responses to each substantive numerical question in the survey. It is divided into two subsections, one for the results of the attorney survey and one for the results of the non-attorney survey. • Comments: Respondents were also asked to comment about each judge on each section of the questionnaire: courtesy, impartiality, communications skills, judicial temperament, diligence, application of the law, retention and general comments. These comments have been transcribed, and in some instances redacted to eliminate respondent identifying information. Again this section has been divided into two subsections, one for attorney comments and one for non-attorney comments. • Methodology: The fourth section of the report discusses the methodology of the survey. • Questionnaires: And the final section provides copies of the questionnaires that were used. 100 Arap ahoe, Suite One, Boulder, CO 80302 Phone 303.443.5300 Fax 303.447.9386 ## Page 2 March 6, 2002 The Honorable Douglas R. Vannoy Page 2 If you have any questions about the methodology and how the survey was conducted, please feel free to contact me at 303-443-5300, and for any other questions you might have about the survey please call the Director of the Colorado Judicial Performance Program, Michelle Stermer, at 303-837-3665. Best regards, Paul A. Talmey President enc: ## Page 3 Judge Douglas R. Vannoy Attorney Survey 1a. How would you grade Judge Vannoy on being courteous toward parties or witnesses? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 64% 65% 65% B 14% 20% 21% C 14% 6% 7% D 3% 3% Fail 2% 2% No Grade 7% 4% 3% Average Grade 3.5 3.5 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 1 ## Page 4 Judge Douglas R. Vannoy Attorney Survey 1b. How would you grade Judge Vannoy on being courteous toward attorneys? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 43% 60% 61% B 36% 22% 22% C 14% 8% 8% D 4% 4% Fail 3% 3% No Grade 7% 3% 3% Average Grade 3.3 3.4 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 2 ## Page 5 Judge Douglas R. Vannoy Attorney Survey 1c. How would you grade Judge Vannoy on being courteous toward pro se parties? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 50% 43% 48% B 36% 13% 14% C 7% 4% 6% D 1% 2% Fail 1% 2% No Grade 7% 37% 29% Average Grade 3.5 3.5 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 3 ## Page 6 Judge Douglas R. Vannoy Attorney Survey 2a. How would you grade Judge Vannoy on treating parties equally regardless of race? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 86% 61% 63% B 7% 11% 12% C 7% 3% 3% D 1% 1% Fail 1% 1% No Grade 24% 19% Average Grade 3.8 3.7 3.7 Letter Grade A- A- A- Judicial Performance Survey 2002 Judicial District 13 Page 4 ## Page 7 Judge Douglas R. Vannoy Attorney Survey 2b. How would you grade Judge Vannoy on treating parties equally regardless of gender? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 86% 65% 66% B 7% 12% 14% C 7% 5% 5% D 2% 2% Fail 2% 2% No Grade 14% 12% Average Grade 3.8 3.6 3.6 Letter Grade A- B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 5 ## Page 8 Judge Douglas R. Vannoy Attorney Survey 2c. How would you grade Judge Vannoy on treating parties equally regardless of age? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 86% 64% 66% B 7% 12% 13% C 7% 3% 4% D 1% 1% Fail 1% 1% No Grade 18% 15% Average Grade 3.8 3.7 3.7 Letter Grade A- A- A- Judicial Performance Survey 2002 Judicial District 13 Page 6 ## Page 9 Judge Douglas R. Vannoy Attorney Survey 2d. How would you grade Judge Vannoy on treating parties equally regardless of social/economic status? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 64% 65% B 14% 12% 13% C 14% 5% 5% D 2% 2% Fail 2% 2% No Grade 15% 13% Average Grade 3.6 3.6 3.6 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 7 ## Page 10 Judge Douglas R. Vannoy Attorney Survey 2e. How would you grade Judge Vannoy on being fair and impartial toward both sides? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 79% 61% 60% B 7% 17% 17% C 8% 8% D 14% 4% 5% Fail 4% 4% No Grade 6% 5% Average Grade 3.5 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 8 ## Page 11 Judge Douglas R. Vannoy Attorney Survey 2f. How would you grade Judge Vannoy on treating pro se parties fairly? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 47% 51% B 7% 10% 11% C 14% 3% 4% D 1% 1% Fail 1% 1% No Grade 7% 38% 31% Average Grade 3.6 3.6 3.6 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 9 ## Page 12 Judge Douglas R. Vannoy Attorney Survey 2g. How would you grade Judge Vannoy on not engaging in ex parte communications? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 79% 61% 59% B 10% 12% C 7% 4% 4% D 7% 1% 1% Fail 2% 2% No Grade 7% 23% 21% Average Grade 3.6 3.7 3.6 Letter Grade B+ A- B+ Judicial Performance Survey 2002 Judicial District 13 Page 10 ## Page 13 Judge Douglas R. Vannoy Attorney Survey 3a. How would you grade Judge Vannoy on providing written communications that are clear, thorough, and well reasoned? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 64% 42% 37% B 23% 23% C 9% 9% D 21% 2% 2% Fail 3% 2% No Grade 14% 21% 27% Average Grade 3.3 3.3 3.2 Letter Grade B B B Judicial Performance Survey 2002 Judicial District 13 Page 11 ## Page 14 Judge Douglas R. Vannoy Attorney Survey 3b. How would you grade Judge Vannoy on communicating verbally in a clear, thorough, and well reasoned manner? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 55% 54% B 14% 27% 28% C 9% 9% D 14% 3% 4% Fail 2% 2% No Grade 3% 3% Average Grade 3.4 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 12 ## Page 15 Judge Douglas R. Vannoy Attorney Survey 3c. How would you grade Judge Vannoy on explaining court procedures clearly and thoroughly? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 57% 54% 54% B 21% 25% 26% C 7% 9% 9% D 14% 3% 3% Fail 2% 2% No Grade 8% 7% Average Grade 3.2 3.4 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 13 ## Page 16 Judge Douglas R. Vannoy Attorney Survey 4a. How would you grade Judge Vannoy on maintaining a professional demeanor in the courtroom? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 64% 64% B 14% 20% 21% C 14% 6% 7% D 3% 4% Fail 3% 3% No Grade 3% 3% Average Grade 3.6 3.4 3.4 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 14 ## Page 17 Judge Douglas R. Vannoy Attorney Survey 4b. How would you grade Judge Vannoy on listening patiently to all testimony and arguments before issuing a ruling? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 64% 57% 57% B 21% 22% 22% C 8% 8% D 14% 4% 5% Fail 4% 4% No Grade 5% 4% Average Grade 3.4 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 15 ## Page 18 Judge Douglas R. Vannoy Attorney Survey 5a. How would you grade Judge Vannoy on managing cases and docket efficiently and with minimal delay? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 45% 46% B 7% 27% 27% C 21% 11% 11% D 4% 4% Fail 4% 4% No Grade 9% 8% Average Grade 3.5 3.2 3.2 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 16 ## Page 19 Judge Douglas R. Vannoy Attorney Survey 5b. How would you grade Judge Vannoy on being punctual in commencing proceedings? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 55% 54% B 7% 28% 28% C 21% 8% 9% D 2% 2% Fail 2% 2% No Grade 4% 4% Average Grade 3.5 3.4 3.3 Letter Grade B+ B+ B Judicial Performance Survey 2002 Judicial District 13 Page 17 ## Page 20 Judge Douglas R. Vannoy Attorney Survey 5c. How would you grade Judge Vannoy on using court time efficiently? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 57% 54% 54% B 21% 26% 25% C 21% 10% 10% D 3% 3% Fail 3% 3% No Grade 5% 5% Average Grade 3.4 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 18 ## Page 21 Judge Douglas R. Vannoy Attorney Survey 5d. How would you grade Judge Vannoy on being prepared for all court matters? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 59% 58% B 7% 22% 23% C 14% 7% 7% D 7% 2% 3% Fail 2% 2% No Grade 7% 7% Average Grade 3.4 3.4 3.4 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 19 ## Page 22 Judge Douglas R. Vannoy Attorney Survey 5e. How would you grade Judge Vannoy on being willing to handle cases on the docket even when they are complicated and time Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 71% 49% 49% B 18% 18% C 7% 7% 7% D 14% 2% 3% Fail 3% 3% No Grade 7% 21% 21% Average Grade 3.4 3.4 3.4 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 20 ## Page 23 Judge Douglas R. Vannoy Attorney Survey 5f. How would you grade Judge Vannoy on providing quick access to the court in emergency matters? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 43% 32% 33% B 13% 13% C 14% 5% 5% D 14% 2% 2% Fail 2% 2% No Grade 29% 46% 45% Average Grade 3.0 3.3 3.3 Letter Grade B B B Judicial Performance Survey 2002 Judicial District 13 Page 21 ## Page 24 Judge Douglas R. Vannoy Attorney Survey 6a. How would you grade Judge Vannoy on having knowledge of the rules of evidence and procedure? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 79% 57% 53% B 24% 25% C 21% 8% 9% D 2% 3% Fail 2% 2% No Grade 7% 7% Average Grade 3.6 3.4 3.3 Letter Grade B+ B+ B Judicial Performance Survey 2002 Judicial District 13 Page 22 ## Page 25 Judge Douglas R. Vannoy Attorney Survey 6b. How would you grade Judge Vannoy on ruling on motions in a timely matter? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 50% 49% 49% B 36% 25% 25% C 14% 8% 8% D 3% 3% Fail 3% 3% No Grade 11% 13% Average Grade 3.4 3.3 3.3 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 23 ## Page 26 Judge Douglas R. Vannoy Attorney Survey 6c. How would you grade Judge Vannoy on making the correct decision based upon the law and the facts? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 64% 45% 44% B 21% 29% 29% C 11% 12% D 14% 5% 5% Fail 4% 4% No Grade 6% 6% Average Grade 3.4 3.1 3.1 Letter Grade B+ B B Judicial Performance Survey 2002 Judicial District 13 Page 24 ## Page 27 Judge Douglas R. Vannoy Attorney Survey 6d. How would you grade Judge Vannoy on making decisions without regard to possible criticism? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 79% 51% 50% B 7% 20% 20% C 7% 8% 8% D 7% 3% 3% Fail 3% 3% No Grade 16% 15% Average Grade 3.6 3.4 3.3 Letter Grade B+ B+ B Judicial Performance Survey 2002 Judicial District 13 Page 25 ## Page 28 Judge Douglas R. Vannoy Attorney Survey 7. Do you recommend that Judge Vannoy be retained in office or not be retained in office? Judge All District All Trial Vannoy Judges 2002 Judges 2002 Retain in office 86% 85% 84% Do not retain in office 14% 10% 11% No opinion 5% 5% Judicial Performance Survey 2002 Judicial District 13 Page 26 ## Page 29 Judge Douglas R. Vannoy Non-Attorney Survey 1a. How would you grade Judge Vannoy on being courteous toward everyone in the courtroom? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 44% 68% 67% B 30% 19% 19% C 14% 5% 6% D 4% 2% 2% Fail 4% 2% 2% No Grade 4% 4% 4% Average Grade 3.1 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 1 ## Page 30 Judge Douglas R. Vannoy Non-Attorney Survey 1b. How would you grade Judge Vannoy on being courteous toward persons representing themselves? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 33% 44% 47% B 23% 14% 15% C 10% 4% 5% D 2% 1% 2% Fail 3% 2% 2% No Grade 28% 35% 30% Average Grade 3.1 3.5 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 2 ## Page 31 Judge Douglas R. Vannoy Non-Attorney Survey 2a. How would you grade Judge Vannoy on treating parties equally regardless of race? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 58% 68% 65% B 20% 14% 14% C 7% 3% 4% D 2% 1% 1% Fail 1% 1% 2% No Grade 12% 13% 14% Average Grade 3.5 3.7 3.6 Letter Grade B+ A- B+ Judicial Performance Survey 2002 Judicial District 13 Page 3 ## Page 32 Judge Douglas R. Vannoy Non-Attorney Survey 2b. How would you grade Judge Vannoy on treating parties equally regardless of gender? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 56% 70% 67% B 28% 15% 16% C 6% 4% 5% D 2% 1% 2% Fail 2% 2% 2% No Grade 6% 8% 9% Average Grade 3.4 3.6 3.6 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 4 ## Page 33 Judge Douglas R. Vannoy Non-Attorney Survey 2c. How would you grade Judge Vannoy on treating parties equally regardless of age? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 57% 70% 67% B 28% 15% 16% C 6% 4% 5% D 2% 1% 1% Fail 1% 1% 2% No Grade 7% 9% 10% Average Grade 3.5 3.7 3.6 Letter Grade B+ A- B+ Judicial Performance Survey 2002 Judicial District 13 Page 5 ## Page 34 Judge Douglas R. Vannoy Non-Attorney Survey 2d. How would you grade Judge Vannoy on treating parties equally regardless of social/economic status? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 57% 69% 66% B 25% 15% 15% C 7% 4% 5% D 2% 2% 2% Fail 4% 2% 3% No Grade 6% 9% 9% Average Grade 3.4 3.6 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 6 ## Page 35 Judge Douglas R. Vannoy Non-Attorney Survey 2e. How would you grade Judge Vannoy on being fair and impartial toward both sides? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 52% 68% 65% B 25% 15% 16% C 10% 5% 5% D 2% 2% 2% Fail 5% 4% 4% No Grade 5% 6% 7% Average Grade 3.2 3.5 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 7 ## Page 36 Judge Douglas R. Vannoy Non-Attorney Survey 2f. How would you grade Judge Vannoy on treating parties without attorneys fairly? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 40% 40% 43% B 17% 11% 12% C 6% 3% 4% D 4% 1% 2% Fail 2% 2% 3% No Grade 31% 44% 37% Average Grade 3.3 3.5 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 8 ## Page 37 Judge Douglas R. Vannoy Non-Attorney Survey 2g. How would you grade Judge Vannoy on giving each side enough time to present his or her case? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 51% 66% 63% B 26% 16% 16% C 9% 5% 5% D 2% 2% 2% Fail 5% 2% 3% No Grade 7% 9% 11% Average Grade 3.3 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 9 ## Page 38 Judge Douglas R. Vannoy Non-Attorney Survey 3a. How would you grade Judge Vannoy on speaking in a way that is clearly understood? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 44% 72% 70% B 30% 18% 19% C 14% 5% 6% D 7% 1% 2% Fail 2% 1% 1% No Grade 3% 2% 2% Average Grade 3.1 3.6 3.6 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 10 ## Page 39 Judge Douglas R. Vannoy Non-Attorney Survey 3b. How would you grade Judge Vannoy on explaining court procedures clearly and thoroughly? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 49% 71% 69% B 30% 18% 18% C 12% 5% 6% D 5% 1% 2% Fail 1% 1% 2% No Grade 3% 4% 4% Average Grade 3.2 3.6 3.6 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 11 ## Page 40 Judge Douglas R. Vannoy Non-Attorney Survey 4a. How would you grade Judge Vannoy on maintaining a professional demeanor in the courtroom? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 55% 74% 72% B 24% 15% 16% C 12% 5% 5% D 1% 2% 2% Fail 6% 1% 2% No Grade 2% 3% 3% Average Grade 3.3 3.6 3.6 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 12 ## Page 41 Judge Douglas R. Vannoy Non-Attorney Survey 4b. How would you grade Judge Vannoy on listening patiently to all testimony and arguments before issuing a ruling? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 49% 68% 66% B 25% 16% 17% C 12% 5% 5% D 4% 2% 2% Fail 4% 3% 3% No Grade 7% 6% 6% Average Grade 3.2 3.5 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 13 ## Page 42 Judge Douglas R. Vannoy Non-Attorney Survey 5a. How would you grade Judge Vannoy on managing cases efficiently and with minimal delay? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 41% 57% 56% B 25% 21% 22% C 17% 8% 8% D 3% 3% 3% Fail 3% 2% 2% No Grade 11% 9% 9% Average Grade 3.1 3.4 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 14 ## Page 43 Judge Douglas R. Vannoy Non-Attorney Survey 5b. How would you grade Judge Vannoy on starting court on time? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 43% 59% 57% B 25% 22% 23% C 18% 8% 9% D 4% 3% 3% Fail 2% 2% 2% No Grade 9% 6% 6% Average Grade 3.1 3.4 3.4 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 15 ## Page 44 Judge Douglas R. Vannoy Non-Attorney Survey 5c. How would you grade Judge Vannoy on being prepared for cases? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 49% 66% 64% B 28% 17% 18% C 9% 5% 6% D 2% 1% 2% Fail 3% 2% 2% No Grade 9% 9% 9% Average Grade 3.3 3.6 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 16 ## Page 45 Judge Douglas R. Vannoy Non-Attorney Survey 6a. How would you grade Judge Vannoy on considering all information presented when making a decision? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 52% 63% 62% B 25% 15% 16% C 7% 5% 5% D 4% 2% 2% Fail 5% 3% 4% No Grade 7% 11% 11% Average Grade 3.2 3.5 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 17 ## Page 46 Judge Douglas R. Vannoy Non-Attorney Survey 6b. How would you grade Judge Vannoy on having knowledge of the rules of evidence, procedure and the law? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 61% 69% 67% B 22% 14% 16% C 6% 4% 5% D 2% 1% 2% Fail 3% 2% 2% No Grade 6% 10% 10% Average Grade 3.4 3.6 3.6 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 18 ## Page 47 Judge Douglas R. Vannoy Non-Attorney Survey 6c. How would you grade Judge Vannoy on deciding important matters in a timely way? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 48% 64% 62% B 31% 17% 18% C 6% 5% 6% D 3% 2% 2% Fail 4% 2% 2% No Grade 9% 10% 10% Average Grade 3.3 3.5 3.5 Letter Grade B B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 19 ## Page 48 Judge Douglas R. Vannoy Non-Attorney Survey 6d. How would you grade Judge Vannoy on making decisions without regard to public criticism? Judge All District All Trial Vannoy Judges 2002 Judges 2002 A 50% 57% 55% B 23% 13% 14% C 9% 4% 5% D 2% 2% Fail 3% 2% 3% No Grade 15% 22% 22% Average Grade 3.4 3.5 3.5 Letter Grade B+ B+ B+ Judicial Performance Survey 2002 Judicial District 13 Page 20 ## Page 49 Judge Douglas R. Vannoy Non-Attorney Survey 7. Do you recommend that Judge Vannoy be retained in office or not be retained in office? Judge All District All Trial Vannoy Judges 2002 Judges 2002 Retain in office 85% 85% 83% Do not retain in office 8% 7% 8% No opinion 7% 8% 9% Judicial Performance Survey 2002 Judicial District 13 Page 21 ## Page 50 MMeetthhooddoollooggyy Sample: The Colorado Judicial Department provided Talmey-Drake Research & Strategy, Inc. with a list of cases heard and closed during the two years prior to the summer of 2001 by the 115 justices and judges standing for retention in November 2002. From this list of cases, Talmey-Drake Research drew a sample of the 250 cases most recently closed for each judge or justice. In some instances where there were an insufficient number of cases (or participants in cases), the time period during which cases could be drawn was lengthened. For each case selected a list of people associated with the case who had likely appeared in the judge’s courtroom were drawn from the Judicial Department’s database, ICON, and the Colorado District Attorney’s database (Blackstone system). The cases and the associated case participants were divided up among the 22 judicial districts and put on CD ROM. These CD’s were distributed to the judicial districts, and district personnel added the names of people who were associated with a case, but whose names and addresses had not been captured electronically. The data from the judicial districts were then returned to Talmey-Drake Research where the data was combined and cleaned. Included in the data cleaning was the identification of potential respondents in the sample who had appeared in more than two judges’ courtrooms. Due to concerns about respondent fatigue, no more than two questionnaires were intended to be sent to any one respondent—though there were a few instances where one respondent did receive more than two questionnaires. Where a person had been in more than two judges’ courtrooms, the selection criteria for which judges he or she would be sent questionnaires was: first, for the judge in whose courtroom the potential respondent had been in most often, and two, the judge with the smallest sample of the judges in whose courtroom the potential respondent had been in. Added to this database were a database of jurors and one of court employees. Survey: In November 2002, each person in the database was mailed a postcard saying they would receive a questionnaire concerning judicial performance and that it was important for them to fill it out and return it. Shortly thereafter, they were sent an initial questionnaire and an introductory letter with a postage- paid return envelope. Those who did not respond to the first questionnaire were then sent a sent a second questionnaire and letter. Non-respondents to the second survey were sent a reminder postcard. At this point, non- responders who had been sent questionnaires about judges who had not yet achieved a target cooperation rate of 40% were sent a third letter and questionnaire—and a follow up postcard. During this process, the sample was augmented for judges with a particularly low number of completed questionnaires. 1 ## Page 51 Questionnaire:The questionnaire used in the 2002 Judicial Performance Survey is identical to the questionnaire used for the 2000 survey. Respondents were asked to use a grade of A, B, C, D, or F (Fail) to assess the justice’s or judge’s performance in the areas of Courtesy, Impartiality, Communication, Judicial Temperament, Diligence and Application of the Law. These scores were then converted to a numerical value where A = 4, B = 3, C = 2, D = 1 and Fail = 0. Response: The response rate is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses & refusals, undeliverables and other responses. The table presents the overall response rate as well as the response rate by the different types of respondents. Refused/ Nonre- Unde- Response Attorney Respondents Total Sent Completed sponse livered Other Rate District Attorney 852 511 227 42 72 69.2% Attorney For Defendant 3,277 1,921 809 223 324 70.4% Attorney for Plaintiff 1,711 1,001 428 92 190 70.0% Guardian ad Litem 85 47 22 9 7 68.1% Unknown Attorney Type 460 206 112 102 40 64.8% Attorney Total 6,385 3,686 1,598 468 633 69.8% Refused/ Nonre- Unde- Response Non-Attny Respondents Total Sent Completed sponse livered Other Rate Law Enforcement 6,918 2,517 2,648 577 1,176 48.7% Social Services Casewrkr 117 61 36 15 5 62.9% Employee 1,946 1,142 526 105 173 68.5% Defendant 15,701 2,467 7,511 5,109 614 24.7% Plaintiff 3,276 943 1,538 553 242 38.0% Juror 12,910 6,565 4,443 776 1,126 59.6% Victim 3,158 414 1,601 788 355 20.5% Other 4,611 816 2,288 951 556 26.3% Non-attorney Total 48,637 14,925 20,591 8,874 4,247 42.0% Total 55,022 18,611 22,189 9,342 4,880 45.6% A similar table showing the response count and cooperation rate for your survey is provided at the end of this methodology section. 2 ## Page 52 Results: The results of the Survey are in two main sections: Results and Comments. Within each main section are two subsections, one for each general type of respondent, attorney or non-attorney. Results: This section shows the percentage distribution of grades you received on each of the substantive questions plus the retain/do not retain question. An average grade point for each graded question is computed and shown in the results section. A letter grade is also assigned to each grade point according to the following scale. A = 4.00 B = 3.00 to 3.33 C = 2.00 to 2.33 D = 1.00 to 1.33 A— = 3.68 to 3.99 B— = 2.67 to 2.99 C— = 1.67 to 1.99 D— = 0.67 to 0.99 B+ = 3.34 to 3.66 C+ = 2.34 to 2.66 D+ = 1.34 to 1.66 Fail = 0.00 to 0.67 This section also includes two comparative columns of results: one comparative column shows the results for that question for all county or district judges (as appropriate) surveyed in 2002, along with a second comparative column showing the results for all trial judges in the 2002 survey. Comments: Each respondent was encouraged to comment on the judge’s performance in the six areas of Courtesy, Impartiality, Communication, Judicial temperament, Diligence, Application of the law as well as the judge’s Overall performance. This section contains these comments—again divided between results from attorneys and non-attorneys. Sampling All sample surveys are subject to what is known as sampling error—the Error: extent to which the results of the sample survey may differ from what would be obtained if the entire population being surveyed had been interviewed. The size of the sampling error is almost entirely due to the number of people interviewed for the survey and the variance of responses. The table below shows the extent of sampling error (95%-confidence interval) for various sizes of random samples and sample percentage results. Sample Size 25 50 100 150 200 300 Percentages near 10% or 90% ± 11.8% ± 8.3% ± 5.9% ± 4.8% ± 4.2% ± 3.4% Percentages near 20% or 80% ± 15.7% ± 11.1% ± 7.8% ± 6.4% ± 5.5% ± 4.5% Percentages near 30% or 70% ± 18.0% ± 12.7% ± 9.0% ± 7.3% ± 6.4% ± 5.2% Percentages near 40% or 60% ± 19.2% ± 13.6% ± 9.6% ± 7.8% ± 6.8% ± 5.5% Percentages near 50% ± 19.6% ± 13.9% ± 9.8% ± 8.0% ± 6.9% ± 5.7% For example, suppose a reported percentage is 80% in a sample size of 150, then one could expect that 95% of the time that a random sample of the same size and collected the same way would include the true population percentage within the range of 80% plus or minus 6.4%. Averages such as grade points also have a 95% confidence interval, however it is not so easily displayed in a table as confidence intervals about a percentage. Suffice it to say that the confidence interval about a score generally increases with smaller sample size. 3 ## Page 53 Judge Douglas R. Vannoy Survey Disposition Report Total Refusals & Undeliv- Other Response Sent Completes Nonresponse erables Response Rate District Attorney 8 2 6 25.0% Attorney For Defendant 5 4 1 80.0% Attorney for Plaintiff 9 5 4 55.6% Guardian ad Litem 3 3 100.0% Unknown Attorney Type Sub Total: 25 14 11 56.0% Law Enforcement 76 47 19 5 5 71.2% Social Services Caseworker 2 2 100.0% Employee 22 17 5 77.3% Defendant 111 17 58 32 4 22.7% Plaintiff 51 12 27 11 1 30.8% Juror 57 32 21 4 60.4% Victim 122 17 74 25 6 18.7% Other 92 20 45 14 13 30.8% Sub Total: 533 164 249 91 29 39.7% Total: 558 178 260 91 29 40.6% 1. 'Other Response' predominately includes people who sent back a survey saying they did not appear in the courtroom, and people who are deceased, or otherwise incapable of responding, and people who could not recall the experience. 2. The Response Rate is calculated using the following formula: Completes (Total Sent - Undeliverables - Other Responses) Judicial Performance Survey 2002 Judicial District 13
Score cards render where the PDF extractor found numeric fields (partial is shown with “—” for missing tiles). “Read full survey text” surfaces the complete report transcription for every survey on file. Source PDFs on OJPE are always linked above for fidelity. Coverage note on Sources.
Sources
- 2014 evaluation on OJPE · scraped Apr 17, 2026
- 2008 evaluation on OJPE · scraped Apr 17, 2026
- 2002 evaluation on OJPE · scraped Apr 17, 2026
- 1996 evaluation on OJPE · scraped Apr 17, 2026
- 1990 evaluation on OJPE · scraped Apr 17, 2026