E. Dale Boyd
Trial Court · Dolores · Dolores
Meets Standards(Retain)3 cycles on record
Evaluation history
- 2016 retention cycleTrial Court · Dolores · DoloresMeets Standards(Retain)VotersRetained· 76.1% yes869 yes · 273 no50% needed to retainRetention Year: 2016 Recommendation: Meets Performance Standard Reports: 2016 Retention Survey Report (PDF) 2015 Interim Survey Report (PDF) Need an accessible PDF Document Version? Please click on the link below and email our staff Contact Us The Twenty-Second Judicial District Commission on Judicial Performance unanimously recommends 9-0 that Judge E. Dale Boyd BE RETAINED. Judge Boyd was appointed as the Dolores County Court Judge for Dolores County on January 4, 2005. Judge Boyd also serves as the Municipal Judge in the Town of Dove Creek. Judge Boyd graduated with a Bachelor of Science Degree in Agricultural Science from New Mexico State University in 1970. Judge Boyd also works as a rancher specializing in alfalfa hay production and raising Limousine cattle. He is involved in his community serving as a speaker at the local high school and periodically invites students into his courtroom as an educational opportunity. The Commission reviewed the results of surveys, reviewed the self-evaluation of Judge Boyd, conducted unannounced courtroom observations, reviewed caseload statistics, and conducted an interview with Judge Boyd prior to making the recommendation for retention. The survey asked “how strongly do you recommend that Judge Boyd be retained in office, or not be retained in office?” Of attorneys completing the survey 75% recommended to retain and 25% not to retain. Of non-attorneys completing the survey, 100% recommended to retain. Four attorneys and eight non-attorneys completed judicial performance surveys this evaluation cycle. The Commissioners noted that two of Judge Boyd’s strengths are his fairness and highly positive reputation within the community. Judge Boyd manages his courtroom in a manner that both encourages and accommodates participation by all parties. Although Judge Boyd is one of the few non-attorney judges in the State of Colorado, he attends intensive judicial training on a regular basis and utilizes his life experiences on the bench.
- 2012 retention cycleTrial Court · Dolores · DoloresMeets Standards(Retain)Retention Year: 2012 Recommendation: Retain Reports: 2012 Retention Survey Report (PDF) 2011 Interim Survey Report (PDF) 2009 Interim Survey Report (PDF) Need an accessible PDF Document version? Please click on the link below and email our staff Contact Us The Twenty-Second Judicial District Commission on Judicial Performance unanimously recommends that Judge E. Dale Boyd BE RETAINED. Judge Boyd was appointed as the Dolores County Court Judge for Dolores County on January 4, 2005. Judge Boyd also serves as the Municipal Judge in the Town of Dove Creek. Judge Boyd graduated with a Bachelor of Science Degree in Agricultural Science from New Mexico State University in 1970. Judge Boyd also works as a rancher specializing in alfalfa hay production and raising Limousine cattle. He is involved in his community serving as a speaker at the local high school and periodically invites students into his courtroom as an educational opportunity. The Commission reviewed the results of surveys, reviewed the self-evaluation of Judge Boyd, conducted unannounced courtroom observation, reviewed caseload statistics, and conducted an interview with Judge Boyd prior to making the recommendation for retention. According to the survey one of Judge Boyd’s strengths is his neutrality and fairness. Most of Judge Boyd’s cases involve parties who are not represented by attorneys and he strives to manage a courtroom forum that both encourages and accommodates participation by pro se parties, but also adheres to the law and maintains order. Judge Boyd is one of the few lay judges in the State of Colorado. Although he possesses no formal legal training, he is able to contact other Colorado judges and utilize provided judicial resources and training, if needed. Judge Boyd utilizes his multiple life experiences, as well as his judicial training and constant efforts to remain current in the law in arriving at his daily judicial decisions. Of all attorneys surveyed about retention, 92% recommended to retain, 8% not to retain, and 0% were undecided or didn’t have enough information to make a recommendation. Of all non-attorneys surveyed, 90% recommended to retain, 8% not to retain, and 2% were undecided or didn’t have enough information to make a recommendation. Of those expressing an opinion to retain or not to retain, 92% recommended to retain and 8% recommended not to retain.
- 2008 retention cycleTrial Court · Dolores · DoloresMeets Standards(Retain)Reports: 2008 Retention Survey Report Need an accessible PDF Document version? Please click on the link below and email our staff Contact Us The Twenty-Second Judicial District Commission on Judicial Performance unanimously recommends that Judge E. Dale Boyd BE RETAINED. Background: Judge Boyd was appointed as the Dolores County Court Judge for Dolores County on January 4, 2005. Previous judicial experience includes serving as a Municipal Judge in the town of Dove Creek from July 17, 2004 to present. Judge Boyd graduated with a Bachelor of Science Degree in Agricultural Science from New Mexico State University. Judge Boyd also works as a rancher specializing in alfalfa hay production and raising Limousine cattle. He is involved in his community serving as a speaker at the local high school, talking to seniors on underage drinking, domestic violence and other areas of interest. Strengths: There were limited numbers of available responses from attorneys. Non-attorneys who responded to survey questions rated Judge Boyle as well above average in treating people fairly who represented themselves and above average in overall communication, fairness, and application of the law. Non-attorneys also commented that Judge Boyle is well versed in the law, honorable, unbiased, and treated all people regardless of their education or background with the same respect and dignity. The Commission reviewed various opinions that Judge Boyd had written and conducted a personal interview with Judge Boyd. Judge Boyd recognizes that there are areas where he could improve his performance and he is actively seeking additional training. Recommendation: The majority of all non-attorneys surveyed strongly recommended that Judge Boyd be retained in office.
Surveys & reports
- 2016 cycle
- 2015 Interim Survey Report(PDF on OJPE)
Read full interim survey textexpand
## Page 1 The Honorable E. Dale Boyd 2015 Judicial Performance Interim Report 22nd Judicial District ## Page 2 May 29, 2015 The Honorable E. Dale Boyd Dolores County Courthouse P.O. Box 511 409 N. Main Dove Creek, CO 81324 Dear Judge Boyd: I am pleased to make available to you the attached copy of your 2015 Judicial Performance Interim Survey Report. This report includes the survey results from two important stakeholder groups: 1) attorneys who have had cases in your court or who are knowledgeable about your judicial performance; and 2) non-attorneys who have observed your performance in court or who have knowledge of your performance as a judge. In addition to this introduction, the report is divided into five main sections: 1. A brief summary of the results of the attorney and non-attorney surveys. 2. The numerical results of the survey of attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments attorneys made about your judicial performance. In some instances the comments have been redacted to eliminate respondent identifying information. 3. The numerical results of the survey of non-attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments these respondents made on the subject of your judicial performance. In few instances the comments have been redacted to eliminate respondent identifying information. 4. The fourth section of the report discusses the methodology of the surveys. 5. The final section provides copies of the questions or questionnaires that were used for each survey. If you have any questions about the methodology and how the survey was conducted, please feel free to contact me at 505-821-5454 or by email at sanderoff@rpinc.com (please put the words “Judicial Performance” in the subject line), and for any other questions you might have about the survey please call the Executive Director of the Office of Judicial Performance Evaluation, Kent Wagner, at 303-928-7779. Best regards, Brian Sanderoff President ## Page 3 Summary of Results Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. On average, Judge E. Dale Boyd received an overall combined average grade of 3.26 in the 2015 Judicial Performance Interim Survey Report. This is calculated by adding the overall average grade received from attorney respondents, 3.11, to the overall average grade received from non-attorney respondents, 3.40, divided by two. The average combined grade for all county judges that are receiving an interim evaluation in 2015 is 3.42 [not shown below]. Judge Boyd Average Grades (All Years) Combined Attorney Non-attorney Overall Grade 3.26 3.11 3.40 Sample Size -- 14 38 Table 1 The results presented in this report are based on data collected in 2011, 2012, 2013, and 2014. (See Methodology section for description of sampling process.) Table 2 shows Judge Boyd’s overall average grades for up to four years (for each year in which survey results are available.) Provisional judges will not have samples for the years prior to their appointment. Judge Boyd Average Grades by Year Combined Attorney Non-attorney Average Average Sample Average Sample Score Score Size Score Size Year 2011 3.29 3.14 6 3.43 20 2012 NA NA NA NA NA 2013 NA NA NA NA NA 2014 3.23 3.09 8 3.37 18 Overall 3.26 3.11 14 3.40 38 Table 2 1 ## Page 4 Comparison of Jurors vs. Non-Jurors Among Non-Attorney Population Among the non-attorney population, jurors tend to grade judges much higher than non- jurors. The juror overall average grade for all county judges that are receiving an interim evaluation in 2015 is 3.81, while the overall average grade awarded by non-jurors is 3.27. Judges with a higher percentage of jurors in their sample tend to have higher average grades in the non-attorney survey than those judges with a small percentage of jurors. The number of jurors in a judge’s sample is, of course, closely related to the number of jury trials the judge presides over. The table below shows Judge Boyd’s non-attorney results broken out by jurors and non-jurors. It also shows the overall average juror and non-juror grades for all county judges that are receiving an interim evaluation in 2015 (see two columns on far right). Average Grades for Jurors vs. Non-Jurors (All Years) All County Judge Boyd Judges* Jurors Non-Jurors Average Sample Average Sample Juror Non-Juror Score Size % Score Size % Average Average 3.74 4 11% 3.36 34 89% 3.81 3.27 Table 3 * Includes only the County judges evaluated during this interim cycle. 2 ## Page 5 Survey of Attorneys Regarding Judge E. Dale Boyd (Sample Size 14) ## Page 6 Survey of Attorneys Regarding County Judges Average (0.0 to 4.0 scale) Judge E. Dale Boyd All County Sample Size = 14 A B C D Fail DK/NA E. Dale Boyd Judges* 1. Case Management: 1a. Promptly issuing a decision on the case after trial. 64% 21% 7% 0% 0% 7% 3.62 3.54 1b. Maintaining appropriate control over proceedings. 79% 7% 7% 0% 7% 0% 3.50 3.47 1c. Promptly ruling on pre-trial motions. 71% 14% 7% 0% 0% 7% 3.69 3.43 1d. Setting reasonable schedules for cases. 71% 21% 7% 0% 0% 0% 3.64 3.37 Overall Case Management 3.61 3.45 2. Application and Knowledge of Law: 2a. Being able to identify and analyze relevant facts. 7% 50% 36% 7% 0% 0% 2.57 3.30 2b. Basing decisions on evidence and arguments. 14% 50% 29% 7% 0% 0% 2.71 3.18 2c. Willing to reconsider error in fact or law. 43% 29% 14% 7% 0% 7% 3.15 3.00 2d. Issuing consistent sentences when the circumstances are 30% 30% 20% 0% 0% 20% 3.13 3.31 similar. Overall Application and Knowledge of Law 2.89 3.20 3. Communications: 3a. Making sure all participants understand the proceedings. 43% 36% 21% 0% 0% 0% 3.21 3.52 3b. Providing written communications that are clear, thorough 21% 36% 36% 0% 0% 7% 2.85 3.34 and well reasoned. Overall Communications 3.03 3.43 4. Demeanor: 4a. Giving proceedings a sense of dignity. 36% 50% 7% 7% 0% 0% 3.14 3.42 4b. Treating participants with respect. 50% 36% 7% 7% 0% 0% 3.29 3.37 4c. Conducting the courtroom in a neutral manner. 50% 29% 14% 0% 7% 0% 3.14 3.18 4d. Consistently applying laws and rules. 21% 43% 21% 7% 0% 7% 2.85 3.23 Overall Demeanor 3.11 3.30 5. Diligence: 5a. Using good judgment in application of relevant law and 14% 57% 14% 0% 7% 7% 2.77 3.18 rules. 5b. Doing the necessary "homework" and being prepared for 21% 36% 29% 0% 7% 7% 2.69 3.30 cases. 5c. Being willing to handle cases on the docket even when 21% 50% 7% 0% 7% 14% 2.92 3.38 they are complicated and time consuming. Overall Diligence 2.79 3.29 Overall Average Grade: 3.11 3.32 * Includes only the County judges evaluated during this interim cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A=4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2015 Judicial Performance Interim Report 3 ## Page 7 Survey of Attorneys Regarding County Judges Percentage Judge E. Dale Boyd All County E. Dale Boyd Judges* Would you say the judge is: Very biased in favor of the prosecution 0% 11% Somewhat biased in favor of the prosecution 10% 30% Completely neutral 70% 50% Somewhat biased in favor of the defense 0% 4% Very biased in favor of the defense 10% 1% Don't know or not sure 10% 4% How strongly do you recommend that the Judge be retained in office, or not be retained in office? Strongly recommend retain 38% 53% Recommend retain 25% 24% Neither recommend nor not recommend retain 13% 9% Recommend not retain 13% 7% Strongly recommend not retain 13% 7% Total Retain 63% 77% Neither 13% 9% Total Not Retain 26% 14% * Includes only the County judges evaluated during this interim cycle. 2015 Judicial Performance Interim Report 4 ## Page 8 Judge E. Dale Boyd Survey of Attorneys Regarding County Judges Average Grades 3.11 Overall Average Grade 3.32 3.61 Q1. Overall Case Management 3.45 1a. Promptly issuing a decision on the 3.62 case after trial. 3.54 3.50 1b. Maintaining appropriate control over proceedings. 3.47 3.69 1c. Promptly ruling on pre-trial motions. 3.43 1d. Setting reasonable schedules for cases. 3.64 3.37 2.89 Q2. Overall App & Knowledge of Law 3.20 2.57 2a. Being able to identify and analyze relevant facts. 3.30 2.71 2b. Basing decisions on evidence and arguments. 3.18 3.15 2c. Willing to reconsider error in fact or law. 3.00 3.13 2d. [Criminal only] Issuing consistent sentences 3.31 when circumstances are similar. 3.03 Q3. Overall Communication 3.43 3.21 3a. Making sure all participants understand 3.52 the proceedings. 2.85 3b. Providing written communications that are 3.34 clear, thorough and well reasoned. 2.0 2.5 3.0 3.5 4.0 E. Dale Boyd All County Judges* * Includes only the County judges evaluated during this interim cycle. Judge E. Dale Boyd 55 2015 Judicial Performance Interim Report ## Page 9 * Includes only the County judges evaluated during this interim cycle. Judge E. Dale Boyd Survey of Attorneys Regarding County Judges Average Grades 3.11 Q4. Overall Demeanor 3.30 3.14 4a. Giving proceedings a sense of dignity. 3.42 3.29 4b. Treating participants with respect. 3.37 4c. Conducting the courtroom in a 3.14 neutral manner. 3.18 2.85 4d. Consistently applying laws and rules. 3.23 2.79 Q5. Overall Diligence 3.29 5a. Using good judgment in application of 2.77 relevant laws and rules. 3.18 5b. Doing the necessary 'homework' and 2.69 being prepared for cases. 3.30 5c. Being willing to handle cases on the docket even 2.92 when they are complicated and time consuming. 3.38 2.0 2.5 3.0 3.5 4.0 Biased in favor of prosecution/defense. 0% Very biased in favor of the prosecution 11% 10% Somewhat biased in favor of the prosecution 30% 70% Completely Neutral 50% 0% Somewhat biased in favor of the defense 4% 10% Very biased in favor of the defense 1% 10% Don't know/not sure 4% 0% 10% 20% 30% 40% 50% 60% 70% 80% E. Dale Boyd All County Judges* * Includes only the County judges evaluated during this interim cycle. 66 2015 Judicial Performance Interim Report ## Page 10 * Includes only the County judges evaluated during this interim cycle. Judge E. Dale Boyd Survey of Attorneys Regarding County Judges How strongly do you recommend that Judge Boyd be retained or not retained in office? 38% Strongly recommend retain 53% 25% Recommend retain 24% 13% All Cnty Neither retain nor not retain 9% Judge Boyd Judges* Total Retain 63% 77% 13% Neither 13% 9% Recommend not retain 7% Total Not Retain 26% 14% 13% Strongly recommend not retain 7% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% E. Dale Boyd All County Judges* * Includes only the County judges evaluated during this interim cycle. 77 2015 Judicial Performance Interim Report ## Page 11 Survey of Non-Attorneys Regarding Judge E. Dale Boyd (Sample Size 38) ## Page 12 Survey of Non-Attorneys Regarding County Judges Average (0.0 to 4.0 scale) Judge E. Dale Boyd All County Sample Size = 38 A B C D Fail DK/NA E. Dale Boyd Judges* 1. Demeanor: 1a. Giving court proceedings a sense of dignity. 53% 21% 13% 8% 5% 0% 3.08 3.54 1b. Treating participants in the case politely and with respect. 66% 13% 16% 5% 0% 0% 3.39 3.54 1c. Conducting the courtroom in a neutral manner. 62% 16% 14% 8% 0% 0% 3.32 3.48 1d. Having a sense of compassion and human understanding 68% 18% 11% 3% 0% 0% 3.53 3.42 for those who appear before the judge. Overall Demeanor 3.33 3.50 2. Fairness: 2a. Giving participants an opportunity to be heard. 71% 18% 5% 3% 3% 0% 3.53 3.53 2b. Treating those involved in the case without bias. 63% 11% 16% 3% 3% 5% 3.36 3.45 2c. Treating fairly people who represent themselves. 61% 16% 5% 3% 0% 16% 3.59 3.46 2d. Giving each side enough time to present their case. 74% 13% 8% 3% 0% 3% 3.62 3.54 Overall Fairness 3.53 3.50 3. Communications: 3a. Making sure participants understand the proceedings, and 71% 18% 5% 5% 0% 0% 3.55 3.58 what's going on in the courtroom. 3b. Using language that everyone can understand. 74% 18% 8% 0% 0% 0% 3.66 3.63 3c. Speaking clearly so everyone in the courtroom can hear 76% 13% 11% 0% 0% 0% 3.66 3.68 what's being said. Overall Communications 3.62 3.63 4. Diligence: 4a. Beginning court on time. 59% 27% 8% 0% 3% 3% 3.44 3.48 4b. Maintaining appropriate control over proceedings. 61% 16% 16% 8% 0% 0% 3.29 3.64 4c. Setting reasonable schedules for cases. 59% 19% 16% 3% 0% 3% 3.39 3.54 4d. Being prepared for cases. 55% 24% 11% 5% 3% 3% 3.27 3.58 4e. Managing court proceedings so that there is little wasted 45% 32% 11% 11% 0% 3% 3.14 3.48 time. Overall Diligence 3.31 3.54 5. Application of Law: 5a. Giving reasons for rulings. 55% 18% 11% 5% 3% 8% 3.29 3.44 5b. Willing to make decision without regard to possible outside 58% 8% 21% 3% 5% 5% 3.17 3.45 pressure. 5c. Being able to identify and analyze relevant facts. 58% 24% 11% 5% 3% 0% 3.29 3.45 Overall Application of Law 3.25 3.45 Overall Average Grade: 3.40 3.52 * Includes only the County judges evaluated during this interim cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A=4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2015 Judicial Performance Interim Report 9 ## Page 13 Survey of Non-Attorneys Regarding County Judges Percentage Judge E. Dale Boyd All County E. Dale Boyd Judges* 6. Average Bias [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 6% 13% Competely neutral 79% 79% Biased in favor of the defense total 12% 7% [A positive average indicates bias toward prosecution, and a Average -0.24 0.13 negative average indicates a bias toward the defense.] 7. Average Sentencing [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 3% 13% Competely neutral 60% 74% Lenient sentencing total 37% 13% [A positive average indicates sentences are harsh, and a Average -1.00 0.10 negative average indicates sentences are lenient.] How strongly do you recommend that the Judge be retained, or not be retained in office? Strongly recommend retain 67% 70% Recommend retain 11% 14% Neither recommend nor not recommend retain 11% 7% Recommend not retain 11% 3% Strongly recommend not retain 0% 7% Total Retain 78% 84% Neither 11% 7% Total Not Retain 11% 10% * Includes only the County judges evaluated during this interim cycle. 2015 Judicial Performance Interim Report 10 ## Page 14 Judge E. Dale Boyd Survey of Non-Attorneys Regarding County Judges Average Grades 3.40 Overall Average Grade 3.52 3.33 Q1. Overall Demeanor 3.50 3.08 1a. Giving proceedings a sense of dignity. 3.54 1b. Treating participants politely and with respect. 3.39 3.54 1c. Conducting the courtroom in a neutral 3.32 manner. 3.48 1d. Having a sense of compassion and human 3.53 understanding for those who appear before the judge. 3.42 3.53 Q2. Overall Fairness 3.50 2a. Giving participants an opportunity to be 3.53 heard. 3.53 2b. Treating those involved in the 3.36 case without bias. 3.45 2c. Treats people fairly who represent 3.59 themselves. 3.46 2d. Giving each side enough time to present 3.62 their case. 3.54 3.62 Q3. Overall Communications 3.63 3a. Making sure participants understand the 3.55 proceedings, and what's going on in the courtroom. 3.58 3b. Using language that everyone can 3.66 understand. 3.63 3c. Speaking clearly so everyone in the courtroom 3.66 can hear what's being said. 3.68 2.0 2.5 3.0 3.5 4.0 E. Dale Boyd All County Judges* * Includes only the County judges evaluated during this interim cycle. Judge E. Dale Boyd 11 2015 Judicial Performance Interim Report ## Page 15 Judge E. Dale Boyd Survey of Non-Attorneys Regarding County Judges Average Grades 3.31 Q4. Overall Diligence 3.54 3.44 4a. Beginning court on time. 3.48 4b. Maintaining appropriate control over 3.29 proceedings. 3.64 4c. Setting reasonable schedules for cases. 3.39 3.54 4d. Being prepared for cases. 3.27 3.58 4e. Managing court proceedings so that there is 3.14 little wasted time. 3.48 3.25 Q5. Overall Application of Law 3.45 3.29 5a. Giving reasons for rulings. 3.44 5b. Willing to make decision without regard to 3.17 possible outside pressure. 3.45 5c. Being able to identify and analyze 3.29 relevant facts. 3.45 2.0 2.5 3.0 3.5 4.0 Q6 Biased in favor of prosecution/defense. 1 -0.24 E. Dale Boyd 0.13 All County Judges* -5 -4 -3 -2 -1 0 1 2 3 4 5 Defense Prosecution 1-A negative average score indicates bias toward the defense, and a positive average score indicates bias toward prosecution. Q7 Lenience or Harshness in Sentencing. 2 -1.00 E. Dale Boyd 0.10 All County Judges* -5 -4 -3 -2 -1 0 1 2 3 4 5 Lenient Harsh 2-A negative average score indicates sentences are lenient, and a positive average score indicates sentences are harsh. E. Dale Boyd All County Judges* * Includes only the County judges evaluated during this interim cycle. 12 2015 Judicial Performance Interim Report ## Page 16 * Includes only the County judges evaluated during this interim cycle. Judge E. Dale Boyd Survey of Non-Attorneys Regarding County Judges How strongly do you recommend that Judge Boyd be retained or not retained in office? 67% Strongly recommend retain 70% 11% Recommend retain 14% 11% Neither retain nor not retain All Cnty 7% Judge Boyd Judges* 11% Total Retain 78% 84% Recommend not retain 3% Neither 11% 7% Total Not Retain 11% 10% 0% Strongly recommend not retain 7% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% E. Dale Boyd All County Judges* * Includes only the County judges evaluated during this interim cycle. 13 2015 Judicial Performance Interim Report ## Page 17 MMeetthhooddoollooggyy ## Page 18 Methodolgy The results shown in the 2015 Judicial Performance Interim Survey Report are based on two surveys: The Survey of Attorneys Regarding Trial Judges, and the Survey of Non- Attorneys Regarding Trial Judges. Below is a description of the methodology used in the two surveys. I Attorneys Regarding County Judges a. Sample: Research & Polling, Inc. received case data with the names of attorneys who had likely been in each judge’s courtroom from the following primary sources: • Colorado Judicial Department • Colorado District Attorneys’ Council • Colorado Public Defender’s Office • Denver County Courts • District Attorney’s Office, Second Judicial District (Denver) The data from these different sources are combined, duplicates removed, and addresses corrected. Only judges that are due to receive an interim evaluation in 2015 were evaluated during this reporting cycle. The intent was to increase the number of completed attorney evaluations for each judge by excluding those not due to receive an interim evaluation in 2015. The number of possible judges that attorney respondents could evaluate was 10. Attorneys are first mailed a letter inviting them to complete the survey online. The letter provides the link to the online survey, as well as a unique password to access the survey. Approximately one week later, attorneys are sent an email invitation to complete the online survey, which also provides the Web address and their unique password. About a week after the first email is sent, a reminder email is sent, providing the same information. Potential respondents who do not complete the survey after the second email are then telephoned and asked to either complete the survey by phone, or to complete it online. Since 2010, the Judicial Performance Survey reports are based on a moving average, or rolling sample, of data collected over a period of time equal to the justice’s or judge’s term of office: ten years for a Supreme Court justice, eight years for a COA judge, six years for a district judge, and four years for a county judge. To use a county judge as an example: as survey data is collected it is pooled together for four years. After four years, as new data is added to the judge’s survey results, the oldest data in the pool is deleted. 15 ## Page 19 b. Questions: Respondents evaluated judges on 17 aspects of judicial performance using a grade scale of A, B, C, D, or F. (See Questionnaire section.) These grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the judge be retained or not retained in office. c. Analysis: The Attorneys Regarding County Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all county judges receiving an interim evaluation in 2015 and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all county judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the question about recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all county judges. The next page displays the question averages in horizontal bar-graph form. The percentage distribution to the retention question is then presented in the graph on the next page. The third part of the Attorneys Regarding County Judges section of the report lists the comments the attorneys made about the judge’s strengths and weaknesses. d. Comments: Respondents were also asked what they considered to be the judge’s strengths and weaknesses. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. Most spelling and typographical errors have been corrected. 16 ## Page 20 e. Cooperation Rate: The overall cooperation rate for the Attorneys Regarding Trial Judges Survey is calculated as the number of completed survey evaluations divided by the number of possible evaluations resulting in an overall response rate of 50.0% for district judges and 51.0% for county judges. An equivalent cooperation rate for an individual judge is computed in the same manner. Undeliverable surveys have been excluded from the cooperation rates. II Non-Attorneys Regarding County Judges [Please Note: Due to insufficient survey responses, the non-attorney results for Judge Ruth M. Acheson are not included in this report.] a. Sample: Research Polling, Inc. received case data with the names of non-attorneys who had likely been in each judge’s courtroom from the following primary sources: • Colorado Judicial Department • Colorado District Attorneys’ Council • Colorado Public Defender’s Office • Denver County Courts • District Attorney’s Office, Second Judicial District (Denver) The data from these different sources are combined, duplicates removed, and addresses corrected. Only the judges due to receive an interim evaluation in 2015 were evaluated during this reporting cycle. The intent was to increase the number of completed non-attorney evaluations for each judge by excluding those not due to receive an interim evaluation in 2015. Non-attorneys were surveyed via standard mail. First, they were mailed an initial postcard informing the recipient that he or she would be receiving a questionnaire. Two to three weeks after the postcard was mailed, the potential respondent was sent a personalized introductory letter and a questionnaire with a postage-paid return envelope. If the person did not respond, a second questionnaire and letter were sent approximately four weeks later. Questionnaires are barcoded, and if a respondent mailed back two questionnaires, the second one was deleted from the data file. Since 2010, the non-attorney section of the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the judge’s term of office: six years for a district judge and four years for a county judge. To use a county judge as an example: as survey data is collected, it is pooled together for four years. After four years, as new data is added to the judge’s survey results, the oldest data in the pool is deleted. 17 ## Page 21 b. Questions: Respondents evaluated judges on 19 aspects of judicial performance using a grade scale of A, B, C, D, or F. (See Questionnaire section.) These grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the judge be retained or not retained in office. A copy of the questionnaire is included in the last section of this report. c. Analysis: The Non-Attorneys Regarding County Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all county judges receiving an interim evaluation in 2015 and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all county judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the questions about prosecution or defense bias and recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all county judges. The next page displays the question averages in horizontal bar-graph form. The percentage distribution of the prosecution-defense bias and retention questions are then presented in the graph on the next page. The last part of the Non-Attorneys Regarding County Judges section of the report lists the comments the non-attorneys made about the judge’s strengths and weaknesses. d. Comments: In addition to the A through F questions, non-attorney respondents were asked what they considered to be the judge’s strengths and weaknesses. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. The number to the left of each comment refers to the same non-attorney respondent in both the strengths section and the weaknesses section. Most spelling and typographical errors have been corrected. 18 ## Page 22 e. Cooperation Rate: The overall cooperation rate for the non-attorney survey is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses and refusals, undeliverables, and other responses. The table presents the estimated overall cooperation rate as well as the cooperation rate by the different types of respondents. The true cooperation rates are likely higher than shown because of the percentage of people who were mailed questionnaires about judges with whom they may not have had sufficient experience. This is due, in part, to many cases being disposed of without the parties having appeared in court, as well as in the case of law enforcement, the data includes all those who were subpoenaed for a case, not just those who appeared. A table of the response counts by respondent type for Judge Boyd is shown on the following page, and on the next page is a table of the overall cooperation rates for both the Attorney and Non-Attorney Regarding County Judges surveys for all county judges. 19 ## Page 23 Judge E. Dale Boyd Judge Response Counts by Type of Respondent Total No Undeliverable/ Other Non- Coop Role Type Sent Response Not Applicable Responses Completes Rate Attorneys Criminal District Attorneys 11 5 3 0 3 37.5% Defense Attorneys 17 7 3 0 7 50.0% Civil Other Attorneys Civil 5 1 0 0 4 80.0% Total Attorneys 33 13 6 0 14 51.9% Non-attorneys Criminal Witness 5 1 2 0 2 66.7% Defendant 131 46 66 0 19 29.2% Civil Litigant 28 12 8 0 8 40.0% Witness 6 3 3 0 0 0.0% Jurors 6 1 0 1 4 66.7% Employees, including Interpreters 5 0 2 0 3 100.0% Probation Officers 8 2 4 0 2 50.0% Total Non-attorneys 189 65 85 1 38 36.5% Grand Total: 222 78 91 1 52 39.7% Note: “Undeliverable/Not Applicable” surveys are removed from the “Total Sent” prior to calculating the cooperation rate. 2015 Judicial Performance Interim Report 20 ## Page 24 Total Response Counts by Type of Respondent for All County Judges* Total No Undeliverable/ Other Non- Completes Cooperation Sent Response Not Applicable Responses Rate Attorneys Criminal District Attorneys 1359 477 428 0 454 48.8% Defense Attorneys 5458 1988 1427 0 2043 50.7% Other Attorneys Criminal 17 5 4 0 8 61.5% Civil Attorneys for Litigants 199 66 48 0 85 56.3% Other Attorneys Civil 1109 325 393 0 391 54.6% Total Attorneys 8142 2861 2300 0 2981 51.0% Non-attorneys Criminal Victim 180 101 60 12 7 5.8% Witness 3505 2059 941 134 371 14.5% Other 336 221 82 9 24 9.4% Law Enforcement 3358 2551 368 73 366 12.2% Defendant 15702 7544 6825 179 1154 13.0% Civil Litigant 4907 2614 1583 103 607 18.3% Witness 629 340 133 17 139 28.0% Other 9 8 0 0 1 11.1% Jurors 4706 2082 550 95 1979 47.6% Employees, including Interpreters 400 106 49 0 245 69.8% Probation Officers 332 92 82 0 158 63.2% Total Non-attorneys 34064 17718 10673 622 5051 21.6% Grand Total: 42206 20579 12973 622 8032 27.5% * Includes only the County judges evaluated during this interim cycle. Note: “Undeliverable/Not Applicable” surveys are removed from the “Total Sent” prior to calculating the cooperation rate. 2015 Judicial Performance Interim Report 21 ## Page 25 Survey of Attorneys Regarding County Judges All County Judges* Average Grade Sample Size = 2995 A B C D Fail DK/NA (0.0 to 4.0 scale) 1. Case Management: 1a.Promptly issuing a decision on the case after trial. 52% 15% 5% 2% 1% 25% 3.54 1b.Maintaining appropriate control over proceedings. 65% 21% 8% 3% 2% 2% 3.47 1c.Promptly ruling on pre-trial motions. 51% 19% 7% 2% 2% 19% 3.43 1d.Setting reasonable schedules for cases. 57% 23% 9% 4% 2% 6% 3.37 Overall Case Management 3.45 2. Application and Knowledge of Law: 2a.Being able to identify and analyze relevant facts. 57% 23% 10% 4% 3% 3% 3.30 2b.Basing decisions on evidence and arguments. 53% 23% 11% 6% 4% 3% 3.18 2c.Willing to reconsider error in fact or law. 39% 18% 10% 6% 6% 22% 3.00 2d.Issuing consistent sentences when the circumstances are 52% 23% 10% 3% 3% 10% 3.31 similar. Overall Application and Knowledge of Law 3.20 3. Communications: 3a.Making sure all participants understand the proceedings. 66% 22% 7% 2% 1% 2% 3.52 3b.Providing written communications that are clear, thorough 44% 17% 7% 3% 2% 27% 3.34 and well reasoned. Overall Communications 3.43 4. Demeanor: 4a. Giving proceedings a sense of dignity. 64% 20% 8% 4% 3% 1% 3.42 4b. Treating participants with respect. 65% 17% 8% 4% 4% 1% 3.37 4c. Conducting the courtroom in a neutral manner. 58% 18% 11% 6% 6% 1% 3.18 4d. Consistently applying laws and rules. 55% 21% 10% 4% 4% 5% 3.23 Overall Demeanor 3.30 5. Diligence: 5a.Using good judgment in application of relevant law and 53% 24% 11% 5% 5% 3% 3.18 rules. 5b.Doing the necessary "homework" and being prepared for 53% 22% 9% 3% 4% 9% 3.30 cases. 5c.Being willing to handle cases on the docket even when they 53% 18% 7% 3% 3% 16% 3.38 are complicated and time consuming. Overall Diligence 3.29 Overall Average Grade: 3.32 * Includes only the County judges evaluated during this interim cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2015 Judicial Performance Interim Report 22 ## Page 26 Survey of Attorneys Regarding County Judges Average Grade All County Judges* (0.0 to 4.0 scale) Would you say the judge is: Very biased in favor of the prosecution 11% Somewhat biased in favor of the prosecution 30% Completely neutral 50% Somewhat biased in favor of the defense 4% Very biased in favor of the defense 1% Don't know or not sure 4% How strongly do you recommend that the Judge be retained in office, or not be retained in office? Strongly recommend retain 53% Recommend retain 24% Neither recommend nor not recommend retain 9% Recommend not retain 7% Strongly recommend not retain 7% Total Retain 77% Neither 9% Total Not Retain 14% * Includes only the County judges evaluated during this interim cycle. 2015 Judicial Performance Interim Report 23 ## Page 27 Survey of Non-Attorneys Regarding County Judges All County Judges* Average Grade Sample Size = 5051 A B C D Fail DK/NA (0.0 to 4.0 scale) 1. Demeanor: 1a.Giving court proceedings a sense of dignity. 71% 17% 6% 2% 2% 2% 3.54 1b.Treating participants in the case politely and with respect. 73% 15% 5% 3% 3% 1% 3.54 1c.Conducting the courtroom in a neutral manner. 71% 15% 5% 3% 4% 1% 3.48 1d.Having a sense of compassion and human understanding 68% 16% 6% 3% 5% 2% 3.42 for those who appear before the judge. Overall Demeanor 3.50 2. Fairness: 2a.Giving participants an opportunity to be heard. 73% 14% 5% 3% 3% 2% 3.53 2b.Treating those involved in the case without bias. 70% 14% 5% 3% 5% 3% 3.45 2c.Treating fairly people who represent themselves. 53% 11% 3% 2% 4% 26% 3.46 2d.Giving each side enough time to present their case. 70% 14% 4% 2% 3% 6% 3.54 Overall Fairness 3.50 3. Communications: 3a.Making sure participants understand the proceedings, and 74% 14% 5% 3% 2% 2% 3.58 what's going on in the courtroom. 3b.Using language that everyone can understand. 74% 16% 5% 2% 2% 1% 3.63 3c.Speaking clearly so everyone in the courtroom can hear 78% 14% 4% 1% 1% 1% 3.68 what's being said. Overall Communications 3.63 4. Diligence: 4a.Beginning court on time. 66% 18% 7% 3% 2% 4% 3.48 4b.Maintaining appropriate control over proceedings. 75% 15% 4% 2% 2% 2% 3.64 4c.Setting reasonable schedules for cases. 63% 16% 5% 2% 2% 12% 3.54 4d.Being prepared for cases. 70% 14% 5% 2% 2% 7% 3.58 4e.Managing court proceedings so that there is little wasted 66% 19% 6% 3% 3% 3% 3.48 time. Overall Diligence 3.54 5. Application of Law: 5a.Giving reasons for rulings. 64% 15% 5% 3% 4% 8% 3.44 5b.Willing to make decision without regard to possible outside 59% 12% 5% 2% 4% 18% 3.45 pressure. 5c.Being able to identify and analyze relevant facts. 65% 14% 5% 3% 5% 8% 3.45 Overall Application of Law 3.45 Overall Average Grade: 3.52 * Includes only the County judges evaluated during this interim cycle. Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 'DK/NA' = Don't Know / Not Applicable. 2015 Judicial Performance Interim Report 24 ## Page 28 Survey of Non-Attorneys Regarding County Judges Average Grade All County Judges* (0.0 to 4.0 scale) 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 13% Competely neutral 79% Biased in favor of the defense total 7% Average 0.13 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 13% Competely neutral 74% Lenient sentencing total 13% Average 0.1 How strongly do you recommend that the Judge be retained, or not be retained in office? Strongly recommend retain 70% Recommend retain 14% Neither recommend nor not recommend retain 7% Recommend not retain 3% Strongly recommend not retain 7% Total Retain 84% Neither 7% Total Not Retain 10% * Includes only the County judges evaluated during this interim cycle. 2015 Judicial Performance Interim Report 25 ## Page 29 QQuueessttiioonnnnaaiirreess ## Page 30 Colorado Judicial Performance Attorneys Regarding Trial Judges Survey Questions _ Which of the following types of cases have you observed Judge (Last Name)’s performance? Please circle all that apply. (Only respondents who indicate they have observed the judge in “criminal other than traffic” cases will be asked question 2d and the “bias” question between 5 and 6.) Civil . 1 Criminal other than traffic . 2 Traffic . 3 Domestic . 4 Juvenile . 5 Probate . 6 Other . 9 Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge [Last Name] on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. 1. Case Management: a. Promptly issuing a decision on the case after trial. A B C D F DK/NA b. Maintaining appropriate control over proceedings. A B C D F DK/NA c. Promptly ruling on pre-trial motions. A B C D F DK/NA d. Setting reasonable schedules for cases. A B C D F DK/NA 2. Application and Knowledge of Law: a. Being able to identify and analyze relevant facts. A B C D F DK/NA b. Basing decisions on evidence and arguments. A B C D F DK/NA c. Willing to reconsider error in fact or law. A B C D F DK/NA d. [Criminal only] Issuing consistent sentences when the circumstances are similar. A B C D F DK/NA 3. Communications: a. Making sure all participants understand the proceedings. A B C D F DK/NA b. Providing written communications that are clear, thorough and well reasoned. A B C D F DK/NA 4. Demeanor: a. Giving proceedings a sense of dignity. A B C D F DK/NA b. Treating participants with respect. A B C D F DK/NA c. Conducting the courtroom in a neutral manner. A B C D F DK/NA d. Consistently applying laws and rules. A B C D F DK/NA 1 ## Page 31 5. Diligence: a. Using good judgment in application of relevant law and rules. A B C D F DK/NA b. Doing the necessary “homework” and being prepared for cases. A B C D F DK/NA c. Being willing to handle cases on the docket even when they are complicated and time consuming. A B C D F DK/NA Having observed Judge (Last Name) in a criminal case, would you say the judge is: (This question is asked only if respondent indicated at the beginning of the survey he/she observed the judge in a criminal case.) Very biased in favor of the prosecution . 1 Somewhat biased in favor of the prosecution . 2 Completely Neutral . 3 Somewhat biased in favor of the defense . 4 Very biased in favor of the defense . 5 Don’t Know/Not Sure . 9 6. What would you say are Judge (Last Name)’s strengths? _ _ _ 7. What would you say are Judge (Last Name)’s weaknesses? _ _ _ 8. Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge (Last Name) be retained in office, or not be retained in office? Strongly recommend retain in office . 5 Recommend retain in office . 4 Neither recommend nor not recommend retain in office . 3 Recommend not retain in office . 2 Strongly recommend not retain in office . 1 2 ## Page 32 9. And what would you say are Judge [Last Name]’s weaknesses? _ _ _ _ Commission on Judicial Performance _ _ Evaluation of 10. Keeping in mind your responses to each of the previous questions, how JUDGE [FULL NAME] strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? Strongly recommend retain in office . 5 Recommend retain in office . 4 Neither recommend nor not recommend retain in office. 3 If we have made a mistake and you either were not in Judge [Last Recommend not retain in office . 2 Name]’s courtroom or you feel that you do not have sufficient Strongly recommend not retain in office . 1 experience with Judge [Last Name] to have an opinion on the judge’s judicial performance, please just return this questionnaire, unanswered, in the enclosed postage-paid envelope, to stop any further requests to evaluate Judge [Last Name]. Thank you for taking the time to complete this questionnaire. Please place it in the self-addressed, postage-paid envelope provided and place it in the mail. Your participation in this survey is very much appreciated. Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please circle the number corresponding to “Don’t Know/Not Applicable”—DK/NA). DK 1. Demeanor: A B C D F N/A a. Giving court proceedings a sense of dignity. 4 3 2 1 0 9 b. Treating participants in the case politely and with respect. 4 3 2 1 0 9 c. Conducting the courtroom in a neutral manner. 4 3 2 1 0 9 d. Having a sense of compassion and human understanding for those who appear before the judge. 4 3 2 1 0 9 Barcode ## Page 33 DK 6. [If you were in [Last Name]’s courtroom during a criminal case or 2. Fairness: A B C D F N/A cases please answer this question, otherwise skip to the next a. Giving participants an opportunity to be heard. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Treating those involved in the case without bias. 4 3 2 1 0 9 number how biased you think Judge [Last Name] is toward the defense or c. Treating fairly people who represent themselves. 4 3 2 1 0 9 the prosecution. If you feel Judge [Last Name] is completely unbiased, circle “0.” d. Giving each side enough time to present their case. 4 3 2 1 0 9 Bias toward Completely Bias toward Defense Neutral Prosecution DK 3. Communications: A B C D F N/A 5 4 3 2 1 0 1 2 3 4 5 a. Makings sure participants understand the proceedings, and what’s going on in the 7. [If you were in [Last Name]’s courtroom during a criminal case or courtroom. 4 3 2 1 0 9 cases please answer this question, otherwise skip to the next b. Using language that everyone can understand. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate c. Speaking clearly so everyone in the courtroom number how lenient or how harsh you think the sentences generally handed can hear what’s being said. 4 3 2 1 0 9 down by [Last Name] are. If you feel Judge [Last Name] generally hands down appropriate sentences, circle “0.” DK 4. Diligence: A B C D F N/A Sentences Appropriate Sentences Too Light Sentences Too Harsh a. Beginning court on time. 4 3 2 1 0 9 b. Maintaining appropriate control over 5 4 3 2 1 0 1 2 3 4 5 proceedings. 4 3 2 1 0 9 c. Setting reasonable schedules for cases. 4 3 2 1 0 9 d. Being prepared for cases. 4 3 2 1 0 9 Though your name will never be associated with your answers, because the judge will e. Managing court proceedings so that there is see a typed transcript of the comments that you and others write, it is important that little wasted time. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. DK 8. What would you say are Judge [Last Name]’s strengths? 5. Application of Law: A B C D F N/A ___________________________________________________________ a. Giving reasons for rulings. 4 3 2 1 0 9 ___________________________________________________________ b. Willing to make decision without regard to ___________________________________________________________ possible outside pressure. 4 3 2 1 0 9 ___________________________________________________________ ___________________________________________________________ c. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 ___________________________________________________________ Continued on Back Page - 2016 Retention Survey Report(PDF on OJPE)
Read full retention survey textexpand
## Page 1 The Honorable E. Dale Boyd 2016 Judicial Performance Survey Report County Court Conducted by: 75 Washington Ave. Ste. 206 Portland, ME 04101 www.marketdecisions.com ## Page 2 Contents Summary of Results . 1 Overall Score . 1 Retention Scores . 2 Individual Category Scores . 3 Summary of Responses . 4 Survey of Attorneys . 5 Methodology and How to Read Results . 5 Retention . 8 Case Management . 9 Application and Knowledge of Law .10 Communications .11 Demeanor .12 Diligence .13 Bias .14 Survey of Non Attorneys .15 Methodology and How to Read Results .15 Retention .18 Demeanor .19 Fairness .20 Communications .21 Diligence .22 Application of Law .23 Bias .24 Perception of Leniency or Harshness .25 i ## Page 3 Summary of Results For Judge E. Dale Boyd, 13 qualified survey respondents submitted surveys. Of those who responded, 12 agreed they had worked with Judge Boyd enough to evaluate his performance. This report reflects these 12 responses. Respondents rated judges on various questions using an A to F (for Fail) scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and 0.0 is the lowest possible score. Overall Score Figure 1 0 1 2 3 4 Combined 3.47 Attorneys 2.98 Total Non-Attorneys 3.71 Juror N/A Non-Attorney Other* 3.71 Table 1 Judge E. Dale Boyd Overall Scores Non-Attorneys Non- Total Non- Combined Attorneys Juror Attorney Attorneys Other* Overall Grade 3.47 2.98 3.71 N/A 3.71 * The Non-Attorney Other category includes law enforcement personnel, defendants, litigants, and witnesses. 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 1 ## Page 4 Retention Scores Figure 2 0% 20% 40% 60% 80% 100% Combined 92% Attorneys 75% Total Non-Attorneys 100% Juror N/A Non-Attorney Other 100% Table 2 Judge E. Dale Boyd Overall Retention Scores Non-Attorneys Total Non- Combined Attorneys Non- Juror Attorney Attorneys Other % Recommending 92% 75% 100% N/A 100% Retention 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 2 ## Page 5 Individual Category Scores Table 3 Judge E. Dale Boyd Overall Category Scores Non-Attorney Non- Area Attorney Total Juror Attorney Other Case Management 3.10 N/A N/A N/A Application and 2.74 3.79 N/A 3.79 Knowledge of Law Communications 3.00 3.83 N/A 3.83 Diligence 3.00 3.55 N/A 3.55 Demeanor 3.08 3.62 N/A 3.62 Fairness N/A 3.78 N/A 3.78 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 3 ## Page 6 Summary of Responses Table 4: Response Rates Undeliverable % Without Response Group Total Sent or Not Complete sufficient Rate Applicable* knowledge** Attorneys 12 0 4 42% 20% Total Non- 105 52 8 15% 0% Attorneys Staff 5 0 2 40% 0% Jurors 0 0 0 NA NA Other Non- 100 52 6 13% 0% Attorneys *Undeliverable or Not Applicable surveys are those that were returned as undeliverable, the person no longer works at the address provided, or the respondent is deceased **The percent without sufficient knowledge are those that said they had insufficient experience to evaluate the judge or justice 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 4 ## Page 7 Survey of Attorneys Methodology and How to Read Results For Judge Boyd, 5 qualified survey respondents submitted surveys. Of those who responded, 4 agreed they had worked with Judge Boyd enough to evaluate his performance. This report reflects these 4 responses. The survey results are divided into nine sections: Retention, Case Management, Application and Knowledge of law, Communications, Demeanor, Diligence, Bias, Strengths, and Weaknesses. The results are shown in both graphs and tables. Each judge’s scores are shown along with a comparison to other judges who serve at the same court level. The comparison group is called “County Judges” on the charts. a. Response rates During the 2015 administration, a total of 13,709 survey invitations were sent to 5,372 attorneys inviting them to evaluate judges and justices standing for retention in 2016. On average, each attorney was asked to evaluate 2.6 judges. 3,738 surveys were completed with an additional 1,818 responses where the attorney indicated that they did not have enough experience with the judge to be comfortable evaluating him or her. The response rate for the survey was 42% and the survey completion rate (the number of those familiar enough to evaluate the judge divided by the total number of attorney responses including those indicating they did not have sufficient familiarity to evaluate the judge) was 67%. b. Methodology The 2015 attorney survey was conducted online beginning on September 16, 2015. Attorneys were first mailed a pre-notification letter sent on September 16, 2015 informing them about the survey and providing a link and login information to access the survey online. Next, a series of three email invitations were sent on September 24th, September 30th, and October 14th. Reminder calls were placed to the offices of selected attorneys in an attempt to increase response rates between November 12th and December 1st. Additional invitations were sent upon request during the reminder calls. Appellate staff attorneys received the same survey as other attorneys, but were invited separately with a series of email invitations starting with the initial invite on October 5th, 2015 and followed by reminders on October 14th and 22nd. To further increase response rates, an additional cycle of data collection took place in January and February 2016. Invitations were emailed to attorneys who had appeared before judges standing for retention in the 3rd and 4th quarters of 2015. The initial invitations were sent on January 19th and reminders were sent on January 29th and February 3rd. 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 5 ## Page 8 c. Questions: In the core of the survey, attorneys evaluated district and county judges on 17 aspects of judicial performance and appellate judges on 12 aspects using a grade scale of A, B, C, D, or F (for Fail). These aspects were grouped by topic into categories, five for district and county judges and two for appellate. The district and county categories were: case management, application and knowledge of law, communications, demeanor, and diligence. Questions regarding appellate judges were divided into two categories, one for general questions and one specific to their writing (which was only asked of those who indicated they had experience with the judge or justice’s written opinions). Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the judge be retained or not retained in office. For this evaluation cycle, the “don’t know enough to make a recommendation” response category was excluded from the retention question. While the formatting and structure of the survey was updated for 2015, the question wording was carried over from the 2014 administration and has remained consistent since 2013. The questions were originally developed in 1998 to meet the criteria outlined in statute 13-5.5-101 et seq. Question Category Areas* Appellate Trial Judge: Judge/Justice Attorney Attorney Survey Survey Question Categories Appellate Judge General Questions 6 Application and Knowledge of Law 5 Case Management 4 Communications 2 Demeanor 3 Diligence 3 Writing 6 Individual Questions Bias 1 Recommendation to Retain 1 1 *The numbers in the table refer to the number of questi ons asked in e ach category by survey group. 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 6 ## Page 9 d. Analysis and Reporting Letter grades were converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0 for analysis. The results include an overall grade, a grade for each category, as well as a grade for each question. The overall score is calculated by averaging the responses to all questions answered by the attorney. This score will have the same numerical range as the individual questions from zero to four. Each category score is calculated by averaging the responses to all questions answered by the attorney with each category. This score will have the same numerical range as the individual questions from zero to four. Similarly, an average score is calculated for each individual question with the exception of the bias and retention questions. The overall average and category scores will be reported for each judge along with the average scores for the judge’s peers. The average score (with exceptions noted above) will also be reported for each question, along with the peer group score. In addition, the report will include the distribution of responses for each question. That is, the percentage of attorneys that assigned a rating of A, B, C, D, and F. The distribution of responses is also reported for the questions on bias and retention. e. Comments At the end of each group of questions, respondents had the option of leaving comments about the judge’s performance in that area. Respondents were also asked what they considered to be the judge’s strengths and weaknesses and were allowed to leave open-ended responses to each. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 7 ## Page 10 Retention Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge E. Dale Boyd be retained in office, or not be retained in office? Table 5 Judge E. Dale Boyd Total Retain 75% Neither 0% Total Not Retain 25% Figure 3 100% 75% 80% 67% 60% 40% 25% 20% 12% 8% 6% 8% 0% Strongly recommend Somewhat Undecided or don't Somewhat Strongly recommend that he or she be recommend he or know enough to recommend he or he or she not be retained in office she be retained in make a she not be retained retained in office office recommendation in office Judge Boyd All County Judges 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 8 ## Page 11 Case Management Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge Boyd on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. Figure 4 3.45 Case Management Overall Average 3.10 3.36 Setting reasonable schedules for cases 3.25 3.46 Promptly ruling on pre-trial motions 3.00 3.47 Maintaining appropriate control over proceedings 3.25 3.61 Promptly issuing a decision on the case after trial 3.33 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 6 Case Management Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 4 Boyd Judges Promptly issuing a decision on the 25% 50% -- -- -- 25% 3.33 3.61 case after trial Maintaining appropriate control 75% -- -- 25% -- -- 3.25 3.47 over proceedings Promptly ruling on pre-trial motions 25% 50% 25% -- -- -- 3.00 3.46 Setting reasonable schedules for 50% 25% 25% -- -- -- 3.25 3.36 cases Case Management Overall Average 3.10 3.45 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 9 ## Page 12 Application and Knowledge of Law Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge Boyd on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. Figure 5 3.27 Application and Knowledge of Law Overall Average 2.74 3.24 Consistently applying laws and rules 2.50 3.16 Being fair and impartial to both sides of the case 2.75 Issuing consistent sentences when the circumstances 3.32 are similar 3.50 3.25 Basing decisions on evidence and arguments 2.50 3.38 Being able to identify and analyze relevant facts 3.00 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 7 Application and Knowledge of Law Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 4 Boyd Judges Being able to identify and analyze 50% 25% -- 25% -- -- 3.00 3.38 relevant facts Basing decisions on evidence and 50% -- -- 50% -- -- 2.50 3.25 arguments Issuing consistent sentences when 25% 25% -- -- -- 50% 3.50 3.32 the circumstances are similar Being fair and impartial to both 25% 50% -- 25% -- -- 2.75 3.16 sides of the case Consistently applying laws and 25% 25% 25% 25% -- -- 2.50 3.24 rules Application and Knowledge of Law Overall Average 2.74 3.27 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 10 ## Page 13 Communications Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge Boyd on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. Figure 6 3.46 Communications Overall Average 3.00 Providing written communications that are clear, 3.33 thorough and well reasoned 3.00 Making sure all participants understand the 3.55 proceedings 3.00 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 8 Communications Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 4 Boyd Judges Making sure all participants 50% 25% -- 25% -- -- 3.00 3.55 understand the proceedings Providing written communications that are clear, thorough and well 50% 25% -- 25% -- -- 3.00 3.33 reasoned Communications Overall Average 3.00 3.46 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 11 ## Page 14 Demeanor Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge Boyd on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. Figure 7 3.36 Demeanor Overall Average 3.08 3.21 Conducting his/her courtroom in a neutral manner 3.00 3.39 Treating participants with respect 3.25 3.47 Giving proceedings a sense of dignity 3.00 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 9 Demeanor Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 4 Boyd Judges Giving proceedings a sense of 50% 25% -- 25% -- -- 3.00 3.47 dignity Treating participants with respect 75% -- -- 25% -- -- 3.25 3.39 Conducting his/her courtroom in a 50% 25% -- 25% -- -- 3.00 3.21 neutral manner Demeanor Overall Average 3.08 3.36 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 12 ## Page 15 Diligence Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge Boyd on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. Figure 8 3.31 Diligence Overall Average 3.00 Being willing to handle cases on the docket even when 3.37 they are complicated and time consuming 3.25 Doing the necessary “homework” and being prepared 3.34 for cases 3.00 Using good judgment in application of relevant law 3.25 and rules 2.75 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 10 Diligence Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 4 Boyd Judges Using good judgment in application of relevant 25% 50% -- 25% -- -- 2.75 3.25 law and rules Doing the necessary “homework” and being 50% 25% -- 25% -- -- 3.00 3.34 prepared for cases Being willing to handle cases on the docket even 75% -- -- 25% -- -- 3.25 3.37 when they are complicated and time consuming Diligence Overall Average 3.00 3.31 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 13 ## Page 16 Bias Having observed Judge Boyd in a criminal case, would you say the judge is: Figure 9 1 0.8 0.6 54% 50% 0.4 28% 25% 25% 0.2 11% 6% 1% 0 Very biased in favor Somewhat biased in Completely Neutral Somewhat biased in Very biased in favor of the prosecution favor of the favor of the defense of the defense prosecution Judge Boyd All County Judges 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 14 ## Page 17 Survey of Non Attorneys Methodology and How to Read Results For Judge E. Dale Boyd, 8 qualified survey respondents submitted surveys. Of those who responded, 8 agreed they had worked with Judge Boyd enough to evaluate his performance. This report reflects these 8 responses. a. Response rates During the 2015 administration, 1,697 survey invitations have been sent to court staff members and 68,393 to other non-attorneys. Among court staff, 787 complete surveys have been received and an additional 192 indicated that they did not have enough experience to evaluate the judge. The response rate among court staff is 58% and the completion rate is 80%. Among other non-attorneys, 4,338 complete surveys have been received and an additional 1,123 indicated that they did not have enough experience to evaluate the judge. The response rate among other non-attorneys is 11% and the completion rate is 80%. b. Methodology The 2015 non-attorney survey was conducted via a mixed mode online and mail survey beginning September 24, 2015 and ending on February 22nd, 2016. Due to the ability to contact court staff via email, respondents were split into two groups for data collection: court staff and other non-attorneys. The court staff group includes staff members, interpreters and probation officers. The other non-attorney group includes jurors, defendants, witnesses, litigants, and law enforcement personnel. Court staff members were invited via emailed invitations sent on October 5th and a reminder sent on October 14th. Other non-attorneys where no email addresses were available were first mailed a pre- notification letter sent on September 24th informing them about the survey and providing a link and login information to access the survey online. This was followed up with a second mailing that also included the information to access the survey online, as well as a full printed survey booklet and postage-paid return envelope. This second mailing was sent on October 19, 2015. The process for other non-attorneys was repeated in January and February 2016 for those that had experience with judges standing for retention in the 3rd and 4th quarters of 2015. For this cycle, the order of the mailings was switched due to the constraints of the reporting schedule. The first mailing, sent on January 22nd, included the full survey booklet and a return mailing envelope as well as instructions to access the survey online. The second mailing, sent on 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 15 ## Page 18 February 12th, included only a letter with instructions to complete the survey online and reminded them of the survey closing on February 22nd. c. Questions: Respondents evaluated judges on 19 aspects of judicial performance using a grade scale of A, B, C, D, or F (for Fail). Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. Non-attorneys were also asked to evaluate the appropriateness of the sentencing. In a final question, respondents were asked to indicate how strongly they would recommend that the judge be retained or not retained in office. For this evaluation cycle, the “don’t know enough to make a recommendation” response category was excluded from the retention question. Question Category Areas* Other Non- Court Staff attorneys Question Categories Application of Law 3 3 Communications 3 3 Demeanor 4 4 Diligence 5 5 Fairness 4 4 Individual Questions Bias 1 1 Appropriateness of Sentence 1 1 Recommendation to Retain 1 1 *The numbers in the table refer to the number of questi ons asked in ea ch category by survey group. d. Analysis and Reporting Letter grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0 for analysis. The results include an overall grade, a grade for each category, as well as a grade for each question. The overall score is calculated by averaging the responses to all questions answered. This score will have the same numerical range as the individual questions from zero to four. Each category score is calculated by averaging the responses to all questions answered by the attorney with each category. This score will have the same numerical range as the individual questions from zero to four. Similarly, an average score is calculated for each individual question with the exception of the bias and retention questions. The overall average and category scores will be reported for each judge along with the average scores for the judge’s peers. The average score (with exceptions noted above) will also be reported for each question, along with the peer group score. In addition, the report will include 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 16 ## Page 19 the distribution of responses for each question. That is, the percentage of attorneys that assigned a rating of A, B, C, D, and F. The distribution of responses are also reported for the questions on bias and retention as well as appropriateness of sentences. e. Comments: At the end of each group of questions, respondents had the option of leaving comments about the judge’s performance in that area. Respondents were also asked what they considered to be the judge’s strengths and weaknesses and allowed to leave open ended responses to each. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 17 ## Page 20 Retention Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge Boyd be retained in office, or not retained in office? Table 11 Judge E. Dale Boyd Total Retain 100% Neither 0% Total Not Retain 0% Figure 10 100% 75% 80% 71% 60% 40% 25% 16% 20% 5% 3% 5% 0% Strongly recommend Somewhat Undecided or don't Somewhat Strongly recommend that he or she be recommend he or know enough to recommend he or he or she not be retained in office she be retained in make a she not be retained retained in office office recommendation in office Judge Boyd All County Judges 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 18 ## Page 21 Demeanor Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please mark “Don’t Know/Not Applicable”—DK/NA). Figure 11 3.59 Demeanor Overall Average 3.62 Having a sense of compassion and human 3.56 understanding for those who appear before him/her 3.75 3.56 Conducting his/her courtroom in a neutral manner 3.62 3.64 Treating participants with respect 3.75 3.61 Giving proceedings a sense of dignity 3.38 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 12 Demeanor Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 8 Boyd Judges Giving proceedings a sense of dignity 38% 63% -- -- -- -- 3.38 3.61 Treating participants with respect 75% 25% -- -- -- -- 3.75 3.64 Conducting his/her courtroom in a neutral 63% 38% -- -- -- -- 3.62 3.56 manner Having a sense of compassion and human understanding for those who appear before 75% 25% -- -- -- -- 3.75 3.56 him/her Demeanor Overall Average 3.62 3.59 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 19 ## Page 22 Fairness Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please mark “Don’t Know/Not Applicable”—DK/NA). Figure 12 3.60 Fairness Overall Average 3.78 Giving each side enough time to present his or her 3.63 case 3.87 3.56 Treating fairly people who represent themselves 3.75 3.55 Treating those involved in the case without bias 3.62 3.64 Giving participants an opportunity to be heard 3.87 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 13 Fairness Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 8 Boyd Judges Giving participants an opportunity 88% 13% -- -- -- -- 3.87 3.64 to be heard Treating those involved in the case 63% 38% -- -- -- -- 3.62 3.55 without bias Treating fairly people who 75% 25% -- -- -- -- 3.75 3.56 represent themselves Giving each side enough time to 88% 13% -- -- -- -- 3.87 3.63 present his or her case Fairness Overall Average 3.78 3.60 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 20 ## Page 23 Communications Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please mark “Don’t Know/Not Applicable”—DK/NA. Figure 13 3.68 Communications Overall Average 3.83 Speaking clearly so everyone in the courtroom can 3.71 hear what’s being said 3.87 3.68 Using language that everyone can understand 3.87 Making sure all participants understand the 3.66 proceedings 3.75 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 14 Communications Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 8 Boyd Judges Making sure all participants 75% 25% -- -- -- -- 3.75 3.66 understand the proceedings Using language that everyone can 88% 13% -- -- -- -- 3.87 3.68 understand Speaking clearly so everyone in the courtroom can hear what’s 88% 13% -- -- -- -- 3.87 3.71 being said Communications Overall Average 3.83 3.68 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 21 ## Page 24 Diligence Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please mark “Don’t Know/Not Applicable”—DK/NA. Figure 14 3.60 Diligence Overall Average 3.55 Managing court proceedings so that there is little 3.56 wasted time 3.38 3.63 Setting reasonable schedules for cases 3.87 3.69 Maintaining appropriate control over proceedings 3.62 Doing the necessary “homework” and being prepared 3.65 for cases 3.57 3.54 Beginning court on time 3.29 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 15 Diligence Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 8 Boyd Judges Beginning court on time 29% 71% -- -- -- -- 3.29 3.54 Doing the necessary “homework” 50% 38% -- -- -- 13% 3.57 3.65 and being prepared for cases Maintaining appropriate control 63% 38% -- -- -- -- 3.62 3.69 over proceedings Setting reasonable schedules for 88% 13% -- -- -- -- 3.87 3.63 cases Managing court proceedings so 38% 63% -- -- -- -- 3.38 3.56 that there is little wasted time Diligence Overall Average 3.55 3.60 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 22 ## Page 25 Application of Law Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please mark “Don’t Know/Not Applicable”—DK/NA. Figure 15 3.55 Application and Knowledge of Law Overall Average 3.79 3.54 Being able to identify and analyze relevant facts 3.87 Willing to make decision without regard to possible 3.54 outside pressure 3.75 3.56 Giving reasons for rulings 3.71 0.00 1.00 2.00 3.00 4.00 All County Judges Judge Boyd Table 16 Application of Law Judge E. Dale Boyd All Judge A B C D Fail DK/NA County Number of Responses: 8 Boyd Judges Giving reasons for rulings 71% 29% -- -- -- -- 3.71 3.56 Willing to make decision without 75% 25% -- -- -- -- 3.75 3.54 regard to possible outside pressure Being able to identify and analyze 88% 13% -- -- -- -- 3.87 3.54 relevant facts Application and Knowledge of Law Overall Average 3.79 3.55 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 23 ## Page 26 Bias On the scale below, please indicate by selecting the appropriate number how biased you think Judge Boyd is toward the defense or the prosecution. If you feel Judge Boyd is completely unbiased, select “0.” Figure 16 100% 80% 80% 63% 60% 40% 25% 20% 13% 4% 7% 5% 3% 0% Very biased in favor Somewhat biased in Completely Neutral Somewhat biased in Very biased in favor of the prosecution favor of the favor of the defense of the defense prosecution Judge Boyd All County Judges 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 24 ## Page 27 Perception of Leniency or Harshness On the scale below, please indicate by selecting the appropriate number how lenient or how harsh you think the sentences generally handed down by Judge Boyd are. If you feel Judge Boyd generally hands down appropriate sentences, circle “0.” Table 17 100% 80% 63% 63% 60% 40% 25% 20% 13% 5% 2% 2% 2% 0% Sentences too Light 2.00 Sentences are 4.00 Sentences are too Appropriate Harsh Judge Boyd All County Judges 2016 Judicial Performance Survey Report for Judge E. Dale Boyd 25
- 2012 cycle
- 2011 Interim Survey Report(PDF on OJPE)
Read full interim survey textexpand
## Page 1 State of Colorado Logo COMMISSION ON JUDICIAL PERFORMANCE TThhee HHoonnoorraabbllee EE.. DDaallee BBooyydd 2011 Interim Judicial Performance Survey 22nd Judicial District ## Page 2 May 6, 2011 The Honorable E. Dale Boyd Dolores County Courthouse P.O. Box 511 Dove Creek, CO 81324 Dear Judge Boyd: I am pleased to make available to you the attached copy of your 2011 Interim Judicial Performance Survey Report. The report is based on two surveys relating to how you are seen carrying out the performance of your office: One of attorneys who have had cases in your court or who are knowledgeable about your judicial performance, second a survey of non-attorneys who have observed your performance in court or who have otherwise been affected by your performance as a judge. In addition to this introduction, the report is divided into five main sections: 1. A brief summary of the results of the two surveys. 2. The numerical results of the survey of attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments attorneys made about your judicial performance. In some instances the comments have been redacted to eliminate respondent identifying information. A copy of the attorney questionnaire is included in the final section of this report. 3. The numerical results of the survey of non-attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments these respondent made on the subject of your judicial performance. In few instances the comments have been redacted to eliminate respondent identifying information. A copy of the non-attorney questionnaire is included in the final section of this report. 4. The fourth section of the Report discusses the methodology of the surveys. 5. The final section provides copies of the questions or questionnaires that were used for each survey. 100 Arap ahoe, Suite One, Boulder, CO 80302 Phone 303.443.5300 Fax 303.200.7385 ## Page 3 Hon. E. Dale Boyd May 6, 2011 Page 2 If you have any questions about the methodology and how the survey was conducted, please feel free to contact me at 303-443-5300 ext 1 or by email at talmey@talmeyresearch.com (please put the words “Judicial Performance” in the subject line), and for any other questions you might have about the survey please call the Executive Director of the Office of Judicial Performance Evaluation, Jane Howell, at 303-866-6465. Best regards, Paul A. Talmey President enc: ## Page 4 SSuummmmaarryy ooff RReessuullttss bbyy YYeeaarr aanndd JJuurroorr//NNoonn--JJuurroorr On average, county judges received an overall combined average grade in the 2011 Interim Judicial Performance Survey of 3.45--the overall average grade received from attorney respondents, 3.33, to the survey plus the overall average grade received from non-attorney respondents, 3.56, divided by two. Based on an average attorney grade of 2.90, and an average non-attorney grade of 3.48, Judge E. Dale Boyd’s combined grade for the 2011 Interim Judicial Performance Survey of 3.19. Judge Boyd Average Grade Combined Attorney Non-attorney Overall Grade 3.19 2.90 3.48 Sample Size - 6 41 Table 1 The results presented in this report are based on data from cases heard and closed by Judge Boyd from 2007 through 2010. (See Methodology section for description of sampling process.) Table 2 shows Judge Boyd’s overall average grades for each of these years. Judge Boyd Average Grades by Year Combined Attorney Non-Attorney Average Average Sample Average Sample Year Score Score Size Score Size 2007 3.33 9 2008 3.03 2.25 1 3.80 6 2009 3.35 3.23 3 3.47 17 2010 3.08 2.74 2 3.42 9 Overall 3.19 2.90 6 3.48 41 Table 2 Due to sending questionnaires to all jurors—not just a sample—and their much higher response rate than other non-attorneys surveyed, the percentage of jurors in the county judge sample of the non-attorney survey is 54%. Moreover, jurors tend to grade judges much higher than non-jurors. The juror overall average grade for county judges was 3.83, while the overall average grade awarded by non-jurors was 3.26. The effect of this is that judges with a higher percentage of jurors in their sample tend to have higher average grades in the non-attorney survey than those judges with a small percentage of 1 ## Page 5 jurors. The number of jurors in a judge’s sample is, of course, closely related to the number of jury trials the judge presides over. The table below shows Judge Boyd’s non-attorney results broken out by jurors and non- jurors for each year from 2007 to 2010. It also shows the overall average juror and non- juror grades for all county judges. Judge Boyd Average Grades by Year Jurors Non-Jurors All County Judges Average Sample Average Sample Juror Non-Juror Year Score Size % Score Size % Average Average 100 2007 % 3.33 9 % 3.82 3.30 100 2008 % 3.80 6 % 3.82 3.26 100 2009 % 3.47 17 % 3.83 3.22 100 2010 % 3.42 9 % 3.85 3.25 100 All Yrs. % 3.48 41 % 3.83 3.26 Table 3 Table 3 allows one to compare Judge Boyd’s juror and non-juror grades with the all county judge averages to better ascertain if the judge is seen as performing relatively well or relatively poorly among these two subgroups. 2 ## Page 6 3 ## Page 7 SSuurrvveeyy ooff AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee EE.. DDaallee BBooyydd ((SSaammppllee SSiizzee 66)) ## Page 8 Survey of Attorneys Regarding Trial Judges Average Judge E. Dale Boyd All County Sample Size = 6 A B C D Fail DK/NA E. Dale Boyd Judges 1. Case Management: 1a. Promptly issuing a decision on the case after trial. 17% 50% 17% 0% 0% 17% 3.00 3.52 1b. Maintaining appropriate control over proceedings. 33% 33% 33% 0% 0% 0% 3.00 3.44 1c. Promptly ruling on pre-trial motions. 17% 33% 17% 0% 0% 33% 3.00 3.39 1d. Setting reasonable schedules for cases. 33% 50% 17% 0% 0% 0% 3.17 3.39 Overall Case Management 3.04 3.44 2. Application and Knowledge of Law: 2a. Being able to identify and analyze relevant facts. 0% 50% 50% 0% 0% 0% 2.50 3.29 2b. Basing decisions on evidence and arguments. 17% 33% 50% 0% 0% 0% 2.67 3.16 2c. Willing to reconsider error in fact or law. 33% 33% 17% 0% 0% 17% 3.20 3.07 2d. Issuing consistent sentences when the circumstances are 20% 40% 20% 20% 0% 0% 2.60 3.27 similar. Overall Application and Knowledge of Law 2.74 3.20 3. Communications: 3a. Making sure all participants understand the proceedings. 33% 50% 17% 0% 0% 0% 3.17 3.53 3b. Providing written communications that are clear, thorough 0% 17% 33% 0% 0% 50% 2.33 3.30 and well reasoned. Overall Communications 2.75 3.42 4. Demeanor: 4a. Giving proceedings a sense of dignity. 17% 50% 17% 17% 0% 0% 2.67 3.43 4b. Treating parties with respect. 50% 33% 17% 0% 0% 0% 3.33 3.43 4c. Conducting his/her courtroom in a neutral manner. 50% 33% 0% 17% 0% 0% 3.17 3.26 4d. Consistently applying laws and rules. 33% 0% 50% 0% 0% 17% 2.80 3.27 Overall Demeanor 2.99 3.35 5. Diligence: 5a. Using good judgment in application of relevant law and 17% 50% 17% 17% 0% 0% 2.67 3.20 rules. 5b. Doing the necessary homework and being prepared for 33% 33% 33% 0% 0% 0% 3.00 3.28 his/her cases. 5c. Being willing to handle cases on the docket even when 0% 17% 0% 0% 0% 83% 3.00 3.39 they are complicated and time consuming. Overall Diligence 2.89 3.29 Overall Average Grade: 2.90 3.33 2011 Interim Judicial Performance Survey 5 ## Page 9 Survey of Attorneys Regarding Trial Judges Percentage Judge E. Dale Boyd All County E. Dale Boyd Judges Sample Size = 6 Would you say the judge is: Very biased in favor of the prosecution 0% 9% Somewhat biased in favor of the prosecution 20% 28% Completely neutral 60% 50% Somewhat biased in favor of the defense 20% 6% Very biased in favor of the defense 0% 2% Don't know or not sure 0% 5% 8. How strongly do you recommend that the Judge be retained in office, or not be retained in office? [Percentages excluding undecided responses.] Strongly recommend retain 83% 71% Somewhat recommend retain 0% 17% Somewhat recommend not retain 17% 6% Strongly recommend not retain 0% 7% Total Retain 83% 88% Total Not Retain 17% 13% [Percentages including undecided responses.] Strongly recommend retain 83% 68% Somewhat recommend retain 0% 16% Undecided or Don't Know 0% 5% Somewhat recommend not retain 17% 6% Strongly recommend not retain 0% 6% Total Retain 83% 84% Undecided/Don't Know 0% 5% Total Not Retain 17% 12% 2011 Interim Judicial Performance Survey 6 ## Page 10 Judge E. Dale Boyd Survey of Attorneys Regarding Trial Judges Average Grades 2.90 Overall Average Grade 3.33 Q1. Overall Case Management 3.04 3.44 1a. Promptly issuing a decision on the 3.00 case after trial. 3.52 1b. Maintainingappropriate control over 3.00 proceedings. 3.44 3.00 1c. Promptlyruling on pre-trial motions. 3.39 1d.Setting reasonable schedules for cases. 3.17 3.39 2.74 Q2. OverallApp & Knowledge of Law 3.20 2a. Beingable to identify and analyze 2.50 relevant facts. 3.29 2b.Basing decisions on evidence and argument. 2.67 3.16 3.20 2c. Willing to reconsider error in fact or law. 3.07 2d. [Criminal only] Issuing consistant sentences 2.60 whencircumstances are simmilar. 3.27 2.75 Q3. Overall Communication 3.42 3a.Making sure all participants understand 3.17 the proceedings. 3.53 3b. Providing written communications that are 2.33 clear, thorough and well reasoned. 3.30 2.0 2.5 3.0 3.5 4.0 E. Dale Boyd All County Judges Judge E. Dale Boyd 7 2011 Interim Judicial Performance Survey ## Page 11 Judge E. Dale Boyd Survey of Attorneys Regarding Trial Judges Average Grades 2.99 Q4. Overall Demeanor 3.35 2.67 4a. Giving proceedingsa sense of dignity. 3.43 3.33 4b. Treating participants with respect. 3.43 4c. Conducting [his/her] courtroom 3.17 in a neutral manner. 3.26 2.80 4d. Consistanly applyinglaws and rules. 3.27 2.89 Q5. Overall Diligence 3.29 5a. Using good judgement in application of 2.67 releveant laws and rules. 3.20 5b. Doing the necessary 'homework' and 3.00 being prepared for [his/her] cases. 3.28 5c. Being willing to handle cases on the docket even 3.00 when they are complicated and time consuming. 3.39 2.0 2.5 3.0 3.5 4.0 Biased in favor of prosecution/defense. 0% Very biased in favor of the prosecution 9% 20% Somewhat biased in favor of the prosecution 28% 60% Completely Neutral 50% 20% Somewhat biased in favor of the defense 6% 0% Very biased in favor of the defense 2% 0% Don't know/not sure 5% 0% 10% 20% 30% 40% 50% 60% 70% E. Dale Boyd All County Judges 8 2011 Interim Judicial Performance Survey ## Page 12 Judge E. Dale Boyd Survey of Attorneys Regarding Trial Judges Q8. How strongly do you recommend that Judge Boyd be retained or not retained in office? Excluding Undecided Respondents 83% Strongly recommend retain 71% 0% Somewhat recommend retain 17% All Cnty Judge Boyd Judges 17% Total Retain 83% 88% Somewhat recommend not retain Total Not Retain 17% 13% 6% 0% Strongly recommend not retain 7% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Including Undecided Respondents 83% Strongly recommend retain 68% 0% Somewhat recommend retain 16% All Cnty 0% Judge Boyd Judges Undecided or DK 5% Total Retain 83% 84% Undecided or DK 0% 5% 17% Somewhat recommend not retain Total Not Retain 17% 12% 6% 0% Strongly recommend not retain 6% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% E. Dale Boyd All County Judges 9 2011 Interim Judicial Performance Survey ## Page 13 SSuurrvveeyy ooff NNoonn--AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee EE.. DDaallee BBooyydd ((SSaammppllee SSiizzee 4411)) ## Page 14 Survey of Non-Attorneys Regarding Trial Judges Average Judge E. Dale Boyd All County Sample Size = 41 A B C D Fail DK/NA E. Dale Boyd Judges 1. Demeanor: 1a. Giving court proceedings a sense of dignity. 61% 24% 5% 0% 5% 5% 3.44 3.59 1b. Treating participants in the case politely and with respect. 78% 10% 2% 2% 5% 2% 3.58 3.61 1c. Conducting court in a neutral manner. 73% 15% 0% 0% 10% 3% 3.44 3.55 1d. Having a sense of compassion and human understanding 68% 15% 7% 5% 2% 2% 3.45 3.47 for those who appear before the court. Overall Demeanor 3.48 3.56 2. Fairness: 2a. Giving participants an opportunity to be heard. 80% 5% 2% 5% 5% 2% 3.55 3.59 2b. Treating those involved in the case without bias. 73% 10% 2% 0% 10% 5% 3.44 3.52 2c. Treating fairly people who represent themselves. 63% 7% 7% 0% 5% 17% 3.50 3.51 2d. Giving each side enough time to present his or her case. 71% 12% 0% 7% 5% 5% 3.44 3.59 Overall Fairness 3.48 3.55 3. Communications: 3a. Making sure participants understand the proceedings, and 73% 12% 7% 2% 2% 2% 3.55 3.64 what is going on in the courtroom. 3b. Using language that everyone can understand. 75% 13% 3% 5% 0% 5% 3.66 3.66 3c. Speaking clearly so everyone in the courtroom can hear 78% 5% 8% 3% 0% 8% 3.70 3.69 what is being said. Overall Communications 3.64 3.66 4. Diligence: 4a. Beginning court on time 63% 18% 15% 0% 0% 5% 3.50 3.45 4b. Maintaining appropriate control over proceedings. 71% 15% 2% 2% 7% 2% 3.43 3.67 4c. Setting reasonable schedules for cases. 73% 7% 10% 5% 0% 5% 3.56 3.56 4d. Being prepared for cases. 68% 15% 0% 7% 5% 5% 3.41 3.61 4e. Managing court proceedings so that there is little wasted 68% 17% 5% 5% 2% 2% 3.48 3.50 time. Overall Diligence 3.48 3.56 5. Application of Law: 5a. Giving reasons for rulings. 61% 20% 7% 2% 7% 2% 3.28 3.50 5b. Willing to make decisions without regard to possible 66% 7% 5% 2% 10% 10% 3.30 3.52 outside pressure. 5c. Being able to identify and analyze relevant facts. 68% 15% 0% 2% 10% 5% 3.36 3.50 Overall Application of Law 3.31 3.51 Overall Average Grade: 3.48 3.56 2011 Interim Judicial Performance Survey 11 ## Page 15 Survey of Non-Attorneys Regarding Trial Judges Percentage Judge E. Dale Boyd All County E. Dale Boyd Judges Sample Size = 41 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 4% 12% Competely neutral 83% 81% Biased in favor of the defense total 12% 7% [A positive average indicates bias toward prosecution, and a Average -0.25 0.12 negative average indicates a bias toward the defense.] 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 4% 12% Competely neutral 78% 77% Lenient sentencing total 17% 11% [A positive average indicates sentences are harsh, and a Average -0.13 0.06 negative average indicates sentences are lenient.] 10. How strongly do you recommend that the Judge be retained or not retained in office? [Percentages excluding undecided responses.] Strongly recommend retain 84% 84% Somewhat recommend retain 5% 8% Somewhat recommend not retain 3% 2% Strongly recommend not retain 8% 6% Total Retain 89% 92% Total Not Retain 11% 8% [Percentages including undecided responses.] Strongly recommend retain 82% 77% Somewhat recommend retain 5% 8% Undecided or Don't Know 3% 8% Somewhat recommend not retain 3% 2% Strongly recommend not retain 8% 5% Total Retain 87% 85% Undecided/Don't Know 3% 8% Total Not Retain 11% 7% 2011 Interim Judicial Performance Survey 12 ## Page 16 Judge E. Dale Boyd Survey of Non-Attorneys Regarding Trial Judges Average Grades 3.48 Overall Average Grade 3.56 3.48 Q1. Overall Demeanor 3.56 3.44 1a. Giving proceedings a sense of dignity. 3.59 1b. Treating participants politely and with respect. 3.58 3.61 1c. Conducting the courtroom in a neutral 3.44 manner. 3.55 1d. Having a sense of compassion and human 3.45 understanding for those who appear before the judge. 3.47 3.48 Q2. Overall Fairness 3.55 2a. Giving participants an opportunity to be 3.55 heard. 3.59 2b. Treating those involved in the 3.44 case without bias. 3.52 2c. Treats people fairly who represent 3.50 themselves. 3.51 2d. Giving each side enough time to present his 3.44 or her case. 3.59 3.64 Q3. Overall Communtications 3.66 3a. Making sure participants understand the 3.55 proceedings, and what's going on in the courtroom. 3.64 3b. Using language that everyone can 3.66 understand. 3.66 3c. Speaking clearly so everyone in the courtroom 3.70 can hear what's being said. 3.69 2.0 2.5 3.0 3.5 4.0 E. Dale Boyd All County Judges Judge E. Dale Boyd 13 2011 Interim Judicial Performance Survey ## Page 17 Judge E. Dale Boyd Survey of Non-Attorneys Regarding Trial Judges Average Grades 3.48 Q4. Overall Diligence 3.56 3.50 4a. Beginning court on time. 3.45 4b. Maintaining appropriate control over 3.43 proceedings. 3.67 4c. Setting reasonable schedules for cases. 3.56 3.56 4d. Being prepared for his or her cases. 3.41 3.61 4e. Managing court proceedings so that there is 3.48 little wasted time. 3.50 3.31 Q5. Overall Legal Ability 3.51 5a. Giving reasons for rulings. 3.28 3.50 5b. Willing to make decision without regard to 3.30 possible outside pressure. 3.52 5c. Being able to identify and analyze 3.36 relevant facts. 3.50 2.0 2.5 3.0 3.5 4.0 Q6 Biased in favor of prosecution/defense. -0.25 E. Dale Boyd 0.12 All County Judges -5 -4 -3 -2 -1 0 1 2 3 4 5 Defense Prosecution Q7 Lenience or Harshness in Sentencing. -0.13 E. Dale Boyd 0.06 All County Judges -5 -4 -3 -2 -1 0 1 2 3 4 5 Lenient Harsh E. Dale Boyd All County Judges 14 2011 Interim Judicial Performance Survey ## Page 18 E. Dale Boyd All County Judges Judge E. Dale Boyd Survey of Non-Attorneys Regarding Trial Judges Q10. How strongly do you recommend that Judge Boyd be retained or not retained in office? Excluding Undecided Respondents 84% Strongly recommend retain in office 84% 5% Somewhat recommend retain in office 8% All Cnty Judge Boyd Judges Total Retain 89% 92% 3% Somewhat recommend not retain in office Total Not Retain 11% 8% 2% 8% Strongly recommend not retain in office 6% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Including Undecided Respondents 82% Strongly recommend retain in office 77% 5% Somewhat recommend retain in office 8% 3% All Cnty Undecided 8% Judge Boyd Judges Total Retain 87% 85% 3% Undecided 3% 8% Somewhat recommend not retain in office 2% Total Not Retain 11% 7% 8% Strongly recommend not retain in office 5% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% E. Dale Boyd All County Judges 15 2011 Interim Judicial Performance Survey ## Page 19 MMeetthhooddoollooggyy ## Page 20 MMeetthhooddoollooggyy The results shown in the 2011 Interim Judicial Performance Survey Report are based on two surveys: The Survey of Attorneys Regarding Trial Judges, and the Survey of Non- Attorneys Regarding Trial Judges. Below is a description of the methodology used in the two surveys. I Attorneys Regarding Trial Judges a. Sample: Talmey-Drake Research & Strategy received case data with the names of people who had likely been in each judge’s courtroom from five primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Denver County Courts District Attorney’s Office, Second Judicial District (Denver) District Attorney’s Office, Ninth Judicial District Additional information was provided by the State Public Defender’s Office and the courts in the 1st and 18th Judicial Districts. The data from these different data sources are combined, duplicates removed and addresses corrected. i. Prior to 2009, the survey of Attorneys Regarding Trial Judges was conducted using paper questionnaires mailed to the attorneys’ offices. A sample of attorneys drawn from the case data were assigned to evaluate judges subject to the following rules applied in the order shown. 1. No attorney would be asked to evaluate the same judge in a 24-month period. 2. If an attorney was eligible to evaluate both a trial judge and an appellate judge, the attorney was assigned to evaluate the appellate judge. 3. If there were several judges the attorney could potentially evaluate, the attorney was assigned the judge with whom he or she had had the most cases during the sampling time frame, or the judge with the smallest sample in order to even out sample sizes among judges. Attorneys were mailed a questionnaire, and if they did not respond they were sent a reminder postcard followed by a second questionnaire and in some cases a second reminder postcard. Questionnaires were barcoded, and if an attorney mailed back two questionnaires, the second one was deleted from the data file. Attorneys who did not complete the survey after the second request were then telephoned and asked to complete the survey by phone. 17 ## Page 21 ii. In 2009 the Attorneys Regarding Trial Judges Survey moved from being a paper survey mailed to potential respondents to an online survey. Moving the survey to online permitted asking individual attorneys to evaluate up to five trial judges, and with the exception of the effects of the modified assignment rules 1 through 3 below, it became a survey of all attorneys who had cases before trial judges. Allowing an attorney to evaluate up to five judges, entailed slightly modifying the assignment rules: 1. No attorney would be asked to evaluate the same justice or judge in a 24-month period. 2. If an attorney was eligible to evaluate both a trial judge and an appellate judge, the attorney was assigned to evaluate the appellate judge. 3. If there were more than five judges who could be assigned to the attorney, the attorney was assigned the judges with whom he or she had had the most cases during the sampling time frame, or the judges with the smallest samples in order to even out sample sizes among judges. Attorneys were first mailed a letter about the online survey to let them know that they would soon receive an email with a link to the survey. The Web address of the survey and a password were included in the letter if the attorney wanted to complete the survey immediately. A week after the first email was sent, a follow-up email was sent. Potential respondents who did not complete the survey after the second email were then telephoned and asked to either complete the survey then by phone, or to please complete it online. iii. In 2010, and going forward, rule #2 above was changed so that an attorney could be asked to evaluate a combination of up to seven trial judges or Court of Appeals judges, if the attorney had had a case before the COA. Attorneys who had cases before the both the Supreme Court and trial judges during the sample time frame were asked to evaluate all seven Supreme Court justices, and not asked to evaluate the trial judges. The results shown in the 2011 Interim Judicial Performance Survey Report for the Attorneys Regarding Trial Judges survey are based on the combined survey results collected from January 2005 through March 30, 20111 for those questions that have been consistently asked during that time period. Since 2010, the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the justice’s or judge’s term of office: ten years for a Supreme Court justice, eight years for a COA judge, six years for a district judge and four years for a county judge. To use a district judge as an example: as survey data is collected it is pooled together for six years. After six years, as new data is added to the judge’s survey results in the first quarter of the seventh year, the oldest quarter of data in the pool is deleted. The current data for all judges only goes back as far as 2005—or the year the judge took the bench—therefore the rolling of the survey results only affects the county judge sample in the 2011 Interim reports. 1 The State Commission on Judicial Performance authorized continuous surveying in 2007. Prior to 2007 data was only collected in the odd numbered years before the retention reports were issued. Therefore, while data was gathered in 2005 and 2007 through the 1st quarter of 2011, and used in this report, there was no data collected in 2006. 18 ## Page 22 b. Questions: The survey questions asked respondents to use a grade of A, B, C, D, or F to assess the justice or judge's performance on twelve aspects of judicial performance. (See Questionnaire section.) These grades were then converted to a numerical scores where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the justice or judge be retained or not retained in office. c. Comments: In addition to the A through F questions, respondents were also asked what they considered to be the judge’s strengths and what they considered to be the judge’s weaknesses. By statute these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. Since 2005 there have been changes to the number of comment questions asked, though the strengths and weaknesses questions have been posed in every survey. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. Most spelling and typographical errors have been fixed, but where the respondent entered a comment in all upper or all lower case, or without punctuation, the comment was not corrected. d. Analysis: The Attorneys Regarding Trial Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all district judges and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all district judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. 19 ## Page 23 The next table shows the percentage distribution of the responses to the question about recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all district judges. The percentages are shown both including and excluding “don’t know/undecided” responses. The next page displays the question averages in horizontal bar-graph form. The percentage distribution to the retention question is then presented in the graph on the next page. The third part of the Attorneys Regarding Trial Judges section of the report lists the comments the attorney made about the judge’s strengths and weaknesses. e. Cooperation Rate: The overall response rate for the Attorneys Regarding Trial Judges Survey is calculated as the number of completed survey-evaluations (the number of judges an attorney chose to evaluate) divided by the number of possible evaluations (the number of judges the attorney could have evaluated) resulting in an overall response rate of 43.3% for district judges and 33.4% for county judges. An equivalent response rate for an individual judge is computed as the number of completed survey-evaluations for that judge divided by the number of possible evaluations that could have been completed for the judge. Since 2009 attorneys have generally been asked to evaluate multiple judges per survey cycle, which affects the way cooperation rates are calculated and results in what appear to be lower overall cooperation rates. However, comparing the percentage of unique attorneys who responded to the mail surveys conducted from 2005 to 2008 to the percentage of unique attorneys who responded to the online surveys conducted from 2009 to the first quarter of 2011 yields very similar percentages. From 2005 to 2008 6,347 unique attorneys were asked to participate in the Judicial Performance mail surveys. Four thousand three (3,984), or 62.8%, responded with a completed questionnaire. Similarly, from 2009 through the first quarter 2011 Talmey-Drake asked 7,589 unique attorneys to participate in the Judicial Performance online survey, of which an almost identical percentage, 62.9% (4,777 attorneys) responded with one or more completed survey-evaluations of a judge. On average each attorney responding to the online survey request evaluated 3.7 judges. 2 2 Because Talmey-Drake deletes survey results associated with judges who are no longer on the bench, the counts used in this paragraph refer only to data collected regarding trial judges who are active at this writing. 20 ## Page 24 II Non-Attorneys Regarding Trial Judges a. Sample: Talmey-Drake Research & Strategy received case data with the names of non-attorneys who had likely been in each judge’s courtroom from five primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Denver County Courts District Attorney’s Office, Second Judicial District (Denver) District Attorney’s Office, Ninth Judicial District The data from these different data sources are combined, duplicates removed and addresses corrected. Depending on the number of names available to be sampled for each judge, a random sample was drawn if the quantity of potential respondents was large. On the other hand, if the count of possible respondents was small, all potential respondents were included in the sample. Where a person had been in more than one judge’s courtroom, the selection criteria for which judge he or she would be sent a questionnaire was generally for the judge in whose courtroom the potential respondent had been in most often. Each person whose name was sampled for the Non-Attorney Survey was mailed an initial postcard informing the recipient that he or she would be receiving a questionnaire. Two to three weeks after the post card was mailed, the potential respondent was sent a personalized introductory letter and a questionnaire with a postage-paid return envelope. If the person did not respond, a second questionnaire and letter were sent approximately four weeks later. Questionnaires are barcoded, and if a respondent mailed back two questionnaires, the second one was deleted from the data file. Since in 2010, non-attorney section of the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the judge’s term of office: six years for a district judge and four years for a county judge. To use a district judge as an example: as survey data is collected it is pooled together for six years. After six years, as new data is added to the judge’s survey results in the first quarter of the seventh year, the oldest quarter of data in the pool is deleted. The current data for all judges only goes back as far as 2005—or the year the judge took the bench—therefore the rolling of the survey results only affects the county judge sample in the 2011 Interim reports. 3 3 The State Commission on Judicial Performance authorized continuous surveying in 2007. Prior to 2007 data was only collected in the odd numbered years before the retention reports were issued. Therefore, while data was gathered in 2005 and 2007 through the 1st quarter of 2011, and used in this report, there was no data collected in 2006. 21 ## Page 25 b. Questions: The survey questions asked respondents to use a grade of A, B, C, D, or F to assess the justice or judge's performance on twelve aspects of judicial performance (See Questionnaire section.) These grades were then converted to a numerical scores where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the justice or judge be retained or not retained in office. A copy of the questionnaire is included in the last section of this report. c. Analysis: The Non-Attorneys Regarding Trial Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all district judges and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all district judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the questions about prosecution or defense bias and recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all district judges. The percentages for the retention question are shown including and excluding “don’t know/undecided” responses. The next page displays the question averages in horizontal bar-graph form. The percentage distribution of the prosecution-defense bias and retention questions are then presented in the graph on the next page. The third part of the Non-Attorneys Regarding Trial Judges section of the report lists the comments the attorney made about the judge’s strengths and weaknesses. d. Comments: In addition to the A through F questions, non-attorney respondents were asked what they considered to be the judge’s strengths and what they considered to be the judge’s weaknesses. By statute these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the 22 ## Page 26 Commission, an attempt is made to redact all respondent identifying information from the comments. Since 2005 there have been changes to the number of comment questions asked, though the strengths and weaknesses questions have been posed in every survey. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. e. Cooperation Rate: The estimated cooperation rate for the Non-attorney Survey is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses and refusals, undeliverables and other responses. The table presents the estimated overall cooperation rate as well as the cooperation rate by the different types of respondents. The true cooperation rates are likely higher than shown because of the percentage of people who were mailed questionnaires about judges who they had not observed. This is due, in part, to many cases being disposed of without the parties having appeared in court, as well as in the case of law enforcement, the data includes all those who were subpoenaed for a case, not just those who appeared. A table of the response counts by respondent type for Judge Boyd is shown below, and on the next page is a table of the overall cooperation rates for both the attorney and non- attorney regarding trial judges surveys for all district judges. 23 ## Page 27 Judge E. Dale Boyd Judge Response Counts by Type of Respondent Total No Undeliverable/ Other Non- Coop Role Type Sent Response Not Applicable Responses Completes Rate Attorneys Criminal District Attorneys 4 3 0 0 1 25.0% Defense Attorneys 20 14 1 0 5 26.3% Civil Other Attorneys Civil 3 3 0 0 0 0.0% Total Attorneys 27 20 1 0 6 23.1% Non-attorneys Criminal Law Enforcement 4 0 4 0 0 0.0% Defendant 160 62 78 0 20 24.4% Civil Litigant 56 16 23 1 16 48.5% Witness 20 5 12 0 3 37.5% Employees 3 0 1 0 2 100.0% Total Non-attorneys 243 83 118 1 41 32.8% Grand Total: 270 103 119 1 47 31.1% 2011 Interim Judicial Performance Survey 24 ## Page 28 Total Response Counts by Type of Respondent for All County Judges Total No Undeliverable/ Other Non- Completes Cooperation Sent Response Not Applicable Responses Rate Attorneys Criminal District Attorneys 4156 2811 74 4 1267 31.0% Defense Attorneys 17291 11594 196 12 5489 32.1% Other Attorneys Criminal 160 82 25 0 53 39.3% Civil Attorneys for Litigants 2387 1332 95 5 955 41.7% Other Attorneys Civil 2728 1654 69 1 1004 37.8% GAL 2 0 0 0 2 100.0% Attorneys, Unknown Role Type 50 17 13 1 19 51.4% Total Attorneys 26774 17490 472 23 8789 33.4% Non-attorneys Criminal Victim 687 473 180 14 20 3.9% Witness 5666 3174 1559 223 709 17.3% Other 3497 2198 941 46 312 12.2% Law Enforcement 10881 6925 1772 150 2030 22.3% Defendant 45129 24420 16000 487 4214 14.5% Civil Litigant 12946 6956 3594 202 2193 23.4% Witness 1892 1039 433 35 383 26.3% Other 110 64 27 2 17 20.5% Jurors 25631 11551 1871 542 11609 48.9% Employees 403 132 59 43 169 49.1% Total Non-attorneys 106842 56932 26436 1744 21656 26.9% Grand Total: 133616 74422 26908 1767 30445 28.5% 2011 Interim Judicial Performance Survey 25 ## Page 29 Projectability Most surveys seen by the public are surveys that are intended to be projectable, that is the results from the sample of people surveyed can be used to estimate a percentage or value of the population sampled with a known probability of error. For example, a pre- election poll of 500 likely Colorado voters is used to estimate the percentage of voters who will vote for Candidate A versus Candidate B on election day, plus or minus some number of percentage points. The plus or minus amount is usually what is known as the 95%-confidence interval (the known probability of error), or what the media often refers to as the margin-of-error. Neither of the two surveys that make up this report, Attorneys Regarding Trial Judges and the Non-Attorneys Regarding Trial Judges, are projectable with a known probability of error because the results are calculated from a self-selecting sample that is self-selecting based on the content and subject matter of the survey. In other words, the potential respondent knows the purpose and content of the survey, and based on that, decides whether to respond to the survey. While projectability within a known probability of error is a highly desirable attribute of a survey, it is often not feasible to achieve. Commercial market research often uses nonprojectable (and small) samples-the most well known of which are for focus groups. Moreover, the federal courts have long accepted, and do not expect, projectable samples for market confusion surveys used in trademark litigation. In other words, one can still use the results of the Judicial Performance Evaluation Survey to estimate how everyone who has observed a justice or judge in the courtroom would grade him or her, just not with a known probability of error. The Judicial Performance Evaluation Survey is a valuable means, perhaps the only practical means, for the Judicial Performance Commissions to have a summary of structured interviews with a number of people who have courtroom familiarity with the judge being evaluated, and who most often—albeit not always—are responding out of a desire to improve the performance of our state's judicial system. 26 ## Page 30 Survey of Attorneys Regarding Trial Judges All County Judges Average Sample Size = 8789 A B C D Fail DK/NA Grade 1. Case Management: 1a.Promptly issuing a decision on the case after trial. 50% 18% 6% 1% 1% 24% 3.52 1b.Maintaining appropriate control over proceedings. 62% 24% 9% 3% 1% 1% 3.44 1c.Promptly ruling on pre-trial motions. 47% 21% 7% 2% 1% 21% 3.39 1d.Setting reasonable schedules for cases. 57% 24% 9% 3% 2% 6% 3.39 Overall Case Management 3.44 2. Application and Knowledge of Law: 2a.Being able to identify and analyze relevant facts. 54% 25% 10% 4% 3% 3% 3.29 2b.Basing decisions on evidence and arguments. 49% 23% 12% 6% 4% 7% 3.16 2c.Willing to reconsider error in fact or law. 40% 18% 10% 6% 4% 22% 3.07 2d.Issuing consistent sentences when the circumstances are 48% 23% 9% 4% 3% 14% 3.27 similar. Overall Application and Knowledge of Law 3.20 3. Communications: 3a.Making sure all participants understand the proceedings. 66% 22% 7% 2% 1% 2% 3.53 3b.Providing written communications that are clear, thorough 41% 18% 8% 3% 2% 28% 3.30 and well reasoned. Overall Communications 3.42 4. Demeanor: 4a. Giving proceedings a sense of dignity. 64% 21% 8% 3% 2% 1% 3.43 4b. Treating parties with respect. 67% 18% 8% 4% 3% 1% 3.43 4c. Conducting his/her courtroom in a neutral manner. 59% 20% 10% 6% 4% 1% 3.26 4d. Consistently applying laws and rules. 55% 22% 9% 5% 3% 5% 3.27 Overall Demeanor 3.35 5. Diligence: 5a.Using good judgment in application of relevant law and 52% 24% 11% 5% 4% 3% 3.20 rules. 5b.Doing the necessary homework and being prepared for 51% 23% 9% 4% 3% 10% 3.28 his/her cases. 5c.Being willing to handle cases on the docket even when 52% 18% 7% 3% 2% 18% 3.39 they are complicated and time consuming. Overall Diligence 3.29 Overall Average Grade: 3.33 2011 Interim Judicial Performance Survey 27 ## Page 31 Survey of Attorneys Regarding Trial Judges Average All County Judges Grade Sample Size = 8789 Would you say the judge is: Very biased in favor of the prosecution 9% Somewhat biased in favor of the prosecution 28% Completely neutral 50% Somewhat biased in favor of the defense 6% Very biased in favor of the defense 2% Don't know or not sure 5% 8. How strongly do you recommend that the Judge be retained in office, or not be retained in office? [Percentages excluding undecided responses.] Strongly recommend retain 71% Somewhat recommend retain 17% Somewhat recommend not retain 6% Strongly recommend not retain 7% Total Retain 88% Total Not Retain 13% [Percentages including undecided responses.] Strongly recommend retain 68% Somewhat recommend retain 16% Undecided or Don't Know 5% Somewhat recommend not retain 6% Strongly recommend not retain 6% Total Retain 84% Undecided/Don't Know 5% Total Not Retain 12% 2011 Interim Judicial Performance Survey 28 ## Page 32 Survey of Non-Attorneys Regarding Trial Judges All County Judges Average Sample Size = 21656 A B C D Fail DK/NA Grade 1. Demeanor: 1a.Giving court proceedings a sense of dignity. 72% 18% 5% 2% 2% 1% 3.59 1b.Treating participants in the case politely and with respect. 76% 15% 4% 2% 3% 1% 3.61 1c.Conducting court in a neutral manner. 74% 15% 5% 2% 3% 1% 3.55 1d.Having a sense of compassion and human understanding 68% 18% 5% 3% 4% 2% 3.47 for those who appear before the court. Overall Demeanor 3.56 2. Fairness: 2a.Giving participants an opportunity to be heard. 75% 15% 4% 2% 3% 1% 3.59 2b.Treating those involved in the case without bias. 73% 14% 4% 3% 4% 2% 3.52 2c.Treating fairly people who represent themselves. 52% 10% 3% 2% 3% 29% 3.51 2d.Giving each side enough time to present his or her case. 72% 14% 4% 2% 3% 5% 3.59 Overall Fairness 3.55 3. Communications: 3a.Making sure participants understand the proceedings, and 76% 14% 5% 2% 2% 1% 3.64 what is going on in the courtroom. 3b.Using language that everyone can understand. 76% 16% 4% 1% 1% 1% 3.66 3c.Speaking clearly so everyone in the courtroom can hear 79% 14% 4% 1% 1% 1% 3.69 what is being said. Overall Communications 3.66 4. Diligence: 4a.Beginning court on time 64% 21% 7% 3% 3% 3% 3.45 4b.Maintaining appropriate control over proceedings. 77% 15% 4% 1% 1% 1% 3.67 4c.Setting reasonable schedules for cases. 63% 16% 5% 2% 2% 13% 3.56 4d.Being prepared for cases. 71% 15% 4% 2% 2% 7% 3.61 4e.Managing court proceedings so that there is little wasted 67% 20% 6% 2% 2% 2% 3.50 time. Overall Diligence 3.56 5. Application of Law: 5a.Giving reasons for rulings. 65% 16% 5% 2% 3% 8% 3.50 5b.Willing to make decisions without regard to possible 60% 12% 4% 2% 3% 19% 3.52 outside pressure. 5c.Being able to identify and analyze relevant facts. 67% 14% 4% 2% 4% 8% 3.50 Overall Application of Law 3.51 Overall Average Grade: 3.56 2011 Interim Judicial Performance Survey ## Page 33 Survey of Non-Attorneys Regarding Trial Judges Average All County Judges Grade Sample Size = 21656 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 12% Competely neutral 81% Biased in favor of the defense total 7% Average 0.12 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 12% Competely neutral 77% Lenient sentencing total 11% Average 0.06 2011 Interim Judicial Performance Survey ## Page 34 QQuueessttiioonnnnaaiirreess ## Page 35 Colorado Judicial Performance Attorneys Regarding Trial Judges Survey Questions _ Which of the following types of cases have you observed Judge (Last Name)’s performance? Please circle all that apply. (Only respondents who indicate they have observed the judge in “criminal other than traffic” cases will be asked question 2c and question 6.) Civil . 1 Criminal other than traffic . 2 Traffic . 3 Domestic . 4 Juvenile . 5 Probate . 6 Other . 9 1. Case Management: a. Promptly issuing a decision on the case after trial. A B C D F DK/NS b. Maintaining appropriate control over proceedings. A B C D F DK/NS c. Promptly ruling on pre-trial motions. A B C D F DK/NS d. Setting reasonable schedules for cases. A B C D F DK/NS 2. Application and Knowledge of Law: a. Being able to identify and analyze relevant facts. A B C D F DK/NS b. Basing decisions on evidence and arguments. A B C D F DK/NS c. Willing to reconsider error in fact or law. A B C D F DK/NS d. [Criminal only] Issuing consistent sentences when the circumstances are similar. A B C D F DK/NS 3. Communications: a. Makings sure all participants understand the proceedings. A B C D F DK/NS b. Providing written communications that are clear, thorough and well reasoned. A B C D F DK/NS 4. Demeanor: a. Giving proceedings a sense of dignity. A B C D F DK/NS b. Treating participants with respect. A B C D F DK/NS c. Conducting his/her courtroom in a neutral manner. A B C D F DK/NS d. Consistently applying laws and rules. A B C D F DK/NS 5. Diligence: a. Using good judgment in application of relevant law and rules. A B C D F DK/NS b. Doing the necessary “homework” and being prepared for his/her cases. A B C D F DK/NS c. Being willing to handle cases on the docket even when they are complicated and time consuming. A B C D F DK/NS 1 ## Page 36 Having observed Judge (Last Name) in a criminal case, would you say the judge is: (This question is asked only if respondent indicated at the beginning of the survey he/she observed the judge in a criminal case.) Very biased in favor of the prosecution . 1 Somewhat biased in favor of the prosecution . 2 Completely Neutral . 3 Somewhat biased in favor of the defense . 4 Very biased in favor of the defense . 5 Don’t Know/Not Sure . 9 6. What would you say are Judge (Last Name)’s strengths? _ _ _ 7. What would you say are Judge (Last Name)’s weaknesses? _ _ _ 8. Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge (Last Name) be retained in office, or not retained in office? Strongly recommend he be retained in office . 5 Somewhat recommend he be retained in office . 4 Undecided or don’t know enough to make recommendation . 3 Somewhat recommend he not be retained in office . 2 Strongly recommend he not be retained in office . 1 2 ## Page 37 9. And what would you say are Judge [Last Name]’s weaknesses? ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ Commission on Judicial Performance ___________________________________________________________ ___________________________________________________________ Evaluation of 10. Keeping in mind your responses to each of the previous questions, how JUDGE [FULL NAME] strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? Strongly recommend he/she be retained in office ................................ 5 Somewhat recommend he/she be retained in office ............................ 4 Undecided or don’t know enough to make recommendation ............. 3 If we have made a mistake and you either were not in Judge [Last Somewhat recommend he/she not be retained in office ..................... 2 Name]’s courtroom in the past 18 months, or you feel that you do not Strongly recommend he/she not be retained in office ......................... 1 have sufficient experience with Judge [Last Name] to have an opinion the judge’s judicial performance, please just return this questionnaire, unanswered, in the enclosed postage-paid envelope, to stop any further requests to evaluate Judge [Last Name]. Thank you for taking the time to complete this questionnaire. Please place it in the self-addressed, postage-paid envelope provided and place it in the mail. Your participation in this survey is very much appreciated. Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please circle the number corresponding to “Don’t Know/Not Applicable”—DK/NA). DK 1. Demeanor: A B C D F N/A a. Giving court proceedings a sense of dignity. 4 3 2 1 0 9 b. Treating participants in the case politely and with respect. 4 3 2 1 0 9 c. Conducting his/her courtroom in a neutral manner. 4 3 2 1 0 9 d. Having a sense of compassion and human understanding for those who appear before him/her. 4 3 2 1 0 9 ## Page 38 DK 6. [If you were in [Last Name]’s courtroom during a criminal case or 2. Fairness: A B C D F N/A cases please answer this question, otherwise skip to the next a. Giving participants an opportunity to be heard. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Treating those involved in the case without bias. 4 3 2 1 0 9 number how biased you think Judge [Last Name] is toward the defense or c. Treating fairly people who represent themselves. 4 3 2 1 0 9 the prosecution. If you feel Judge [Last Name] is completely unbiased, circle “0.” d. Giving each side enough time to present his or her case. 4 3 2 1 0 9 Bias toward Completely Bias toward Defense Neutral Prosecution DK 5 4 3 2 1 0 1 2 3 4 5 3. Communications: A B C D F N/A a. Makings sure participants understand the 7. [If you were in [Last Name]’s courtroom during a criminal case or proceedings, and what’s going on in the cases please answer this question, otherwise skip to the next courtroom. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Using language that everyone can understand. 4 3 2 1 0 9 number how lenient or how harsh you think the sentences generally handed c. Speaking clearly so everyone in the courtroom down by [Last Name] are. If you feel Judge [Last Name] generally hands can hear what’s being said. 4 3 2 1 0 9 down appropriate sentences, circle “0.” DK Sentences Appropriate Sentences 4. Diligence: A B C D F N/A Too Light Sentences Too Harsh a. Beginning court on time. 4 3 2 1 0 9 5 4 3 2 1 0 1 2 3 4 5 b. Maintaining appropriate control over proceedings. 4 3 2 1 0 9 c. Setting reasonable schedules for cases. 4 3 2 1 0 9 d. Being prepared for his/her cases. 4 3 2 1 0 9 Though your name will never be associated with your answers, because the judge will e. Managing court proceedings so that there is see a typed transcript of the comments that you and others write, it is important that little wasted time. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. 8. What would you say are Judge [Last Name]’s strengths? DK ___________________________________________________________ 5. Application of Law: A B C D F N/A ___________________________________________________________ a. Giving reasons for rulings. 4 3 2 1 0 9 ___________________________________________________________ b. Willing to make decision without regard to ___________________________________________________________ possible outside pressure. 4 3 2 1 0 9 ___________________________________________________________ c. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 ___________________________________________________________ Continued on Back Page - 2012 Retention Survey Report(PDF on OJPE)
Read full retention survey textexpand
## Page 1 State of Colorado Logo COMMISSION ON JUDICIAL PERFORMANCE TThhee HHoonnoorraabbllee EE.. DDaallee BBooyydd 2012 Judicial Performance Survey Report 22nd Judicial District ## Page 2 March 26, 2012 The Honorable E. Dale Boyd Dolores County Courthouse P.O. Box 511 Dove Creek, CO 81324 Dear Judge Boyd: I am pleased to make available to you the attached copy of your 2012 Judicial Performance Survey Report. This report includes the survey results from two important stakeholder groups: 1) attorneys who have had cases in your court or who are knowledgeable about your judicial performance; and 2) non-attorneys who have observed your performance in court or who have knowledge of your performance as a judge. In addition to this introduction, the report is divided into five main sections: 1. A brief summary of the results of the attorney and non-attorney surveys. 2. The numerical results of the survey of attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments attorneys made about your judicial performance. In some instances the comments have been redacted to eliminate respondent identifying information. A copy of the attorney questionnaire is included in the final section of this report. 3. The numerical results of the survey of non-attorneys in both tabular and graphical form. In addition to the numerical results, this section also contains comments these respondents made on the subject of your judicial performance. In few instances the comments have been redacted to eliminate respondent identifying information. A copy of the non-attorney questionnaire is included in the final section of this report. 4. The fourth section of the report discusses the methodology of the surveys. 5. The final section provides copies of the questions or questionnaires that were used for each survey. ## Page 3 Hon. E. Dale Boyd March 26, 2012 Page 2 If you have any questions about the methodology and how the survey was conducted, please feel free to contact me at 505-821-5454 or by email at sanderoff@rpinc.com (please put the words “Judicial Performance” in the subject line), and for any other questions you might have about the survey please call the Executive Director of the Office of Judicial Performance Evaluation, Jane Howell, at 303-866-6465. Best regards, Brian Sanderoff President enc: 5140 SAN FRANCISCO RD NE, ALBUQUERQUE, NM 87109 WWW.RPINC.COM 505-821-5454 ## Page 4 Summary of Results Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. On average, Judge E. Dale Boyd received an overall combined average grade of 3.25 in the 2012 Judicial Performance Survey. This is calculated by adding the overall average grade received from attorney respondents, 3.02, to the overall average grade received from non-attorney respondents, 3.48, divided by two. The average combined grade for all county judges standing for retention in 2012 is 3.45 [not shown below]. Judge Boyd Average Grades (All Years) Combined Attorney Non-attorney Overall Grade 3.25 3.02 3.48 Sample Size - 12 52 Table 1 The results presented in this report are based on data collected in 2008, 2009, 2010, and 2011. (See Methodology section for description of sampling process.) Provisional judges will not have samples for the years prior to their appointment. Table 2 shows Judge Boyd’s overall average grades for each year in which survey results are available. Judge Boyd Average Grades by Year Combined Attorney Non-Attorney Average Average Sample Average Sample Year Score Score Size Score Size 2008 3.03 2.25 1 3.80 6 2009 3.35 3.23 3 3.47 17 2010 3.08 2.74 2 3.42 9 2011 3.29 3.14 6 3.43 20 Overall 3.25 3.02 12 3.48 52 Table 2 1 ## Page 5 Comparison of Jurors vs. Non-Jurors Among Non-Attorney Population Among the non-attorney population, jurors tend to grade judges much higher than non- jurors. The juror overall average grade for all county judges standing for retention in 2012 is 3.85, while the overall average grade awarded by non-jurors is 3.29. The effect of this is that judges with a higher percentage of jurors in their sample tend to have higher average grades in the non-attorney survey than those judges with a small percentage of jurors. The number of jurors in a judge’s sample is, of course, closely related to the number of jury trials the judge presides over. The table below shows Judge Boyd’s non-attorney results broken out by jurors and non- jurors. It also shows the overall average juror and non-juror grades for all county judges standing for retention in 2012 (see two columns on far right). Judge Boyd Average Grades for Jurors vs. Non-Jurors (All Years) All County Judge Boyd Retention Judges Jurors Non-Jurors Average Sample Average Sample Juror Non-Juror Score Size % Score Size % Average Average 3.74 4 8% 3.47 48 92% 3.85 3.29 Table 3 2 ## Page 6 SSuurrvveeyy ooff AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee EE.. DDaallee BBooyydd ((SSaammppllee SSiizzee 1122)) ## Page 7 Survey of Attorneys Regarding Trial Judges Average Judge E. Dale Boyd All County Sample Size = 12 A B C D Fail DK/NA E. Dale Boyd Retention Judges 1. Case Management: 1a. Promptly issuing a decision on the case after trial. 33% 33% 17% 0% 0% 17% 3.20 3.52 1b. Maintaining appropriate control over proceedings. 58% 17% 25% 0% 0% 0% 3.33 3.44 1c. Promptly ruling on pre-trial motions. 42% 25% 17% 0% 0% 17% 3.30 3.41 1d. Setting reasonable schedules for cases. 50% 33% 17% 0% 0% 0% 3.33 3.40 Overall Case Management 3.29 3.44 2. Application and Knowledge of Law: 2a. Being able to identify and analyze relevant facts. 8% 42% 50% 0% 0% 0% 2.58 3.26 2b. Basing decisions on evidence and arguments. 17% 42% 42% 0% 0% 0% 2.75 3.15 2c. Willing to reconsider error in fact or law. 33% 42% 17% 0% 0% 8% 3.18 3.01 2d. Issuing consistent sentences when the circumstances are 25% 38% 25% 13% 0% 0% 2.75 3.28 similar. Overall Application and Knowledge of Law 2.82 3.18 3. Communications: 3a. Making sure all participants understand the proceedings. 25% 58% 17% 0% 0% 0% 3.08 3.49 3b. Providing written communications that are clear, thorough 8% 25% 42% 0% 0% 25% 2.56 3.31 and well reasoned. Overall Communications 2.82 3.40 4. Demeanor: 4a. Giving proceedings a sense of dignity. 33% 42% 17% 8% 0% 0% 3.00 3.39 4b. Treating parties with respect. 58% 25% 17% 0% 0% 0% 3.42 3.36 4c. Conducting his/her courtroom in a neutral manner. 58% 25% 8% 8% 0% 0% 3.33 3.19 4d. Consistently applying laws and rules. 33% 17% 42% 0% 0% 8% 2.91 3.23 Overall Demeanor 3.17 3.29 5. Diligence: 5a. Using good judgment in application of relevant law and 17% 58% 17% 8% 0% 0% 2.83 3.18 rules. 5b. Doing the necessary homework and being prepared for 25% 33% 42% 0% 0% 0% 2.83 3.28 his/her cases. 5c. Being willing to handle cases on the docket even when 8% 25% 8% 0% 0% 58% 3.00 3.38 they are complicated and time consuming. Overall Diligence 2.89 3.28 Overall Average Grade: 3.02 3.31 Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 2012 Judicial Performance Survey Report 4 ## Page 8 Survey of Attorneys Regarding Trial Judges Percentage Judge E. Dale Boyd All County E. Dale Boyd Retention Sample Size = 12 Judges Would you say the judge is: Very biased in favor of the prosecution 0% 9% Somewhat biased in favor of the prosecution 13% 30% Completely neutral 75% 49% Somewhat biased in favor of the defense 13% 5% Very biased in favor of the defense 0% 1% Don't know or not sure 0% 5% 8. How strongly do you recommend that the Judge be retained in office, or not be retained in office? Percentages excluding undecided/don't know responses. Strongly recommend retain 75% 70% Somewhat recommend retain 17% 16% Somewhat recommend not retain 8% 7% Strongly recommend not retain 0% 7% Total Retain 92% 86% Total Not Retain 8% 14% Percentages including undecided/don't know responses. Strongly recommend retain 75% 66% Somewhat recommend retain 17% 15% Undecided or Don't Know 0% 5% Somewhat recommend not retain 8% 6% Strongly recommend not retain 0% 7% Total Retain 92% 81% Undecided/Don't Know 0% 5% Total Not Retain 8% 13% 2012 Judicial Performance Survey Report 5 ## Page 9 Judge E. Dale Boyd Survey of Attorneys Regarding Trial Judges Average Grades 3.02 Overall Average Grade 3.31 Q1. Overall Case Management 3.29 3.44 1a. Promptly issuing a decision on the 3.20 case after trial. 3.52 1b. Maintaining appropriate control over 3.33 proceedings. 3.44 3.30 1c. Promptly ruling on pre-trial motions. 3.41 1d. Setting reasonable schedules for cases. 3.33 3.40 2.82 Q2. Overall App & Knowledge of Law 3.18 2a. Being able to identify and analyze 2.58 relevant facts. 3.26 2b. Basing decisions on evidence and argument. 2.75 3.15 3.18 2c. Willing to reconsider error in fact or law. 3.01 2d. [Criminal only] Issuing consistent sentences 2.75 when circumstances are similar. 3.28 2.82 Q3. Overall Communication 3.40 3a. Making sure all participants understand 3.08 the proceedings. 3.49 3b. Providing written communications that are 2.56 clear, thorough and well reasoned. 3.31 2.0 2.5 3.0 3.5 4.0 E. Dale Boyd All County Retention Judges Judge E. Dale Boyd 6 2012 Judicial Performance Survey Report ## Page 10 Judge E. Dale Boyd Survey of Attorneys Regarding Trial Judges Average Grades 3.17 Q4. Overall Demeanor 3.29 3.00 4a. Giving proceedings a sense of dignity. 3.39 3.42 4b. Treating participants with respect. 3.36 4c. Conducting [his/her] courtroom 3.33 in a neutral manner. 3.19 2.91 4d. Consistently applying laws and rules. 3.23 2.89 Q5. Overall Diligence 3.28 5a. Using good judgment in application of 2.83 relevant laws and rules. 3.18 5b. Doing the necessary 'homework' and 2.83 being prepared for [his/her] cases. 3.28 5c. Being willing to handle cases on the docket even 3.00 when they are complicated and time consuming. 3.38 2.0 2.5 3.0 3.5 4.0 Biased in favor of prosecution/defense. 0% Very biased in favor of the prosecution 9% 13% Somewhat biased in favor of the prosecution 30% 75% Completely Neutral 49% 13% Somewhat biased in favor of the defense 5% 0% Very biased in favor of the defense 1% 0% Don't know/not sure 5% 0% 10% 20% 30% 40% 50% 60% 70% 80% E. Dale Boyd All County Retention Judges 7 2012 Judicial Performance Survey Report ## Page 11 Judge E. Dale Boyd Survey of Attorneys Regarding Trial Judges Q8. How strongly do you recommend that Judge Boyd be retained or not retained in office? Excluding Undecided/Don't Know Respondents 75% Strongly recommend retain 70% 17% Excluding Und/DK Respondents Somewhat recommend retain 16% All Cnty Retention Judge Boyd Judges 8% Somewhat recommend not retain Total Retain 92% 86% 7% Total Not Retain 8% 14% 0% Strongly recommend not retain 7% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Including Undecided/Don't Know Respondents 75% Strongly recommend retain 66% 17% Somewhat recommend retain 15% Including Und/DK Respondents 0% Undecided or DK All Cnty 5% Retention Judge Boyd Judges 8% Somewhat recommend not retain Total Retain 92% 81% 6% Undecided or DK 0% 5% Total Not Retain 8% 13% 0% Strongly recommend not retain 7% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% E. Dale Boyd All County Retention Judges 8 2012 Judicial Performance Survey Report ## Page 12 SSuurrvveeyy ooff NNoonn--AAtoorrnneeyyss RReeggaarrddiinngg JJuuddggee EE.. DDaallee BBooyydd ((SSaammppllee SSiizzee 5522)) ## Page 13 Survey of Non-Attorneys Regarding Trial Judges Average Judge E. Dale Boyd All County Sample Size = 52 A B C D Fail DK/NA E. Dale Boyd Retention Judges 1. Demeanor: 1a. Giving court proceedings a sense of dignity. 56% 23% 10% 2% 6% 4% 3.26 3.59 1b. Treating participants in the case politely and with respect. 73% 12% 8% 2% 4% 2% 3.51 3.61 1c. Conducting court in a neutral manner. 67% 16% 8% 2% 6% 2% 3.38 3.56 1d. Having a sense of compassion and human understanding 73% 13% 8% 2% 2% 2% 3.57 3.48 for those who appear before the court. Overall Demeanor 3.43 3.56 2. Fairness: 2a. Giving participants an opportunity to be heard. 79% 10% 2% 4% 4% 2% 3.59 3.60 2b. Treating those involved in the case without bias. 69% 12% 8% 2% 6% 4% 3.42 3.53 2c. Treating fairly people who represent themselves. 65% 8% 6% 2% 4% 15% 3.52 3.53 2d. Giving each side enough time to present his or her case. 73% 12% 2% 4% 4% 6% 3.55 3.60 Overall Fairness 3.52 3.57 3. Communications: 3a. Making sure participants understand the proceedings, and 75% 15% 2% 4% 2% 2% 3.61 3.64 what is going on in the courtroom. 3b. Using language that everyone can understand. 76% 14% 2% 4% 0% 4% 3.69 3.67 3c. Speaking clearly so everyone in the courtroom can hear 78% 6% 10% 2% 0% 4% 3.67 3.71 what is being said. Overall Communications 3.66 3.67 4. Diligence: 4a. Beginning court on time 66% 14% 14% 0% 0% 6% 3.55 3.49 4b. Maintaining appropriate control over proceedings. 69% 13% 10% 2% 4% 2% 3.45 3.69 4c. Setting reasonable schedules for cases. 71% 12% 10% 2% 0% 6% 3.60 3.59 4d. Being prepared for cases. 65% 17% 2% 8% 2% 6% 3.45 3.62 4e. Managing court proceedings so that there is little wasted 60% 21% 8% 6% 2% 4% 3.36 3.52 time. Overall Diligence 3.48 3.58 5. Application of Law: 5a. Giving reasons for rulings. 60% 19% 8% 2% 6% 6% 3.33 3.51 5b. Willing to make decisions without regard to possible 62% 8% 12% 2% 8% 10% 3.26 3.53 outside pressure. 5c. Being able to identify and analyze relevant facts. 65% 19% 4% 2% 6% 4% 3.42 3.52 Overall Application of Law 3.34 3.52 Overall Average Grade: 3.48 3.58 Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 2012 Judicial Performance Survey Report 10 ## Page 14 Survey of Non-Attorneys Regarding Trial Judges Percentage Judge E. Dale Boyd All County E. Dale Boyd Retention Sample Size = 52 Judges 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 6% 12% Competely neutral 84% 82% Biased in favor of the defense total 10% 6% [A positive average indicates bias toward prosecution, and a Average -0.16 0.15 negative average indicates a bias toward the defense.] 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 3% 12% Competely neutral 73% 78% Lenient sentencing total 25% 10% [A positive average indicates sentences are harsh, and a Average -0.49 0.14 negative average indicates sentences are lenient.] 10. How strongly do you recommend that the Judge be retained or not retained in office? Percentages excluding undecided/don't know responses. Strongly recommend retain 78% 84% Somewhat recommend retain 14% 8% Somewhat recommend not retain 2% 3% Strongly recommend not retain 6% 5% Total Retain 92% 92% Total Not Retain 8% 8% Percentages including undecided/don't know responses. Strongly recommend retain 76% 77% Somewhat recommend retain 14% 7% Undecided or Don't Know 2% 8% Somewhat recommend not retain 2% 2% Strongly recommend not retain 6% 5% Total Retain 90% 84% Undecided/Don't Know 2% 8% Total Not Retain 8% 7% 2012 Judicial Performance Survey Report 11 ## Page 15 Judge E. Dale Boyd Survey of Non-Attorneys Regarding Trial Judges Average Grades 3.48 Overall Average Grade 3.58 3.43 Q1. Overall Demeanor 3.56 3.26 1a. Giving proceedings a sense of dignity. 3.59 1b. Treating participants politely and with respect. 3.51 3.61 1c. Conducting the courtroom in a neutral 3.38 manner. 3.56 1d. Having a sense of compassion and human 3.57 understanding for those who appear before the judge. 3.48 3.52 Q2. Overall Fairness 3.57 2a. Giving participants an opportunity to be 3.59 heard. 3.60 2b. Treating those involved in the 3.42 case without bias. 3.53 2c. Treats people fairly who represent 3.52 themselves. 3.53 2d. Giving each side enough time to present his 3.55 or her case. 3.60 3.66 Q3. Overall Communications 3.67 3a. Making sure participants understand the 3.61 proceedings, and what's going on in the courtroom. 3.64 3b. Using language that everyone can 3.69 understand. 3.67 3c. Speaking clearly so everyone in the courtroom 3.67 can hear what's being said. 3.71 2.0 2.5 3.0 3.5 4.0 E. Dale Boyd All County Retention Judges Judge E. Dale Boyd 12 2012 Judicial Performance Survey Report ## Page 16 Judge E. Dale Boyd Survey of Non-Attorneys Regarding Trial Judges Average Grades 3.48 Q4. Overall Diligence 3.58 3.55 4a. Beginning court on time. 3.49 4b. Maintaining appropriate control over 3.45 proceedings. 3.69 4c. Setting reasonable schedules for cases. 3.60 3.59 4d. Being prepared for his or her cases. 3.45 3.62 4e. Managing court proceedings so that there is 3.36 little wasted time. 3.52 3.34 Q5. Overall Application of Law 3.52 3.33 5a. Giving reasons for rulings. 3.51 5b. Willing to make decision without regard to 3.26 possible outside pressure. 3.53 5c. Being able to identify and analyze 3.42 relevant facts. 3.52 2.0 2.5 3.0 3.5 4.0 Q6 Biased in favor of prosecution/defense. 1 -0.16 E. Dale Boyd 0.15 All County Retention Judges -5 -4 -3 -2 -1 0 1 2 3 4 5 Defense Prosecution 1-A negative average score indicates bias toward the defense, and a positive average score indicates bias toward prosecution. Q7 Lenience or Harshness in Sentencing. 2 -0.49 E. Dale Boyd 0.14 All County Retention Judges -5 -4 -3 -2 -1 0 1 2 3 4 5 Lenient Harsh 2-A negative average score indicates sentences are lenient, and a positive average score indicates sentences are harsh. E. Dale Boyd All County Retention Judges 13 2012 Judicial Performance Survey Report ## Page 17 Judge E. Dale Boyd Survey of Non-Attorneys Regarding Trial Judges Q10. How strongly do you recommend that Judge Boyd be retained or not retained in office? Excluding Undecided/Don't Know Respondents 78% Strongly recommend retain in office 84% 14% Somewhat recommend retain in office Excluding Und/DK Respondents 8% All Cnty Retention 2% Somewhat recommend not retain in office Judge Boyd Judges 3% Total Retain 92% 92% Total Not Retain 8% 8% 6% Strongly recommend not retain in office 5% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Including Undecided /Don't Know Respondents 76% Strongly recommend retain in office 77% 14% Somewhat recommend retain in office 7% 2% Including Und/DK Respondents Undecided 8% All Cnty Retention 2% Judge Boyd Judges Somewhat recommend not retain in office Total Retain 90% 84% 2% Undecided 2% 8% 6% Total Not Retain 8% 7% Strongly recommend not retain in office 5% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% E. Dale Boyd All County Retention Judges 14 2012 Judicial Performance Survey Report ## Page 18 MMeetthhooddoollooggyy ## Page 19 MMeetthhooddoollooggyy The results shown in the 2012 Judicial Performance Survey Report are based on two surveys: The Survey of Attorneys Regarding Trial Judges, and the Survey of Non- Attorneys Regarding Trial Judges. Below is a description of the methodology used in the two surveys. I Attorneys Regarding Trial Judges a. Sample: Research & Polling, Inc. received case data with the names of attorneys who had likely been in each judge’s courtroom from the following primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Colorado Public Defender’s Office Denver County Courts District Attorney’s Office, Second Judicial District (Denver) District Attorney’s Office, Ninth Judicial District The data from these different sources are combined, duplicates removed, and addresses corrected. In 2011, the following changes were made to the Attorneys Regarding Trial Judges survey process: Only judges that are standing for retention in 2012 were evaluated during this reporting cycle (the intent was to increase the number of completed attorney evaluations for each retention judge by excluding those not standing for retention). The number of possible judges that attorney respondents could evaluate was increased from seven to 10. Attorneys are first mailed a letter inviting them to complete the survey online. The letter provides the link to the online survey, as well as a unique password to access the survey. Approximately one week later, attorneys are sent an email invitation to complete the online survey, which also provides the Web address and their unique password. About a week after the first email is sent, a reminder email is sent, providing the same information. Potential respondents who do not complete the survey after the second email are then telephoned and asked to either complete the survey by phone, or to complete it online. Since 2010, the Judicial Performance Survey reports are based on a moving average, or rolling sample, of data collected over a period of time equal to the justice’s or judge’s term of office: ten years for a Supreme Court justice, eight years for a COA judge, six years for a district judge, and four years for a county judge. To use a county judge as an 16 ## Page 20 example: as survey data is collected it is pooled together for four years. After four years, as new data is added to the judge’s survey results, the oldest data in the pool is deleted. b. Questions: Respondents evaluated judges on 17 aspects of judicial performance using a grade scale of A, B, C, D, or F. (See Questionnaire section.) These grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the justice or judge be retained or not retained in office. c. Comments: Respondents were also asked what they considered to be the judge’s strengths and weaknesses. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. Since 2005, there have been changes to the number of comment questions asked, though the strengths and weaknesses questions have been posed in every survey. The number to the left of each comment refers to the same attorney respondent in both the strengths section and the weaknesses section. Most spelling and typographical errors have been corrected. d. Analysis: The Attorneys Regarding Trial Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all county judges standing for retention in 2012 and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all county retention judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. The next table shows the percentage distribution of the responses to the question about recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all county retention judges. The 17 ## Page 21 percentages are shown both including and excluding “undecided/don’t know” responses. The next page displays the question averages in horizontal bar-graph form. The percentage distribution to the retention question is then presented in the graph on the next page. The third part of the Attorneys Regarding Trial Judges section of the report lists the comments the attorneys made about the judge’s strengths and weaknesses. e. Cooperation Rate: The overall cooperation rate for the Attorneys Regarding Trial Judges Survey is calculated as the number of completed survey evaluations divided by the number of possible evaluations resulting in an overall response rate of 45.7% for district judges and 37.6% for county judges. An equivalent response rate for an individual judge is computed in the same manner. II Non-Attorneys Regarding Trial Judges a. Sample: Research & Polling, Inc. received case data with the names of non-attorneys who had likely been in each judge’s courtroom from the following primary sources: Colorado Judicial Department Colorado District Attorneys’ Council Colorado Public Defender’s Office Denver County Courts District Attorney’s Office, Second Judicial District (Denver) District Attorney’s Office, Ninth Judicial District The data from these different sources are combined, duplicates removed, and addresses corrected. In 2011, only the judges standing for retention in 2012 were evaluated. The intent was to increase the number of completed non-attorney evaluations for each retention judge by excluding those not standing for retention. For this evaluation cycle, the following changes were made to the Non-Attorneys Regarding Trial Judges survey process: Court staff, probation officers, and court interpreters were asked to complete the survey online, with the possibility of evaluating up to 10 judges RPI surveyed all non-attorneys with courtroom experience instead of a random sample of each sub-population (i.e. court employees, court interpreters, probation officers, witnesses, law enforcement personnel, jurors, crime victims, litigants, etc.). The only exception to this is the criminal defendants, for which RPI selected a random sample. 18 ## Page 22 As stated above, court staff, probation officers, and court interpreters were asked to complete the survey online. They are sent an email invitation to complete the online survey, which also provides the Web address and their unique password. About a week after the first email is sent, a reminder email is sent, providing the same information. Other non-attorneys were surveyed via standard mail. First, they were mailed an initial postcard informing the recipient that he or she would be receiving a questionnaire. Two to three weeks after the postcard was mailed, the potential respondent was sent a personalized introductory letter and a questionnaire with a postage-paid return envelope. If the person did not respond, a second questionnaire and letter were sent approximately four weeks later. Questionnaires are barcoded, and if a respondent mailed back two questionnaires, the second one was deleted from the data file. Since 2010, the non-attorney section of the Judicial Performance Survey reports have been based on a moving average, or rolling sample, of survey results collected over a period of time equal to the judge’s term of office: six years for a district judge and four years for a county judge. To use a county judge as an example: as survey data is collected, it is pooled together for four years. After four years, as new data is added to the judge’s survey results, the oldest data in the pool is deleted. b. Questions: Respondents evaluated judges on 19 aspects of judicial performance using a grade scale of A, B, C, D, or F. (See Questionnaire section.) These grades were then converted to a numerical score where A = 4, B = 3, C = 2, D = 1 and Fail = 0. The A through F scale was chosen because it is almost universally recognized and understood. This makes it easy for respondents to complete their questionnaire, and for the public to interpret the results. Respondents were also asked if they considered the judge biased toward the defense or prosecution in criminal cases. In a final question, respondents were asked to indicate how strongly they would recommend that the justice or judge be retained or not retained in office. A copy of the questionnaire is included in the last section of this report. c. Analysis: The Non-Attorneys Regarding Trial Judges section first shows a table of the percentage distribution for each of the A through F questions, including “don’t know/not applicable” responses. The next column to the right shows the judge’s average grade for each question. For comparison purposes, averages were also computed for all county judges standing for retention in 2012 and are shown in the furthest right column on the page. Tables showing the percentage distribution for all questions for all county retention judges are located at the end of this methodology section. The overall question averages are calculated by adding up the averages for each question and dividing by the number of questions. 19 ## Page 23 The next table shows the percentage distribution of the responses to the questions about prosecution or defense bias and recommending retention. The first column of percentages is for the report-judge and the second column displays the percentages for all county retention judges. The percentages for the retention question are shown including and excluding “undecided/don’t know” responses. The next page displays the question averages in horizontal bar-graph form. The percentage distribution of the prosecution-defense bias and retention questions are then presented in the graph on the next page. The third part of the Non-Attorneys Regarding Trial Judges section of the report lists the comments the non-attorneys made about the judge’s strengths and weaknesses. d. Comments: In addition to the A through F questions, non-attorney respondents were asked what they considered to be the judge’s strengths and weaknesses. By statute, these comments are confidential and only provided to the judge and the District Commission on Judicial Performance. They are not released to the public when the rest of the report is released. Before being given to the judge and the Commission, an attempt is made to redact all respondent identifying information from the comments. Since 2005 there have been changes to the number of comment questions asked, though the strengths and weaknesses questions have been posed in every survey. The number to the left of each comment refers to the same non-attorney respondent in both the strengths section and the weaknesses section. e. Cooperation Rate: The estimated cooperation rate for the non-attorney survey is calculated as the number of completed questionnaires divided by the number of eligible respondents who actually received a questionnaire. The following table shows the total number of questionnaires mailed, completed, non-responses and refusals, undeliverables, and other responses. The table presents the estimated overall cooperation rate as well as the cooperation rate by the different types of respondents. The true cooperation rates are likely higher than shown because of the percentage of people who were mailed questionnaires about judges with whom they may not have had sufficient experience. This is due, in part, to many cases being disposed of without the parties having appeared in court, as well as in the case of law enforcement, the data includes all those who were subpoenaed for a case, not just those who appeared. A table of the response counts by respondent type for Judge Boyd is shown on the following page, and on the next page is a table of the overall cooperation rates for both the Attorney and Non-Attorney Regarding Trial Judges surveys for all county judges. 20 ## Page 24 Judge E. Dale Boyd Judge Response Counts by Type of Respondent Total No Undeliverable/ Other Non- Coop Role Type Sent Response Not Applicable Responses Completes Rate Attorneys Criminal District Attorneys 8 4 3 0 1 20.0% Defense Attorneys 27 18 1 0 8 30.8% Civil Other Attorneys Civil 6 3 0 0 3 50.0% Total Attorneys 41 25 4 0 12 32.4% Non-attorneys Criminal Witness 3 1 2 0 0 0.0% Law Enforcement 4 0 4 0 0 0.0% Defendant 197 51 121 0 25 32.9% Civil Litigant 50 11 25 1 13 52.0% Witness 26 8 15 0 3 27.3% Jurors 6 1 0 1 4 66.7% Employees, including Interpreters 8 0 3 0 5 100.0% Probation Officers 8 2 4 0 2 50.0% Total Non-attorneys 302 74 174 2 52 40.6% Grand Total: 343 99 178 2 64 38.8% 2012 Judicial Performance Survey Report 21 ## Page 25 Total Response Counts by Type of Respondent for All County Retention Judges Total No Undeliverable/ Other Non- Completes Cooperation Sent Response Not Applicable Responses Rate Attorneys Criminal District Attorneys 2049 1103 289 0 657 37.3% Defense Attorneys 8880 5065 774 0 3041 37.5% Other Attorneys Criminal 12 7 1 0 4 36.4% Civil Attorneys for Litigants 441 266 30 0 145 35.3% Other Attorneys Civil 1346 701 191 0 454 39.3% Attorneys, Unknown Role Type 24 8 7 1 8 47.1% Total Attorneys 12752 7150 1292 1 4309 37.6% Non-attorneys Criminal Victim 277 159 90 15 13 7.0% Witness 4435 2510 1368 182 375 12.2% Other 549 334 156 20 39 9.9% Law Enforcement 3638 2574 457 92 515 16.2% Defendant 24165 11842 9981 329 2013 14.2% Civil Litigant 4982 2497 1744 118 623 19.2% Witness 1544 856 331 44 313 25.8% Other 78 50 20 2 6 10.3% Jurors 11310 5027 1133 268 4882 48.0% Employees, including Interpreters 666 182 95 12 377 66.0% Probation Officers 415 109 97 5 204 64.2% Total Non-attorneys 52059 26140 15472 1087 9360 25.6% Grand Total: 64811 33290 16764 1088 13669 28.4% 2012 Judicial Performance Survey Report 22 ## Page 26 A Final Word Regarding the Survey Results The most frequently asked question that we receive from judges regarding the survey statistics is, “What is the margin of sampling error associated with these results?” The answer to this question is that a margin of error cannot be calculated since we are not selecting a random sample of eligible respondents (attorneys and non-attorneys) to be surveyed; instead, we are attempting to survey all members of the eligible population. Since we are not generating a random sample, we cannot estimate a percentage or value of the population sampled with a known probability of error. Every eligible respondent in the attorney and non-attorney population is now given an opportunity to evaluate judges with whom they have had a recent experience.1 The only exception is among the criminal defendant population, in which, due to its size, a random sample is selected. The respondents know the purpose and content of the survey, and based on that, decide whether to respond to it. Measures are taken to increase the response rate so that concerns regarding sampling bias can be mitigated. The higher the response rate, the more confident we can feel the results of the respondents are similar to the results of the non- respondents. Attorneys and non-attorneys receive multiple waves of reminders via email or mail to complete the survey. Further, all non-responding attorneys are then contacted on the telephone and given the opportunity to complete the evaluation with the professional interviewer. RPI has contacted hundreds of non-responding attorneys to encourage their participation. We have been informed by the vast majority of the non-responding attorneys that the primary reason for not participating in the survey is because of a lack of sufficient information to evaluate that particular judge. The Judicial Performance Evaluation Survey is a valuable means, perhaps the only practical means, for the Commissions on Judicial Performance to have a summary of results from structured interviews among stakeholders who have courtroom familiarity with each judge being evaluated. We are continuing to take steps to increase cell sizes and cooperation rates for each judge in order to further enhance this evaluation program. 1 Attorneys have the opportunity to evaluate up to 10 judges on an online survey. Among the non- attorney population, court staff, probation officers, and interpreters also have the opportunity to evaluate up to 10 judges on an online survey. The remaining non-attorney populations are mailed a paper survey with the opportunity to evaluate one judge. 23 ## Page 27 Survey of Attorneys Regarding Trial Judges All County Retention Judges Average Sample Size = 4309 A B C D Fail DK/NA Grade 1. Case Management: 1a.Promptly issuing a decision on the case after trial. 50% 17% 5% 1% 1% 25% 3.52 1b.Maintaining appropriate control over proceedings. 63% 23% 9% 3% 2% 1% 3.44 1c.Promptly ruling on pre-trial motions. 48% 21% 7% 2% 1% 21% 3.41 1d.Setting reasonable schedules for cases. 57% 24% 9% 3% 2% 5% 3.40 Overall Case Management 3.44 2. Application and Knowledge of Law: 2a.Being able to identify and analyze relevant facts. 55% 24% 11% 5% 3% 3% 3.26 2b.Basing decisions on evidence and arguments. 51% 23% 12% 6% 4% 4% 3.15 2c.Willing to reconsider error in fact or law. 38% 18% 10% 6% 5% 23% 3.01 2d.Issuing consistent sentences when the circumstances are 50% 23% 10% 4% 3% 11% 3.28 similar. Overall Application and Knowledge of Law 3.18 3. Communications: 3a.Making sure all participants understand the proceedings. 65% 22% 8% 2% 1% 2% 3.49 3b.Providing written communications that are clear, thorough 41% 17% 7% 3% 2% 30% 3.31 and well reasoned. Overall Communications 3.40 4. Demeanor: 4a. Giving proceedings a sense of dignity. 64% 20% 9% 4% 3% 1% 3.39 4b. Treating parties with respect. 65% 17% 9% 4% 4% 1% 3.36 4c. Conducting his/her courtroom in a neutral manner. 58% 19% 10% 6% 5% 1% 3.19 4d. Consistently applying laws and rules. 55% 20% 10% 5% 4% 5% 3.23 Overall Demeanor 3.29 5. Diligence: 5a.Using good judgment in application of relevant law and 52% 23% 11% 6% 4% 3% 3.18 rules. 5b.Doing the necessary homework and being prepared for 51% 22% 9% 4% 3% 11% 3.28 his/her cases. 5c.Being willing to handle cases on the docket even when they 53% 16% 7% 3% 2% 18% 3.38 are complicated and time consuming. Overall Diligence 3.28 Overall Average Grade: 3.31 Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 2012 Judicial Performance Survey Report 24 ## Page 28 Survey of Attorneys Regarding Trial Judges Average All County Retention Judges Grade Sample Size = 4309 Would you say the judge is: Very biased in favor of the prosecution 9% Somewhat biased in favor of the prosecution 30% Completely neutral 49% Somewhat biased in favor of the defense 5% Very biased in favor of the defense 1% Don't know or not sure 5% 8. How strongly do you recommend that the Judge be retained in office, or not be retained in office? Percentages excluding undecided/don't know responses. Strongly recommend retain 70% Somewhat recommend retain 16% Somewhat recommend not retain 7% Strongly recommend not retain 7% Total Retain 86% Total Not Retain 14% Percentages including undecided/don't know responses. Strongly recommend retain 66% Somewhat recommend retain 15% Undecided or Don't Know 5% Somewhat recommend not retain 6% Strongly recommend not retain 7% Total Retain 81% Undecided/Don't Know 5% Total Not Retain 13% 2012 Judicial Performance Survey Report 25 ## Page 29 Survey of Non-Attorneys Regarding Trial Judges All County Retention Judges Average Sample Size = 9360 A B C D Fail DK/NA Grade 1. Demeanor: 1a.Giving court proceedings a sense of dignity. 73% 17% 5% 2% 2% 1% 3.59 1b.Treating participants in the case politely and with respect. 77% 14% 4% 2% 2% 1% 3.61 1c.Conducting court in a neutral manner. 74% 15% 5% 2% 3% 1% 3.56 1d.Having a sense of compassion and human understanding 70% 16% 5% 3% 4% 2% 3.48 for those who appear before the court. Overall Demeanor 3.56 2. Fairness: 2a.Giving participants an opportunity to be heard. 75% 15% 4% 2% 3% 2% 3.60 2b.Treating those involved in the case without bias. 73% 14% 4% 2% 4% 2% 3.53 2c.Treating fairly people who represent themselves. 53% 10% 3% 2% 3% 29% 3.53 2d.Giving each side enough time to present his or her case. 72% 14% 4% 2% 3% 5% 3.60 Overall Fairness 3.57 3. Communications: 3a.Making sure participants understand the proceedings, and 77% 14% 4% 2% 2% 1% 3.64 what is going on in the courtroom. 3b.Using language that everyone can understand. 77% 16% 4% 1% 1% 1% 3.67 3c.Speaking clearly so everyone in the courtroom can hear 79% 14% 3% 1% 1% 1% 3.71 what is being said. Overall Communications 3.67 4. Diligence: 4a.Beginning court on time 66% 20% 6% 3% 3% 3% 3.49 4b.Maintaining appropriate control over proceedings. 78% 14% 4% 1% 1% 2% 3.69 4c.Setting reasonable schedules for cases. 64% 16% 4% 2% 2% 13% 3.59 4d.Being prepared for cases. 72% 14% 4% 2% 2% 7% 3.62 4e.Managing court proceedings so that there is little wasted 68% 19% 6% 2% 2% 2% 3.52 time. Overall Diligence 3.58 5. Application of Law: 5a.Giving reasons for rulings. 66% 17% 5% 2% 3% 8% 3.51 5b.Willing to make decisions without regard to possible 61% 12% 4% 2% 3% 18% 3.53 outside pressure. 5c.Being able to identify and analyze relevant facts. 67% 14% 4% 2% 4% 8% 3.52 Overall Application of Law 3.52 Overall Average Grade: 3.58 Note: Respondents rated judges on various questions using an A to F scale, in which the grades were then converted to numerical scores: A= 4, B=3, C=2, D=1 and F=0. An average score of 4.0 is the highest possible score and a 0.0 is the lowest possible score. 2012 Judicial Performance Survey Report ## Page 30 Survey of Non-Attorneys Regarding Trial Judges Average All County Retention Judges Grade Sample Size = 9360 6. How biased do you think the Judge is toward the defense or prosecution? [Please see the questionnaire at the end of report for question wording.] Biased in favor of the prosecution total 12% Competely neutral 82% Biased in favor of the defense total 6% Average 0.15 7. How lenient or harsh do you think the sentences generally handed down by Judge are? [Please see the questionnaire at the end of report for question wording.] Harsh sentencing total 12% Competely neutral 78% Lenient sentencing total 10% Average 0.14 10. How strongly do you recommend that the Judge be retained or not retained in office? Percentages excluding undecided/don't know responses. Strongly recommend retain 84% Somewhat recommend retain 8% Somewhat recommend not retain 3% Strongly recommend not retain 5% Total Retain 92% Total Not Retain 8% Percentages including undecided/don't know responses. Strongly recommend retain 77% Somewhat recommend retain 7% Undecided or Don't Know 8% Somewhat recommend not retain 2% Strongly recommend not retain 5% Total Retain 84% Undecided/Don't Know 8% Total Not Retain 7% 2012 Judicial Performance Survey Report ## Page 31 QQuueessttiioonnnnaaiirreess ## Page 32 Colorado Judicial Performance Attorneys Regarding Trial Judges Survey Questions _ Which of the following types of cases have you observed Judge (Last Name)’s performance? Please circle all that apply. (Only respondents who indicate they have observed the judge in “criminal other than traffic” cases will be asked question 2d and the “bias” question between 5 and 6.) Civil . 1 Criminal other than traffic . 2 Traffic . 3 Domestic . 4 Juvenile . 5 Probate . 6 Other . 9 Using a grade scale, where an "A" is excellent along with B, C, D or F for fail, please grade Judge [Last Name] on the following. If, for a specific question you feel that you do not have enough information to grade the judge, please check DK/NA for Don't Know/Not Applicable. 1. Case Management: a. Promptly issuing a decision on the case after trial. A B C D F DK/NA b. Maintaining appropriate control over proceedings. A B C D F DK/NA c. Promptly ruling on pre-trial motions. A B C D F DK/NA d. Setting reasonable schedules for cases. A B C D F DK/NA 2. Application and Knowledge of Law: a. Being able to identify and analyze relevant facts. A B C D F DK/NA b. Basing decisions on evidence and arguments. A B C D F DK/NA c. Willing to reconsider error in fact or law. A B C D F DK/NA d. [Criminal only] Issuing consistent sentences when the circumstances are similar. A B C D F DK/NA 3. Communications: a. Makings sure all participants understand the proceedings. A B C D F DK/NA b. Providing written communications that are clear, thorough and well reasoned. A B C D F DK/NA 4. Demeanor: a. Giving proceedings a sense of dignity. A B C D F DK/NA b. Treating participants with respect. A B C D F DK/NA c. Conducting his/her courtroom in a neutral manner. A B C D F DK/NA d. Consistently applying laws and rules. A B C D F DK/NA 1 ## Page 33 5. Diligence: a. Using good judgment in application of relevant law and rules. A B C D F DK/NA b. Doing the necessary “homework” and being prepared for his/her cases. A B C D F DK/NA c. Being willing to handle cases on the docket even when they are complicated and time consuming. A B C D F DK/NA Having observed Judge (Last Name) in a criminal case, would you say the judge is: (This question is asked only if respondent indicated at the beginning of the survey he/she observed the judge in a criminal case.) Very biased in favor of the prosecution . 1 Somewhat biased in favor of the prosecution . 2 Completely Neutral . 3 Somewhat biased in favor of the defense . 4 Very biased in favor of the defense . 5 Don’t Know/Not Sure . 9 6. What would you say are Judge (Last Name)’s strengths? _ _ _ 7. What would you say are Judge (Last Name)’s weaknesses? _ _ _ 8. Keeping in mind your responses to each of the previous questions, how strongly do you recommend that Judge (Last Name) be retained in office, or not be retained in office? Strongly recommend he be retained in office . 5 Somewhat recommend he be retained in office . 4 Undecided or don’t know enough to make recommendation . 3 Somewhat recommend he not be retained in office . 2 Strongly recommend he not be retained in office . 1 2 ## Page 34 9. And what would you say are Judge [Last Name]’s weaknesses? ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ ___________________________________________________________ Commission on Judicial Performance ___________________________________________________________ ___________________________________________________________ Evaluation of 10. Keeping in mind your responses to each of the previous questions, how JUDGE [FULL NAME] strongly do you recommend that Judge [Last Name] be retained in office, or not retained in office? Strongly recommend he/she be retained in office ................................ 5 Somewhat recommend he/she be retained in office ............................ 4 Undecided or don’t know enough to make recommendation ............. 3 If we have made a mistake and you either were not in Judge [Last Somewhat recommend he/she not be retained in office ..................... 2 Name]’s courtroom or you feel that you do not have sufficient Strongly recommend he/she not be retained in office ......................... 1 experience with Judge [Last Name] to have an opinion the judge’s judicial performance, please just return this questionnaire, unanswered, in the enclosed postage-paid envelope, to stop any further requests to evaluate Judge [Last Name]. Thank you for taking the time to complete this questionnaire. Please place it in the self-addressed, postage-paid envelope provided and place it in the mail. Your participation in this survey is very much appreciated. Using a grade scale, where an “A” is excellent along with B, C, D or F for fail, please grade the judge on the following. (If you feel that you don’t have experience with the judge in a specific area, or just don’t know, please circle the number corresponding to “Don’t Know/Not Applicable”—DK/NA). DK 1. Demeanor: A B C D F N/A a. Giving court proceedings a sense of dignity. 4 3 2 1 0 9 b. Treating participants in the case politely and with respect. 4 3 2 1 0 9 c. Conducting his/her courtroom in a neutral manner. 4 3 2 1 0 9 d. Having a sense of compassion and human understanding for those who appear before him/her. 4 3 2 1 0 9 Barcode ## Page 35 DK 6. [If you were in [Last Name]’s courtroom during a criminal case or 2. Fairness: A B C D F N/A cases please answer this question, otherwise skip to the next a. Giving participants an opportunity to be heard. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Treating those involved in the case without bias. 4 3 2 1 0 9 number how biased you think Judge [Last Name] is toward the defense or c. Treating fairly people who represent themselves. 4 3 2 1 0 9 the prosecution. If you feel Judge [Last Name] is completely unbiased, circle “0.” d. Giving each side enough time to present his or her case. 4 3 2 1 0 9 Bias toward Completely Bias toward Defense Neutral Prosecution DK 5 4 3 2 1 0 1 2 3 4 5 3. Communications: A B C D F N/A a. Makings sure participants understand the 7. [If you were in [Last Name]’s courtroom during a criminal case or proceedings, and what’s going on in the cases please answer this question, otherwise skip to the next courtroom. 4 3 2 1 0 9 question.] On the scale below, please indicate by circling the appropriate b. Using language that everyone can understand. 4 3 2 1 0 9 number how lenient or how harsh you think the sentences generally handed c. Speaking clearly so everyone in the courtroom down by [Last Name] are. If you feel Judge [Last Name] generally hands can hear what’s being said. 4 3 2 1 0 9 down appropriate sentences, circle “0.” DK Sentences Appropriate Sentences 4. Diligence: A B C D F N/A Too Light Sentences Too Harsh a. Beginning court on time. 4 3 2 1 0 9 5 4 3 2 1 0 1 2 3 4 5 b. Maintaining appropriate control over proceedings. 4 3 2 1 0 9 c. Setting reasonable schedules for cases. 4 3 2 1 0 9 d. Being prepared for his/her cases. 4 3 2 1 0 9 Though your name will never be associated with your answers, because the judge will e. Managing court proceedings so that there is see a typed transcript of the comments that you and others write, it is important that little wasted time. 4 3 2 1 0 9 you do not include information in the comments below that would unintentionally identify you as the author. 8. What would you say are Judge [Last Name]’s strengths? DK ___________________________________________________________ 5. Application of Law: A B C D F N/A ___________________________________________________________ a. Giving reasons for rulings. 4 3 2 1 0 9 ___________________________________________________________ b. Willing to make decision without regard to ___________________________________________________________ possible outside pressure. 4 3 2 1 0 9 ___________________________________________________________ c. Being able to identify and analyze relevant facts. 4 3 2 1 0 9 ___________________________________________________________ Continued on Back Page
- 2008 cycle
- 2008 Retention Survey Report(PDF on OJPE)Structured scores pending
Full numeric extraction isn’t complete for this cycle’s layout yet. Open the source PDF above for the underlying data.
Score cards render where the PDF extractor found numeric fields (partial is shown with “—” for missing tiles). “Read full survey text” surfaces the complete report transcription for every survey on file. Source PDFs on OJPE are always linked above for fidelity. Coverage note on Sources.
Sources
- 2016 evaluation on OJPE · scraped Apr 17, 2026
- 2012 evaluation on OJPE · scraped Apr 17, 2026
- 2008 evaluation on OJPE · scraped Apr 17, 2026