Participatory Evaluation

What is participatory evaluation, and how is it conducted?

Traditional evaluation is often seen as something that is done to people (Patton, 1990). Participatory evaluation is different. It is a bottom-up approach to evaluation that is guided either partially or fully by interested program participants, staff, board members, and community members. Participants ask the questions, plan the evaluation design, gather and analyze data, and determine actions to take based on the results (Zukoski and Lulaquisen, 2002). Throughout the process, participants' perspectives are weighted equally to those of the evaluator (Kellogg, 1998). Because of its focus on empowerment, participatory evaluation may be particularly well suited for environmental education (EE) programs (McDuff and Jacobson, 2001).

The following table highlights some of the advantages and disadvantages of participatory evaluation.

Advantages Disadvantages
May be less expensive than hiring an external evaluator Process requires more time
Gives participants more control over decision-making Demands more coordination and is often more challenging to facilitate
Participants feel responsible for the results and are more committed to the success of the program Requires investment in evaluation training for participants
Collaborative process builds and strengthens participants’ relationships Requires committed and motivated participants
Evaluation results are more likely to be acted on Staff turnover at inopportune time would be very disruptive
Increases participants’ knowledge of the program, skills in leadership, group decision-making, and evaluation  

(Adapted from Zukoski and Lulaquisen, 2002)

This policy brief provides an introduction to participatory evaluation. As suggested by the title, it defines participatory evaluation, explains reasons for conducting it and the challenges involved. Public health examples are included. Other information includes a table comparing participatory and traditional evaluation, a list of guiding principles, an explanation of when it is most useful, a list of relevant techniques, and steps for conducting participatory evaluation.

Participatory Evaluation. What is it? Why do it? What are the challenges? (.pdf)
Zukoski, A. and M. Lulaquisen. (2002).
Beginner Intermediate
This policy brief provides an introduction to participatory evaluation. As suggested by the title, it defines participatory evaluation, explains reasons for conducting it and the challenges involved. Public health examples are included. Other information includes a table comparing participatory and traditional evaluation, a list of guiding principles, an explanation of when it is most useful, a list of relevant techniques, and steps for conducting participatory evaluation.

Needs Assessment for Participatory Evaluation of Environmental Education Programs (.pdf)
McDuff, M. (2002); AND Participatory Evaluation of Environmental Education: Stakeholder Assessment of the Wildlife Clubs of Kenya (.pdf)
McDuff, M. and S. Jacobson. (2001).
Intermediate
These two studies describe a participatory needs assessment and participatory evaluation of the Wildlife Clubs of Kenya, Africa’s largest EE organization for youth. Details are provided on the process, tools, and results of each. The second study also discusses the relevance of participatory evaluation for EE programs, and describes how the Wildlife Clubs of Kenya used evaluation results to institutionalize evaluation and improve its programs.

Who are the Question Makers? A Participatory Evaluation Handbook
Office of Evaluation and Strategic Planning, United Nations Development Programme. (1997).
Beginner Intermediate Advanced
This handbook provides concrete guidance on how to conduct a participatory evaluation, describes the evolution of the approach, and compares it with conventional evaluation. Part Five is a stand-alone training module that can be used as a mini-workshop on participatory evaluation. It describes the steps in conducting a participatory evaluation using a case study on a rural water supply project. The appendices provide examples of participatory evaluation tools, and additional resources.

Empowerment Evaluation Blog
Dr. David Fetterman, (2006).
Beginner Intermediate
This website provides a wealth of information on empowerment and participatory evaluation. It includes a brief introduction and a more detailed description of empowerment evaluation, an in-depth list of online resources, handbooks, guides, software, relevant organizations, and information about the Collaborative, Participatory, and Empowerment section of the American Evaluation Association.

 

Participatory evaluation: It does not have to be all or nothing

 
 

Why and how to involve youth?

If your EE program involves youth, consider offering them a meaningful role as evaluators. Imagine what it would be like if they were invited to serve as consultants, evaluation team members, or even leaders of the evaluation. The opportunity may:

  • enhance their social development
  • prepare and motivate them to become agents of social change
  • improve their sense of empowerment and ownership of the program
  • strengthen relationships between youth and adults
  • improve the evaluation

(Adapted from Checkoway and Richards-Schuster, 2003)

The following resources provide details on how to involve youth in participatory evaluation, along with other relevant information.

Youth Involvement in Evaluation and Research
Horsch, K., P. Little, J.C. Smith, L. Goodyear, and E. Harris, Harvard Family Research Project. (2002).
Beginner Intermediate
This brief gives reasons for involving youth in evaluation, describes groups that conduct evaluations with youth, and explains how to best involve youth. It also includes five elements of successful evaluation projects involving youth, such as providing adequate training and support for youth and adult staff.

Participatory Evaluation with Young People (.pdf) AND Facilitator’s Guide for Participatory Evaluation with Young People (.pdf)
Checkoway, B. and K. Richards-Schuster. (2003).
Beginner Intermediate
This instructional set consists of a workbook to prepare youth to participate in evaluation, and an accompanying guide for the adult facilitator. The workbook has hands-on learning tools and activities that prepare young people for, and walks them through the steps of participatory evaluation. Additionally, the authors include an introduction to participatory evaluation, obstacles to youth participation in evaluation, and evaluation roles that young people can play. The facilitator’s guide provides supplementary information, activities, and examples to improve delivery and expand upon the workbook material.

Youth Participatory Evaluation: A Field in the Making: New Directions for Evaluation Sabo, K., ed. (2003).
Youth Participatory Evaluation: A Field in the Making: New Directions for Evaluation Sabo, K., ed. (2003).
Intermediate Advanced
Available for purchase from publisher.
This issue of the journal, New Directions for Evaluation, describes the many ways that youth have been involved in participatory evaluation. Case studies demonstrate how young people have strengthened evaluations and enhanced programs.

 

Involving youth: Is it worth it?

 
 
 

Not just for children?

 
 

References

Jackson, E.T. and Y. Kassam. Knowledge Shared. (1998). Bloomfield, CT: Kumarian Press, p. 3.

Kellogg Foundation. (1998). W.K. Kellogg Foundation Evaluation Handbook. Retrieved August 2010 at: http://www.wkkf.org/knowledge-center/resources/2010/w-k-kellogg-foundation-evaluation-handbook.aspx

McDuff, M. and S. Jacobson. (2001). Participatory evaluation of environmental education: Stakeholder assessment of the wildlife clubs of Kenya. Retrieved August, 2010 at: http://www.multilingual-matters.net/irgee/010/0127/irgee0100127.pdf

Sabo, K. (2001). The benefits of participatory evaluation for children and youth. PLA Notes. 42: 48-51. Retrieved August, 2010 at: http://pubs.iied.org/pdfs/G01967.pdf

Patton, M.Q. (1990). Qualitative Evaluation Methods. Beverly Hill, CA: Sage Publications.

Zukoski, A. and M. Lulaquisen. (2002). Participatory Evaluation. What is it? Why do it? What are the challenges? Community-based public health: Policy and practice. Retrieved June, 2006 at: http://depts.washington.edu/ccph/ pdf_files/Evaluation.pdf