Just Do It!

The views expressed are those of the author and do not necessarily reflect the views of ASPA as an organization.

By Shone Hughes
September 20, 2024

As the Michael Jordan and Nike collaboration slogan state, “Just Do It!” Well, you may ask, just do what? Program evaluation is what we must do. More specifically, we must integrate ongoing methodologically sound program evaluation into public service. Fortunately, there are no high jumps or three point shots required to conduct a methodological sound program evaluation. Nevertheless, fearless team players are required to systematically assess the program design, implementation and outcomes. Fear among program administrators, managers and employees is a common barrier to conducting a solid program evaluation. Program evaluation anxiety stems from fear that evaluation results will reveal deficiencies followed by negative consequences such as loss of funding, employee scapegoating and increased scrutiny from administrators and external stakeholders. It is important for program managers to acknowledge their own anxiety and employees’ anxiety surrounding evaluations. Acknowledging and addressing anxiety allows the evaluation process to focus on scoring a solid evaluation that measures program effectiveness, efficiency, economy and equity.  

Advantages of Evaluations

There are several advantages to conducting a methodologically sound program evaluation. Program evaluations empower programs to achieve better outcomes for citizens to ensure that resources are used efficiently and equitably to address individual and community needs. In all, evaluations provide an avenue to measure the organization’s public value. More specifically, to assess the organization’s responsiveness to individual and community needs. Evaluation data can uncover areas of improvement which allows an organization to increase public value. It is an opportunity to gather data to better understand the program participants’ experiences. Based on data, organizations can make informed decisions regarding program continuation, program adaptation or funding. Consequently, evaluations empower organizations to remain accountable to funders and stakeholders.

Guiding Principles to a Successful Evaluation

• Make transparency a priority. Transparency reduces anxiety through clear and ongoing communication with employees. Provide ongoing clear communication on the overall evaluation process, including performance metrics, methods and how findings will be used.
• Practice integrity. Practice and maintain integrity by avoiding conflicts of interest and handle data responsibly.
• Clearly articulate program goals. Clearly articulate program goals. This involves setting specific and measurable goals and outcomes.
• Collect quality data. Create and maintain quality data that documents goals, activities, inputs, outputs and outcomes. Use and demonstrate how data are used to make informed decisions.
• Eliminate ambiguity. Develop specific performance indicators to measure program effectiveness. Performance indicators should include outputs, or the number of services delivered. Performance indicators should also include outcomes, or improvements in community well-being.
• Use evaluation as a learning tool. Frame evaluations as an opportunity for program growth and learning. Emphasize that evaluations are a tool for learning and improving programs, not just for assessing performance.
• Focus on program performance. Emphasize that the evaluation focuses on the program and services, not individuals. Highlight successful examples of how evaluations have led to positive programmatic changes.
• Invest in human capital. Nurture frontline employees prior to the evaluation by providing support and training to help frontline employees feel confident in their position, which ultimately improves performance. Similarly, provide employees responsible for carrying out evaluations with resources and support to navigate evaluative processes. For example, dedicated time to focus on evaluation tasks and access to evaluation experts.
• Shared responsibilities. Engage employees in developing program goals to foster a sense of shared responsibility in improving outcomes.
• Consult with experts. Hire an evaluation expert trained in a variety of evaluative methods.
• Triangulate Data. Use a variety of quantitative and qualitative data collected over time from different sources to measure program outcomes and impact. Those methods may include case studies, documents, surveys, interviews and/or focus groups.
• Implement ongoing evaluations. Plan and efficiently integrate periodic evaluations into the program ongoing activities to minimize disruptions.
• Engage stakeholders. Importantly, engage stakeholders including populations served in all phases of the evaluation.
• Disseminate findings. Share the results with all stakeholders including funding partners, citizens and communities served.

Celebrate Success

By addressing anxiety, organizations can enhance their program evaluations and use insight to better serve their communities. Similar to winning a game, organizations should celebrate successes. Evaluations requires a tremendous amount of dedication and bravery so it is important to celebrate such a huge achievement. Additionally, organizations should celebrate improvements discovered from evaluations. For example, offer the team a meaningful wage boost, use social media to broadcast achievements or offer paid opportunities for professional development. This positive reinforcement shifts evaluation anxiety to an organizational growth mindset.

---

Author: Dr. Shone Hughes is an Assistant Professor in the College of Public Service at Tennessee State University. Prior to teaching, Shone served as Program Manager at a non-profit providing care to children and families. Shone’s expertise includes program evaluation and social equity.  Shone can be reached at [email protected] 

(1 votes, average: 5.00 out of 5)
Loading...