At Innovation Network, we think they have a lot in common. Both are inquisitive. They challenge the status quo. And they both seek to answer the question: What difference are we making?

Over the past twelve years, we have worked with hundreds of nonprofits and social enterprises to integrate the entrepreneur’s quest to do things better with the evaluator’s quest to understand what works and why. Through our work, we have found that when organizations evaluate their work, they have the knowledge and skills to:

• Manage their internal matters, programs, and services effectively;
• Gain a stronger understanding of what is happening in their programs, and how those programs are affecting people and communities; and
• Collectively raise a strong voice in funding and policy decisions.

In our experience, evaluation empowers organizations and becomes a catalyst for social change.

Getting Practical

For many, evaluation sounds good—in theory. But let’s get practical. Most social entrepreneurs are the program director, fundraiser, spokesperson, bookkeeper and general jack-of-all-trades. Adding evaluator to the list doesn’t seem feasible.

Believe it or not, evaluation is easier than one might think. And, evaluation is high-impact; a little bit goes a long way. For example, in our work to break down the barriers to evaluation, we recommend the use of a logic model. A logic model is a commonly used tool for clarifying and depicting a program and its intended outcomes. It shows the relationships between what is put into the program (resources), what the program does (activities and outputs), and what results (outcomes) the program produces over the short and long term. Click here to view a sample logic model.

"Evaluation is high-impact; a little bit goes a long way."

Because entrepreneurs wear so many functional hats and are entrenched in “doing the work,” the logic model helps to bring a big picture perspective to their work. It articulates the results you want achieve and what change you want to occur as a result of your work.

The logic model is a useful tool for social entrepreneurs, because it also wears multiple hats and serves many purposes. For example:

Program Planning & Management. Used at the onset of a program, or even during the concept stage, the logic model will help you think through program strategy—to help clarify where you are and where you want to go. It “connects the dots” between resources, activities and outcomes and can bring focus and prioritization to your work.

Communication & Consensus Building. The logic model presents a snap shot of your program and is a powerful communication tool. It can be shared with board members, volunteers, staff, colleague organizations and donors to build common understanding around your work and what you hope to achieve. Increasingly, funders, particularly in the international arena, are requiring prospective and current grantees to submit logic models.

Evaluation. A logic model helps you articulate intended outcomes. As a result, you evaluate the short, intermediate and long-term impact of your work. If you don’t know where you are going, how will you know when you get there?

Accountability. When your program components and outcomes are clearly articulated, stakeholders know you’re accountable. It provides a framework for you to be responsible and answerable to your goals.

At its core, the logic model helps to make the entrepreneurial vision tangible. Let’s face it. In this results-based world, you can’t secure funding and resources on good intentions and passion alone. The business lexicon of ROI, bottom-line results, measurable outcomes, and high performance has created an analytical lens through which the complex and often intangible work of social change is discussed. The logic model is a planning tool that will help ensure your success.

Getting Started

If you’re interested in creating a logic model, there are a number of resources to support you. A good place to start would be Innovation Network’s Logic Model Builder. The Logic Model Builder is a free online tool that walks through a step-by-step process to create a logic model. It can be accessed on our website at http://www.innonet.org.

Other Resources: Online course on developing logic models and evaluation plans: an online course from the University of Wisconsin, Extension on developing and applying logic models. Designed for the beginner, this user-friendly course includes an audio track, worksheets, resources, and examples. Logic Model Overview: a logic model overview with links to workbooks, PowerPoint presentations, etc. from the University of Wisconsin, Extension. W.K. Kellogg Foundation Logic Model Development Guide: a clear and concise discussion of the use of logic models and their importance for program and evaluation planning. Introducing Program Logic Models: a six-page summary of logic model concepts prepared by the Kellogg Foundation. Outcomes Based Evaluations Using the Logic Model: a training program from SAMHSA about logic models and evaluation.

Veena Pankaj is a Project Manager at Innovation Network where she provides oversight and technical assistance to grassroots nonprofits in the areas of program planning, evaluation and capacity building.

Heather Peeler is a Senior Associate and works with the nonprofit community to encourage usage of Innovation Network’s free online tools.

Innovation Network, Inc. ("InnoNet"), is a national 501(c)(3) nonprofit that builds the evaluation capacity of nonprofits and funders. InnoNet offers free Web-based tools for nonprofit program planning and evaluation at http://www.innonet.org.

hpeeler - Jan 10, 2005 2:30 pm (#1 Total: 30)
Innovation Network


Thanks for participating in this discussion on evaluation. Veena and I look forward to your questions and comments. To start the conversation, we’d like to hear from you.

Have you used a logic model in your work? If so, please share your experiences and opinions – both positive and negative – about the usefulness of this tool.

BChevalier - Jan 11, 2005 3:57 pm (#2 Total: 30)


Are there some programmatic areas / program structures that translate better to a logic model than others? The first nonprofit I worked for years ago didn't have programs exactly -- they put teams of consultants together to work on international development contracts, but those contracts weren't exactly programs (or if they were, they weren't the organization's programs.) And another group I worked with more recently had very complicated programs with multiple intervention strategies and multiple goals. The second group tried to use logic models, but shoehorning their 5 goals into the logic model resulted in a document so unwieldy that no-one wanted to work with it (which made it basically useless). Is there some "happy medium" that best fits into the logic model structure?

Veena_Pankaj - Jan 11, 2005 4:31 pm (#3 Total: 30)


You bring up a very good question. Are logic models useful for all program types? Unfortunately, I cannot argue that this one model can be applicable to ALL programs. However, I would like to add that if used correctly, it can be a very useful planning tool for MOST programs. A logic model can be viewed as a visual representation of your program. It’s a tool that can help graphically represent what it is you are doing, either by program goal, or major content area that exists within your program. In your first example, where teams of consultants were put together to work on international development contracts – each of those contracts must have had a main purpose or intended goal (or even multiple goals). These goals could have further been broken down into individual activity groupings or components that could illustrate the causal link between the activities or strategies and the intended outcomes. While this technique may seem unwieldy at first, it is extremely powerful in identifying common outcomes and coordinating program strategies.

In your second example, you mention that the organization had very complicated programs with multiple goals and strategies. The logic model can be extremely useful in breaking down complex programs into more manageable pieces. In addition, when you are developing a logic model, it’s important to have the staff members involved in each aspect of your program be involved in creating that particular component of your model. Ensuring that major stakeholders are involved in your planning process can help ensure buy-in to your overall program strategies and outcomes. I hope this answers your question! Thanks for visiting the Social Edge website.

Kurt - Jan 12, 2005 11:30 am (#4 Total: 30)


As a newcomer to the f measurement field: what is the difference between using a logic model, and a scorecard? Or is it the same?

ebroze - Jan 12, 2005 11:36 am (#5 Total: 30)


I have not used the model, however the last NPO I worked with in a fundraising experience could have been an opportunity for that organization to use it. They used the survey method only. I agree that it is as important to use evaluation in management tactics as is strategic planning.Thanks for posting the model

taiyashiner - Jan 12, 2005 11:53 am (#6 Total: 30)


I have been working with the logic model for about 2 years and it is still in draft format - it seems that as the organization and our programs become more focused the logic model is more useful.

I have been creating an logic for each program and just decided to create one for the organization as well.

The difficulty seems to be that when I was creating the model that it seemed to become too detailed? Any ideas on how detailed to become?(I know and agree that we need to have a group effort around the logic model - still building volunteer/committee capacity.)

Thank you in advance for your consideration.

Karen Guskin - Jan 12, 2005 12:00 pm (#7 Total: 30)


As the national HQ, we created a logic model for our home visiting program. We then had to get it out to the field and are working to get everyone familiar with it -- for example, integrating it into the training we do for parent educators. We have gotten good feedback on how helpful it is for describing our program to stakeholders and of course people like that it clearly specifies outcomes.

Cass - Jan 12, 2005 12:58 pm (#8 Total: 30)


I began using a logic model to better organize and clarify my thinking about our education programs. I knew there were gaps in understanding imputs and outcomes. As the years have gone by, we've used it as a group to come to consensus about what we think we're doing and whether or not the data we gather demonstrates it. It promotes reflective thinking about the work.

Cass - Jan 12, 2005 1:13 pm (#9 Total: 30)


We resorted to the logic model to clarify what we wanted to accomplish and how we would do it in our collaborations--our small non-profit literary center uses it for collaborating with partners: a research project, a collaborative educational program and an administrative collaboration. An unexpected result was the ability to find language that really described, concretely what, who, when and where. The logic model forces everyone to sit down, slow down and think. It can greatly encourage deeper understanding, dreaming, conversation and better results.

Veena_Pankaj - Jan 12, 2005 2:34 pm (#10 Total: 30)


--Your Message Here-- A score card is generally a performance management tool used by for-profit businesses that help them focus on internal processes, financial management and clientele. A scorecard helps to link organizational strategies to a performance measurement system. I see the logic model as a scorecard for nonprofits. A logic model can help link the activities or strategies of a program to its intended outcomes. These outcomes can then be assessed to determine the overall effectiveness of a program. I hope this is helpful.

Veena_Pankaj - Jan 12, 2005 2:46 pm (#11 Total: 30)


--Your Message Here-- The advice I usually give to the organizations that I work with is this: It can be as detailed as you want or need it to be. Typically people have different versions of a logic model depending on who the audience is. When using a logic model to show a funder or a board member, I usually limit the amount of detail that’s portrayed. For the most part, these audiences aren’t too interested in the minute details of the program. When using it for internal purposes with program staff, I tend to include more detail. In developing a logic model you don’t necessarily want it to be too detailed or task oriented. That type of detail belongs in a work plan. A logic model should include enough detail to give you and those you work with a general framework for your program. Good luck with your program planning!

sista - Jan 12, 2005 2:55 pm (#12 Total: 30)


We are a non for profit orgn. that provides a holistic-approach to selfsufficiency to individuals in our improvised communities by net working and applying available resources. our purpose is to aid with Hands-up not Hands-outs. we work with victims of homelessness we work with former offenders and dislocated individuals. We take what we know and apply it. we provide motivational work-shops as well as educational resources with financial literacy We are for change and the change we provide is showing others how to make a meal with a loaf of bread a can of pork-beans and no meat. when people have no life support they learn nothing regarding life. so we are a part of a support

hpeeler - Jan 12, 2005 5:52 pm (#13 Total: 30)
Innovation Network


Karen, thanks for sharing your experience using the logic model to build buy-in with stakeholders. Have you had success using the logic model with your funders or potential funders?

hpeeler - Jan 12, 2005 5:56 pm (#14 Total: 30)
Innovation Network


Cass, thanks for sharing how you have used the logic model to build internal consensus and agreement about your programs. Involving multiple stakeholders in the process can be a challenge. What were some of the hurdles you and your colleagues encountered and how did you overcome them?

amanuel melles - Jan 12, 2005 7:17 pm (#15 Total: 30)
With people, with ideas, in action


Thanks for starting this discussion on logic models. I do use logic models (LM) and provide training to non-profits on evaluation, including LM. An area that I'm interested to find out more info is the use of LM in the context of community outcomes (as opposed to service outcomes), where results tend to happen over long-term. Would be super to hear from anyone who has experience or can refer me to cases out there. Thanks.

amanuel toronto, canada

Karen Guskin - Jan 12, 2005 7:24 pm (#16 Total: 30)


Great question -- our local program sites have used the logic model to apply for funding and we have used it at National to help write grants. In both cases, it's been a useful tool, but since it's relatively new, I'm not sure that we have the data on the success of the grants yet. Your question makes me think about how we might best get this information from our local sites.

jcm0114 - Jan 13, 2005 7:54 am (#17 Total: 30)


I am a doctoral student in an educational leadership program in NC. One of my current courses is program evaluation. We are meeting tonight for the first time so I'm not sure what models will be taught as part of the course work. The texts we will be using are Assessment Essentials by Catherine Palomba & Trudy Banta (1999) and Evaluation: A Systematic Approach by P. Rossi, M. Lipsey, and H. Freeman (2004).

I have printed out information from this site and will be sharing it during our class this evening if given an opportunity to do so. I look forward to future discussions regarding program evaluations on this site to receive insight into my own learning.

Cgasca - Jan 13, 2005 12:50 pm (#18 Total: 30)
Social Entreprenuer


This link will direct you to a logical framework model, which I found useful in my consulting work.
http://www.ausaid.gov.au/ausguide/ausguidelines/1.cfm

As a consultant I found that there are many intagible benefits that a service may provide and such transaction may be difficult to measure. The logical framework helps you sort out what is measurable and what is not and how your actions link to your intended mission or goal. However, I usually filter my analysis through several logic models such as the 4p's of marketing and business logic, sales, operations, finance. In social services there more clinical means to measure outcomes, however, their application to soft/intangibles such as self-sufficiency is hard to incorporate.

Kzakama - Jan 14, 2005 6:54 am (#19 Total: 30)


I have just regisered to participate in this discussion, which I believe is a very useful one with practical outcomes for all of us.

First, I ask a question, is the logic model the same as logical framework (logframe)?

While I worked with a small NGO, we did not need the logframe because we were applying for small grants and lacked the skills to use the model. However, in the organisation I now work, we use the logframe for big projects. This then may validate the fact that the size of the project does matter. And of course, logic model does require some training.

Since our work is mainly capacity building for local NGOs, we do not require them to use logframes, even though their activities feed into our evaluation for the main project. Rather, the local partners are expected to use participatory monitoring and evaluation tools to evaluate the impact of their activities. This means that members of the communities where our partners work get to decide what change they want to see, how they want to measure the change and how they will they know/tell that change has occured. We use simple participatory tools that the communities are comfortable with.

I am willing to share a few examples of this approach as I settle into the discussion.

Robin Kane - Jan 14, 2005 8:48 am (#20 Total: 30)


Great question, Amanuel. I would also like to hear from others about on-the-ground examples of using the logic model in community efforts.

One thought is that the logic model can complement methods often used for community-level initiatives.

Innovation Network frequently works with funders who are engaged in community-wide efforts that involve multiple organizations and programs. Some of these efforts use Results-Based Accountability or Theory of Change processes to identify the population-level outcomes that are jointly sought and the preconditions that would be necessary for success.

Each organization or program in these community efforts is responsible for more narrow outcomes. At the same time, these groups are engaged in many activities that will not be reflected in a model of the larger community effort.

The logic model can help especially on this level to organize and help prioritize the work of those groups and programs. The longer-term outcomes identified in each program's logic model should then mirror outcomes or preconditions identified in RBA or theories of change for the larger community effort.

jabstuart - Jan 14, 2005 10:39 am (#21 Total: 30)


I am self-learned in using a logic model, and used it at my previous organization to include in grant proposals. At first it was very difficult to figure out the proper sequence of activities and how they lead to a particular outcome. But it forced me to really clarify the solution I was proposing, and how the inputs and activities of different partners would coordinate together to achieve the anticipated outcomes. Using a logic model also helped me to identify redundancies and inconsistencies in the narrative. Once I had a solid logic model in place, it made the rest of the proposal fall in place so it actually helped the writing process.

Barbara Kibbe - Jan 15, 2005 9:06 am (#22 Total: 30)
Vice President for Program and Effectiveness at the Skoll Foundation


It's my experience that any analytical tool - logic model, benchmarking, zero-based planning or even traditional strategic planning can be used well or poorly. But a logic model is particularly tricky because if you don't include outside and diverse perspectives, it can devolve into an exercise of rationalizing what we already do rather than a meaningful process of discovering the most relevant and impactful work to reach a goal. At its best, a logic model is a great tool for aligning an organization and all its resources toward a meaningful hoped for outcome.

(N.O.A.W. FND) PJ Williamson - Jan 15, 2005 10:17 am (#23 Total: 30)


All these post's have helped me make a decision to use the logic model or to ask for assistance in creating one. I am a new founder of a non-profit organization called the "Nathan Osburn & Aaliyah Wagley Foundation" AKA Care For The Kids at www.careforthekids.org. Eliminating fire injury,death and loss of property, and temporary assistance to home fire victims through public fire education, prevention, and temporary financial assistance programs in our local communities. I know what programs I want to create, but putting it into writing and action is difficult. I have networked with other organization's and individuals in an effort to learn form others on what works and their approaches. I am in other words doing my homework before I leap to lessen wasted time and money and "re-inventing the wheel". That is why I am here today. And to let everyone know I found the information very insightful. Thank you!

amanuel melles - Jan 17, 2005 12:23 pm (#24 Total: 30)
With people, with ideas, in action


Thanks Robin...I brieflyt visited the website for the Innovation Network and found it quite resorceful.

Particular to the population-level outcomes involving multiple organizations, the individual program components can indeed help in shaping the overall long-term outcomes. What would interesting is to see what type of of indicators one would identify for population-level outcomes.

amanuel

srik - Jan 18, 2005 10:34 am (#25 Total: 30)


Hi all, I've found these discussion threads really useful. I lead evaluation for a small Chicago-based foundation that works in public education (k-12). We've been working on LMs for the past 6 months or so as a part of a broader evaluation framework that we are developing. While I've seen many ways in which LMs are useful, there have been quite a few challenges as well. I'm sharing a couple here

1. As a group, we have been influenced a lot and believe in systems theory and whole systems approach. Some of the more ardent systems thinkers among us question the wisdom of "breaking things up and putting them in boxes", which I admit is only a crude definition of what a LM does. However, there is concern that somehow de-constructing the program (in a LM) takes away the "synergy" between the elements, which is really the most crucial thing. Also, people question using LMs for evaluation as we would only be evaluating what we're looking for, and may be blind to what may 'emerge' (which may not be in the LM)

2. Most of our intended outcomes depend not only on our actions but also the actions of our partner school districts. For example, one of our outcomes is to get teachers to collaborate around promising instructional practices. The foundation provides some PD, process tools etc. but a lot also depends on what the school staff do on their own. So we've always had the dilemma of whether to have the LM represent our (as in foundation) work or our (as in the combined foundation + school district) work given that in the latter case, we do not have control over things that the district may or may not do.

I wonder if others have had similar experiences and if they can share those. On another note, I'm so glad to have found a group of evaluation practitioners.

Veena_Pankaj - Jan 18, 2005 11:53 am (#26 Total: 30)


--Your Message Here-- You bring up a very valid concern. Some would argue that a logic model restricts your program by narrowly focusing on the specific inputs and outputs of a program. I find that the logic model as a tool can be extremely helpful in planning out a program, in determining what the chain of outcomes are and to set up a structure for evaluation. Logic models are especially helpful for individuals working at the program level. However, when looking at the broader picture of a program or initiative, it is often helpful to look at the theory behind the program. A Theory of Change can clarify the assumptions behind the program. In my work with nonprofits, starting a discussion about the Theory of Change can really help demonstrate the true reasons behind the program.

The second point you bring up is also a good one. While a logic model is a great tool for looking at the details of your program, you may need a broader framework to fully capture the intended goals of your grant making. It sounds like many of your intended outcomes are based on the assumption that your partner school districts are accomplishing certain things. In this case, it may be helpful for you to articulate any theoretical, contextual and even programmatic assumptions that your program may be contingent upon. Innovation Network is in the process of developing a Causal Model approach to developing a logic model that helps organizations look at their programs from a broader perspective. While this particular approach may not be useful to all individuals working on a program, it may be helpful in developing a ‘big picture’ framework for your program or grant giving strategies. I’d be interested in hearing any of your experiences using a Theory of Change and if it has been useful.

srik - Jan 18, 2005 1:12 pm (#27 Total: 30)


Hi Veena, thanks for your reply. Interesting that you should ask about our theory of change. We've gone through several iterations of it, actually. Both narrative and graphic. But I don't think we've ever clearly laid out the theory and assumptions behind all our strategies. One point of view is also that our strategies (or programs) aren't 'mature' enough for us to be clear about the assumptions, rationale or even some of the intended outcomes. That, as you say, may be the source of some of the current challenges. I'd be interested in learning more about this Causal Model approach if possible.

Cgasca - Jan 19, 2005 9:55 am (#28 Total: 30)
Social Entreprenuer


I had the opportunity to develop a logic model for an agency providing self-employment services to mental health consumers. To build the logic model I held focus groups with mental health consumers to discuss their life-cycle and how self-employment fit within that. Then we developed the logic model.

I used life-cycle from a marketing perspective to identify products or service characteristics. From there we worked backwards to understand what the organizational impact would be in order to deliver what clients wanted. It think NGO's would find it useful to study consumer behavior and use a marketing frame of reference to develop the logic of their services.

hpeeler - Feb 1, 2005 4:31 pm (#29 Total: 30)
Innovation Network

Thanks to everyone who contributed to this lively discussion on evaluation and social change.  Veena and I really enjoyed hearing your first-hand experiences, successes and struggles in using evaluation tools like the logic model.  We wish you the best of luck in your endeavors to change the world.  As always, feel free to contact Veena, myself or anyone on staff at Innovation Network if we can be of any help to you.  www.innonet.org

brianr - Sep 21, 2005 11:03 am (#30 Total: 30)
Western Economic Diversification

Logic models are very difficult.  Like business plan templates, can easily become a fill in the box exercise.  A logic model is a linear creation.  You put something in at the beginning and something is produced at the other end.  It’s about delivering something through a pipeline, not about building a network.   A network is made up of people who interact with their environment, learn from their interactions, derive knowledge from what they learn, use that knowledge as a resource, and share it with others.  The logic model suits an industrial society very well but lacks power in a networked one.  An industrial model of social change assumes that if you grow sectors and remove barriers, you will increase participation and resolve or reduce social problems.  In a post-industrial society change comes from individuals, businesses, organizations and communities moving a long a continuum of sustainability that begins with greater self-reliance.   As they move along, they develop a growing capacity to engage in dynamic interactions with each other and their environment.   They live and work within interconnected systems or networks.  Networks characterize later stages along the continuum.   The continuum of capacity and collaboration replaces the pipeline or delivery paradigm as a model for assessing change.  

 

I like what Charles King, founding Chairman of the Social Enterprise Alliance said:

 

"What we are about is the business of changing the entire paradigm by which not-for-profits operate and generate the capital they need to carry out their mission -- a new paradigm based on sustainability and social entrepreneurship.

If we're successful in shifting the paradigm, we'll be able to recruit staff who are both mission-driven and trained in the business models.

If we're successful in shifting the paradigm, we won't have to constantly try to prove to the financial community the social and economic worth of investing in our work.

If we're successful in shifting the paradigm, we'll be able to recruit board members who understand the real world of business, and, at the same time, appreciate the cause that drives the business's activities.

If we're successful in shifting the paradigm, we'll have access to research to demonstrate what we already know to be true.”