Selecting an Appropriate Evaluator

Selecting an Appropriate EvaluatorThe choice of an evaluator or an evaluation team is an essential factor in the whole process of evaluation. Evaluations are conducted either by an internal evaluator or by an external evaluator, or are often the case, by a combination of both.

Careful consideration of the purposes of the evaluation will help in the determination of the best approach.

Internal evaluations are conducted by evaluators who are associated with the program to be evaluated. In contrast, the external evaluations are performed by evaluators who are not associated with the program being executed, implemented, and funded.

In some instances, national consultants are appointed as a helping hand for project evaluation. This practice is usually effective and can significantly enrich the evaluation exercise.

A competent consultant understands the evaluation context and may provide the evaluation team with access to officials and sources of information that otherwise may not be available.

Moreover, the inclusion of a national consultant on a team can act as a catalyst for greater local “buy-in” into the evaluation results.

We summarize below the possible advantages and disadvantages of deploying the internal and external evaluators.

Advantages of Internal Evaluation

  1. An internal evaluator is familiar with the organization, its program and operations, and the aims and the objectives. This is expected to pose less threat of anxiety and disruption;
  2. Sometimes people are more willing to speak to insiders than to outsiders;
  3. An internal evaluation is very clearly a management tool, a way of self-correcting, and much less threatening than an external evaluation. This may make it easier for those involved to accept findings and criticisms.
  4. An internal evaluation will usually cost less than an external evaluation;
  5. An internal evaluation does not require time-consuming recruitment negotiations;
  6. An internal evaluation contributes to strengthening national evaluation capability.

Disadvantages of Internal Evaluation

  1. The evaluation team may have a vested interest in reaching positive conclusions about the project or organization. For this reason, other stakeholders, such as donors, may prefer an external evaluation;
  2. The evaluation team may not be sufficiently knowledgeable, skilled or trained in evaluation;
  3. While it may cost less than an external evaluation, the opportunity cost in the internal evaluation may be high;
  4. The evaluation team may not have special subject matter expertise, thus rendering the in internal evaluation exercise at risk.

Advantages of External Evaluation

  1. The external evaluation team is likely to be more objective as the evaluators will have some distance from the work. This may reduce organizational bias;
  2. The external evaluation team will have more exceptional evaluation skill and technical expertise in conducting an evaluation;
  3. Sometimes people are more willing to speak to outsiders than to insiders;
  4. Use of an outside evaluator gives more credibility to findings, particularly positive results;
  5. An outside evaluator can dedicate full time to the evaluation;
  6. An external evaluator can bring the organization into contact with additional technical resources because of their increased exposure to the outside world.

Disadvantages of External Evaluation

  1. An external evaluator may not know the organization, its policies, procedures, and personalities;
  2. An external evaluator may be unfamiliar with the local political, cultural and economic environment;
  3. In external evaluation, those who are directly involved may feel threatened by outsiders and be less likely to talk openly and co­operate in the process;
  4. External evaluation can be a very costly undertaking;
  5. An external evaluator may misunderstand what you want from the evaluation and will not provide you with what you want;
  6. An external evaluation requires more time for contact, negotiations, orientation, and monitoring.

How to choose an external evaluator or evaluation team?

If it is felt that an external evaluation is called for, then you will need to delineate some criteria for this purpose.

The following is a tentative list of qualities that you may look for in an external evaluator or evaluation team:

  • An evaluator (or an evaluation team) must have an understanding of the development and organizational issues with adequate experience of evaluating development projects, programs or organizations;
  • An evaluator must have enough research skills with a firm commitment to quality and meeting deadlines;
  • An evaluator must be objective, honest, and fair;
  • An evaluator will have the ability to communicate verbally and in writing and have a style and approach that best fit with the organization for which he will work.

Related Posts ⁄