Issue 7.1, April 2003
This issue may be outdated. Click here to view the most recent issue.
Back
Use of Multi-Criteria Analysis in Allocating EOD Teams in Humanitarian Mine Action

In this article, the author aims to set out how a standard economic planning tool, multi-criteria analysis (MCA), can be used to help plan allocation of mobile explosive ordnance disposal (EOD) teams between regions in a humanitarian mine action program and solicit comments on how the model could be developed.

by Robert Keeley

Introduction

Many demining programs face significant problems in attracting resources. There may be several reasons for this, but one that is commonly heard is that donors are not comfortable with the observed outcomes of programs. However, over the last few years, socio-economic issues have come to play a greater part in planning mine action projects, and, in particular, demining or area clearance projects. The reasons for this are comparatively clear: demining capacity is a scarce and expensive resource, and it makes sense to utilise that capacity where it can do the most good for local development. It may be that the use of socio-economic tools to assist in prioritisation of resource allocation will help alleviate donor concerns.

The publication “A Study of Socio-Economic Approaches to Mine Action”1 was one of the first to set out some of these issues, and the increasing emphasis of “impact” in the survey process also marks the increasing importance of such criteria. However, in focussing on the area clearance question, there has been comparatively little attention paid to the question of allocating mobile EOD teams2 between different regions. EOD teams do not clear land, so economic tools such as cost-benefit analysis (CBA) do not provide a means to prioritise their activities. Nevertheless, it is the contention of this paper that EOD teams are also a scarce and expensive resource and may help EOD planners to demonstrate that they are being used in an optimum manner.

Background

All readers will be familiar with MCA techniques, though the name is rarely used outside economic circles. In its most trivial incarnation, MCA is the method consumer magazines use to rate items such as electrical appliances. For example, most people will have seen tables that compare digital cameras such as the one in Table 1.

Attribute

Option

  Acme 2000 Delux Superlight El Cheapo Bog Standard
Zoom Yes Yes No No No
Memory 32 64 8 8 16
Robustness ***** **** *** * **
Ease of Use * ** *** ***** ****
Price 600 800 700 100 300

Table 1: Example of simple MCA table.

It is worth taking some time to analyse this table.

“Option” covers the choice open to the stakeholders (in this case, the five cameras available to the public that have been considered by the survey). In MCA, the options have to be discrete and distinct, i.e., option 1 is not the same as option 2.

“Attribute” lists the attributes (a.k.a. criteria) that the surveyors have considered for the analysis (attributes also have to be discrete and distinct). The surveyors then score the options in terms of each of these attributes.

Note first that there are different ways of scoring. The “zoom” question is comparatively simple: does the camera have a zoom or not? This produces a simple yes/no response that economists refer to as a “dummy.” We will come back to potential application of this yes/no filter later. Memory is measured here in megabytes, and price in dollars. Finally, the more subjective attributes are scored in stars, with the camera with the “best” rating given five stars and the others ranked accordingly. Again, we will come back to the question of units and numbers later.

In this simple application, the MCA table does not attempt to select which camera is the “best” because the stakeholder, according to their need, will do this. For example, a potential buyer on a tight budget constraint may decide that the price criterion is much more important than the others. In economic parlance, the stakeholder will “weight” this criterion.

Use of MCA in Project Analysis

The use of such a simple model as an introduction to the MCA concept should not mislead the power of the tool, however. Indeed, governments regularly use MCA as a way of making choices about major development projects. Imagine a western government having to decide whether to expand the airport serving their capital.

They may have identified three main options:

  1. Do nothing, i.e., live with the level of air traffic at present.

  2. Build a new runway at the existing airport (which is badly served by land transport connections).

  3. Build a new airport on a green field site (which has access to motorway and international rail links but is in an environmentally sensitive area).

Each option has several advantages and disadvantages,3 and the application of the MCA process helps set these out clearly.

Attribute

Option

  Option 1 Option 2 Option 3
No. of Flights 100% 150% 300%
Effect on local employment Nil +2000 +4000
Effect on local wildlife Nil ** ****
Effect on local quality of life/house prices Nil ** ****
Net Cost/Benefit XXXX XXXX XXXX

Table 2: Example of Typical MCA Used in Project Analysis

The first thing to note about this use of MCA is that it is possible to resolve everything in the same terms (i.e., in the same unit of measure). In this example, the government’s economists could estimate the benefits of the extra flights and jobs and also the environmental costs.4 Substituting these figures into the table, it would be possible to work out the value in dollar terms of each option. In other words, by using common units of measure, the MCA process can actually produce a cardinal result—i.e., the options are automatically ranked and their relative values determined. In even more simple terms, MCA is a process by which we can compare apples and oranges!5

Application of MCA Techniques for EOD Resource Allocation

It is suggested that MCA techniques can be used to divide mobile EOD teams between provinces in a national humanitarian program in an objective and transparent manner to achieve the optimum allocation of resources.

Selection of Criteria
For the purposes of EOD resource allocation, the following criteria are proposed:

These criteria fulfil the requirements of the MCA process in that they are (a) relevant and (b) distinct from each other. The list may not be exhaustive, and suggestions as to how the list could be expanded are welcome. The raw data for the MCA process should be easily accessible from the national gazetteer and the national landmine/UXO survey (providing such a survey has been carried out).

Options
Of course, there is only one option available (i.e., the provision of EOD services), but use of survey data means that, in this case, each province can be scored in terms of the criteria. Furthermore, by scoring on a percentage basis, the “large-numbered” attributes (such as area in square kilometres, which may be a five-figured number) will not overwhelm a “small-numbered” attribute (such as number of casualties, which may be in the low hundreds at the most). This generates an MCA table similar to the example in Table 3, based on a fictional country with five provinces.

Ser Criteria Province
(a) (b) (c) (d) (e) (f) (g) (h)
    A B C D E Total (%)
1 Size in km2 14.36 32.65 17.25 16.51 19.20 100
2 Degree 27.61 0.00 11.47 37.77 23.15 100
3 Reported Casualties 34.66 0.00 0.00 37.99 27.35 100
4 Population 21.99 20.60 15.72 21.32 20.37 100
5 Subtotal 99.62 55.25 47.47 117.59 95.07 --

Table 3: EOD MCA Step 1 (Initial Scoring)

At first, this appears to provide a simple ranking of each province, but at the moment this includes a score for province B, which in fact has no contamination. This is where the “dummy” technique referred to above comes into use. By simply multiplying the subtotal by either 1 (has contamination) or 0 (does not have contamination) the scores can be amended to take account of this. This is done in Table 4.

Ser Criteria Province
(a) (b) (c) (d) (e) (f) (g) (h)
    A B C D E Total (%)
1 Size in km2 14.36 32.65 17.25 16.51 19.20 100
2 Degree 27.61 0.00 11.47 37.77 23.15 100
3 Reported Casualties 34.66 0.00 0.00 37.99 27.35 100
4 Population 21.99 20.60 15.72 21.32 20.37 100
5 Subtotal 99.62 55.25 47.47 117.59 95.07 --
6 Contamination 1/0 1 0 1 1 1
7 Unweighted Score 100 0 47 118 95 --

Table 4: EOD MCA Step 2 (Unweighted Totals)

Weighting
Weighting requires participation of stakeholders to make the process more inclusive. Whilst this approach is more subjective than the earlier steps, which have been based purely on application of data, it is comparatively objective when compared to simply “flying by the seat of the pants!”

For the purposes of this paper, it is suggested that, as the prime function of EOD teams is to save lives and prevent injuries from accidental detonation of UXO, the criterion that is most relevant to this function (i.e., the number of casualties) could be weighted.

In this example, the casualty figures are given a weighting of a factor of three. When this weighting is inserted in the table, it has the following effect (see Table 5).

Ser Criteria Province
(a) (b) (c) (d) (e) (f) (g) (h)
    A B C D E Total (%)
1 Size in km2 14.36 32.65 17.25 16.51 19.20 --
2 Degree 27.61 0.00 11.47 37.77 23.15 --
3 Reported Casualties 105 0.00 0.00 114 51 --
4 Population 21.99 20.60 15.72 21.32 20.37 --
5 Subtotal 168.96 53.25 44.47 189.6 113.72 --
6 Contamination 1/0 1 0 1 1 --
7 Total Score 169 0 44 190 114 517

Table 5: EOD MCA Step 3 (Weighted Scores)

Stakeholder Analysis and Sequence of Events
It is worth making the point here that the MCA tool is at its best when used to increase transparency. This can be done in this context by involving stakeholders in selection of criteria and decisions on weighting before populating the table with data, as this then means that the conclusions about resource allocation can be shown to have been done in a transparent and objective manner, which should help maximise donor confidence and thus help in the release of funds. It may also be useful to involve beneficiary groups (such as provincial government representatives) in the criteria selection and weighting process as it may help them buy into the way that teams are allocated. This is also in line with modern development approaches in that it encourages local ownership of the program at all levels.

Once the data is inserted in the table and the weighted scores obtained, the final score can be used as the ratio in which the EOD teams can be allocated. In this fictional example, imagine that the program has 24 EOD teams. Therefore, they should be allocated in the ratio: 169:44:190:114.

Dividing each score by 517 (the total of the scores), and multiplying the result in each case by 24 (the number of available teams) and rounding the result gives us the ratio to divide the teams. This is set out in Table 6 below.

Ser Weighted score Weighted score/total score Result ((c) x 24)
(a) (b) (c) (d)
1 169 0.33 8
2 44 0.09 2
3 190 0.37 9
4 114 0.22 5
5 Total 24

Table 6: EOD MCA Step 4 (Allocating Resources)

Therefore, given the above data on the country and the extent of contamination, and the decision to weight the casualty data by a factor of three, the 24 existing teams would be divided amongst the four contaminated provinces in the ratio of 8:2:9:5.

Effect of Time
In general, the MCA process is used to assist in making irreversible decisions. One can imagine that a dissatisfied customer can return a digital camera to the store, but it is harder to imagine dismantling an airport! In both cases, the MCA process is a “one shot” analysis done to help make the decision about which option to adopt. However, when using MCA to assist in EOD planning, we do have the ability to modify resource allocation on a periodical basis. In this case, given that the size of each province would remain constant (and assuming either a constant population or equal proportionate growth over each province), it would be simple to revisit the MCA process armed with the most recent casualty data and re-calculate the most appropriate ratio. Of course, it would also be possible to change the weighting over time, and even introduce different criteria. One can imagine doing this on an annual basis as part of the project cycle/annual budget allocation process. Figure 1 represents this process diagrammatically.

Figure 1: Incorporating MCA into the EOD planning cycle

Advantages and Limitations

Advantages
There seem to be several advantages to this process. First, it is logical and easy to understand (and hence easy to explain to others in the planning process). Second, it allocates resources objectively, which, when reinforced by appropriate inclusion of stakeholders in identification of criteria and weighting, makes the process very transparent (thus helping with donor confidence). The use of the weighting mechanism also allows policy makers to intercede in a transparent and comparatively objective manner. Finally, periodic recursion would allow planners to take account of changing circumstances over time.

Limitations
The MCA process relies on the existence of suitable survey data. While geographic information might be available from stakeholders, data on casualties and the extent of UXO contamination may not be so easily obtainable. It may be possible to use MCA without casualty and contamination data in the early days of an emergency program as a “least worst” approach. However, the development of structured landmine/UXO survey processes over the last few years has meant that there is more chance that the information may be available. If nothing else, the development of MCA as a means of allocating EOD resources may provide further justification for the timely conduct of such surveys.

One possible apparent limitation may be the need to involve stakeholders in the planning process. Although this makes the process more open and inclusive, it may at first require some education of stakeholders in MCA techniques in order to maximise their input, thus placing a further strain on timetabling—especially in the budget formulation season. However, the MCA process is not too difficult to understand and the good news is that many agencies already use it for other types of projects. Furthermore, including the stakeholders in this process helps “mainstream” EOD activity with general development activity. Different organisations will of course be best placed to deal with this issue in the way most appropriate for their own structures.

In its current format, the proposed MCA process is intended for use in developing countries emerging from conflict that are being assisted by humanitarian donor programs supported by external donors. As such, it is not optimised for EOD organisations operating in developed countries. However, it might be possible, through the substitution of criteria, to use this process to allocate EOD teams in developed countries. For example, the casualty figure could be replaced by the number of improvised explosive device (IED) incidents. Comments on this would be welcome from EOD planners.

Summary and Conclusions

In summary, the MCA process does seem to offer a means by which an established economic planning tool could be adapted for use in EOD resource allocation. It does, however, require availability of contamination and casualty data as well as active participation by stakeholders if it is to be most effective. When such participation is achieved, the MCA process seems to offer a means to increase transparency and hence donor confidence. Nevertheless, there may be other potential pitfalls in the process that are not readily apparent to the author, and input from readers would be very welcome at this stage.

*All graphics courtesy of the author

Endnotes

  1. Published by the Geneva International Centre for Humanitarian Demining on behalf of the United Nations Development Program in 2001.
  2. The term “EOD team” is used here to describe a mobile team that responds to reports of items of UXO. They do not search or clear areas of land that are (thought to be) contaminated, and therefore it is not possible to use CBA techniques to analyse the value of the land that they have cleared.
  3. Readers with military backgrounds will recognise that there are some similarities between the early stages of the MCA process and the military planning technique of “appreciations” (or “mission estimates”). Though “do nothing” may be an unusual tactical option, it is often—for quite sensible reason—the default option for government planners!
  4. Techniques on environmental valuation are not relevant here and so the exercise on calculating full project cost/benefit is not completed. For readers interested in the concept, however, a good source is the book Economic Valuation of the Environment by G Garrod and KG Willis, published by Edward Elgar Ltd.
  5. Detailed information about MCA techniques is available at the following British government website: http://www.dtlr.gov.uk/about/multicriteria/index.htm.

Contact Information

Robert Keeley
77 Kent Avenue
Ashford
Kent
TN24 8NG
United Kingdom
Tel: +44 1233 663023
Mobile: +44 7788585828
E-mail: BobKeeley@compuserve.com