CEN Workshop Agreements for Test and Evaluation of Humanitarian Demining Equipment

by Franciska Borry [ International Test and Evaluation Program for Humanitarian Demining Secretariat ]

The Comité Européen de Normalisation has organised workshops to aid the establishment of standard methodologies for demining. This article discusses the workshops and the agreements reached in those workshops. The author includes a list of contacts for additional information on demining equipment and methods.

The increase of humanitarian-demining activities in the late 1990s awakened the need for a standardised assessment of the equipment used in these activities. Although trials of the capabilities of available demining equipment were already taking place, the lack of testing standardisation made it difficult to compare test results to determine which equipment was best-suited to any particular need. Therefore, test results were frequently of limited use to the end-user community. It was within this context that the European Commission mandated in 2000 that the Comité Européen de Normalisation establish standard methodologies for humanitarian demining. In order to fulfil this mandate, the CEN Technical Committee created Technical Working Group 126 (CEN BT/WG126) to ensure coordination and generate specific standardisation initiatives.

The CEN Workshop Approach

CEN has introduced the CEN Workshop, a mechanism and approach to standardisation. It is intended to be a process in which clients can bring their standardisation and technical specification requirements and have the opportunity to find a solution in an environment "tailor made" for their needs. The workshop concept provides an opportunity for any party faced with a technical challenge to find others in a similar situation and develop a result by consensus, validated in an open arena.

The procedures for setting up and operating CEN Workshops are deliberately kept to a minimum and all the decision-making powers rest with the interested parties themselves (i.e., the workshop participants). They cover their own costs and are responsible for the direction of the workshop as well as the approval of the deliverables.

The main activity of a CEN Workshop is the development and publication of the CEN Workshop Agreement. The CWA is a technical agreement endorsed and adopted by interested parties on a voluntary basis. Published CWAs are publicly available on the International Test and Evaluation Program for Humanitarian Demining Web site,1 among others, and can be used free of charge. They are promulgated in the International Mine Action Standards after consideration by the IMAS Review Board.

Since the creation of the CEN BT/WG 126, the following CEN Workshops have been completed and the associated CWAs published:

Two of the completed workshops were on the test and evaluation of demining equipment. They were strongly supported by the International Test and Evaluation Program for Humanitarian Demining through active participation of the expert ITEP participants, as well as the hosting of the respective CEN Workshop Secretariats. These two testing standards are discussed in more detail below. As CWA 15464, "EOD Competency Standards," is not of direct interest to the test and evaluation community, it is not discussed further in this article.

Image 1
Preparation of test lanes: removal of all metal objects prior to burial of test targets. STEMD project, Laos. All photos courtesy of D. Guelle

CWA 14747, "Test and Evaluation of Metal Detectors," and CWA 15044, "Test and Evaluation of Demining Machines," have been included in the IMAS on test and evaluation of mine-action equipment5 during the July 2005 amendment.

During 2006 the following new CEN Workshops started:

Both Workshops will publish final CEN Workshop Agreements by the end of 2007.

Published CWAs for Test and Evaluation of Humanitarian Demining Equipment

CWA, Test and Evaluation of Metal Detectors (CWA 14747, June 2003). CWA 14747 provides guidelines, principles and procedures for test and evaluation of metal detectors. As far as possible, procedures for testing have been closely specified. The agreement applies to all handheld metal detectors for use in humanitarian demining and is intended to be used for commercial off-the-shelf detectors, but many of the tests specified could be applied to detectors under development.

It should be noted that few users of the document will wish to or be able to perform all of the tests specified. Different parts of the CWA are intended to be used by research and development laboratories, manufacturers and organisations needing to procure metal detectors, mine-action centres, and metal-detector users in the field. A user in the field, for example, may perform the detection reliability test, some of the tests of operational performance characteristics and some of the basic in-air and in-soil sensitivity measurements. Furthermore, users of the CWA who wish to conduct a trial of various metal detectors using the tests specified may also conduct a pretrial assessment to exclude detectors that clearly do not meet their requirements from the start. Such a pretrial would include one or more of the tests specified in the CWA, with acceptance levels set by the users according to their own requirements.

In order to help different users get the maximum benefit from the CWA, guidelines are provided under the form of a matrix6 as to which CWA tests are considered appropriate for different categories of trials.

Image 2
Measuring of the test lane's soil electromagnetic properties using the Bartington MS2D instrument. STEMD project, Laos.

At the time of the publication of CWA 14747 (June 2003), it was stated that further work was needed on understanding the effect of the soil and how to best characterise it, as well as on the design of a practical approach to measure detection reliability. In the meantime, the CWA 14747 test protocols have been verified during several trials, among others, the comparative trial of COTS metal detectors.7 A list of CWA 14747 updates is now being proposed and plans exist to reconvene CEN Workshop 7 in 2007. The main objective of the reconvened Workshop 7 will be to produce an addition to the CWA 14747 that incorporates new scientific knowledge on testing procedures and provides user guidance on key performance tests for field users as well as for laboratory testing.8

CWA, Test and Evaluation of Demining Machines (CWA 15044, July 2004). The aim of CWA 15044 was to create industry-accepted criteria for the testing, evaluation and acceptance of COTS mechanical equipment used in humanitarian demining. Among other things, it should help users find the key technique or combination of techniques best suited to a given mine-clearance operation.

In CWA 15044, demining machines are defined as those machines whose stated purpose is the detonation, destruction or removal of landmines. It should be noted this does not necessarily imply a fully demined area following passage of the machine. The machine could be a ground-preparation machine, primarily intended to improve the efficiency of subsequent demining activities.

CWA 15044 provides a standardised methodology for test and evaluation of demining machines using a systematic and stepwise approach. It includes provisions and technical criteria for:

CWA 15044 also provides a list of all information that should be provided by the manufacturer before testing. Further, it recommends a pretrial assessment but does not include specific guidelines. This assessment is a qualitative examination of the equipment looking at the different functions, suitability, basic operating parameters, capabilities and manufacturer specifications and should answer the question: "Is it suitable for continued testing?" The ITEP testing community recommends a pretrial assessment for all demining equipment considered for testing prior to embarking on a full-scale trial.

It is acknowledged that the current version of CWA 15044 is written with an apparent bias toward flails and similar machines; however, it is noted that other machines including rollers could be tested equally well using the same procedures. In addition, machines intended to remove mines (versus triggering or breaking them), such as sifters, could be tested simply by modifying the proposed test sheets.

At the time CWA 15044 was published (July 2004), it was recognized that the CWA concentrates on the testing of machines to clear mines and there is a need to expand future work to address a number of issues, including appropriate testing of ground-preparation devices and vegetation cutters, enhancement of operator/crew safety testing, enhancement of mobility testing and performance-degradation testing.

A series of mechanical equipment trials executed by ITEP during 2006 using the CWA 15044 test protocol has further produced some useful experiences which will be taken into account when CWA 15044 is updated, probably in 2008.

Ongoing CWAs for test and evaluation of humanitarian-demining equipment. A CEN Workshop (CEN WS 26) on a Test Methodology for Personal Protective Equipment for use in humanitarian mine action kicked off in June 2006.

The Standardiseringen i Sverige (SIS) and the Geneva International Centre for Humanitarian Demining are co-chairing this CEN Workshop. The aim is to establish recognised and clearly defined specifications for vital criteria to be tested and appropriate testing methodologies for PPE for deminers. An open invitation was issued to those with an interest in the test and evaluation of PPE to participate in the Workshop. Two technical CEN Workshop meetings were held during 2006 and a third was held on 13–14 March 2007.9

A CEN Workshop (CEN WS 7/Part Two) on Soil Characterisation for Metal Detector and Ground-Penetrating Radar Performance Evaluation started in November 2006. The Workshop will produce a second part for the CEN Workshop Agreement for Test and Evaluation of Metal Detectors (CWA 14747,10 part 2) with the following objectives:

Four Working Groups, each tasked with drafting different parts of the document, were established at the kick-off meeting. The first technical meeting was held 3 May 2007.11 Bullet

Points of Contact

The contacts listed below are available to provide advice on the planning and to conduct of an evaluation according to the described CEN Workshop Agreements. Please do not hesitate to contact them when considering a trial of demining equipment or demining methods.

Biography

HeadshotFranciska Borry has been working for the Secretariat of the International Test and Evaluation Program for Humanitarian Demining since June 2002. She provides advice, assistance and coordination services to the ITEP Executive Committee. She is further responsible for the maintenance of all ITEP information databases and serves as the point of contact for any communication with ITEP.

Endnotes

  1. ITEP Web site: http://www.itep.ws. Accessed 4 April 2007.
  2. "CEN Workshop Agreement, Test and Evaluation of Metal Detectors," CWA 14747, June 2003. http://www.itep.ws/pdf/CWA_metal_detectors.pdf. Accessed 9 March 2007.
  3. "CEN Workshop Agreement, Test and Evaluation of Demining Machines," CWA 15044, July 2004. http://www.itep.ws/pdf/CWA_demining_machines.pdf. Accessed 14 March 2007.
  4. "EOD Competency Standards," CWA 15464. December 2005. http://www.itep.ws/news/events.php?id=218. Accessed 9 March 2007.
  5. IMAS 03.40 http://www.mineactionstandards.org/IMAS_archive/Amended/Amended2/IMAS_0340_1.pdf. Accessed March 14, 2007.
  6. CWA 14747, Chapter 5.1. http://www.itep.ws/pdf/CWA_metal_detectors.pdf. Accessed 14 March 2007.
  7. Systematic Test and Evaluation of Metal Detectors. STEMD was executed by the EC Joint Research Centre and the Bundesanstalt für Materialforschung und -prüfung. The STEMD Project's objectives were to identify new commercially available metal detectors that are suitable for demining, test those detectors using new metal detector standard (CWA 14747–2003) and provide the demining community with reliable performance data for tested detectors.
  8. To obtain more information on the updating of the CWA 14747, please contact Christina Muller, Christina.Mueller@bam.de or Dieter Guelle, Dieter.Guelle@bam.de.
  9. CEN Workshop on a Test Methodology for Personal Protective Equipment (CEN WS 26) for use in Humanitarian Mine Action. http://www.cenorm.be/cenorm/businessdomains/technicalcommitteesworkshops/workshops/ws26.asp. Accessed 14 March 2007.
  10. CEN Workshop Agreement (CWA 14747) on Humanitarian Mine Action—Test and Evaluation—Metal Detectors. http://www.itep.ws/pdf/CWA_metal_detectors.pdf. Accessed 26 March 2007.
  11. CEN Workshop (CEN WS 7/Part Two) on Soil Characterisation for Metal Detector (MD) and GPR Performance Evaluation. http://www.cen.eu/cenorm/businessdomains/technicalcommitteesworkshops/workshops/ws7part2.asp. Accessed 9 March 2007.

Contact Information

Franciska Borry
ITEP Secretariat
c/o Royal Military Academy
31 Avenue de la Renaissance
B-1000 Brussels / Belgium
Tel: +39 0332 771847
Fax: +32 27376349
E-mail: franciska.borry@itep.ws