The application of minimum standards during crisis - A practitioner ’s perspective, southern Sudan 1998/9
By Stephanie Maxwell
Stephanie Maxwell worked as the medical co-ordinator for Medicines Sans Frontiers Holland (MSFH) between May '97 and March '99, and as programme manager during the crisis period in southern Sudan. Between mid 1999 to early 2000 she was working as a nutrition consultant for Unicef in the Operation Lifeline Sudan Programme (OLS) for the southern sector. Part of the Unicef assignment included a review of some of the targeted feeding programmes being implemented in southern Sudan.
The Sphere Project was launched in 1997 to develop a set of universal minimum standards in core areas of humanitarian assistance. The aim of the project is to improve the quality of assistance provided to people affected by disasters, and to enhance the accountability of the humanitarian system in disaster response. The project was however never intended to provide a comprehensive guide for assessing interventions or cover the complete range of potential humanitarian responses. This sometimes gets forgotten in the debate over the application of minimum standards during a crisis.
Airdrop site, South Sudan '99 (UNICEF)
The Minimum Standards specify the minimum acceptable levels to be attained in sectors of humanitarian response. Each standard has a set of key indicators which signal whether the standard has been attained. They provide a way of measuring and communicating both the impact, or result of the programmes as well as the process, or methods used.
This article examines aspects of the influence, use and impact, of the nutrition 'Minimum Standards' during the response to the 1998/9 humanitarian crisis in southern Sudan. The discussion is largely based upon consideration of Standard 2 for Targeted Nutritional Support for Severe Malnutrition, and some of the key indicators used in the context of the emergency in southern Sudan in 1998/1999. The relevant standard and indicators read as follows:
The 1998 food crisis in southern Sudan
The multiple factors that brought about the humanitarian crisis, and shaped the humanitarian response are well documented*. The principal constraints that characterised the 1998 humanitarian crisis and response in southern Sudan are summarised as follows:
Standard 2
Targeted nutritional support standard 2: severe malnutrition
Mortality, morbidity and suffering associated with severe malnutrition are reduced.
Examples of Key indicators
- Proportion of exits from a therapeutic feeding programme who have died is <10%.
- Proportion of exits from therapeutic feeding programme recovered is >75%.
- Proportion of exits from therapeutic feeding programme defaulted <15%.
- There is a mean weight gain of >8g per kg per person per day.
- Nutrition worker to patient ratio is at least 1:10.
- Humanitarian agencies were initially denied access to the affected population by the Government in Khartoum.
- Limited infra-structure and poor communication systems.
- Logistical constraints, especially when airstrips were wet and/or too short, making it impossible for vital cargo planes to land.
- Working in flat, flooded and swampy conditions.
- Lack of experienced international and national professionals.
- The overwhelming scale of the problem.
- Inadequate co-ordination of the humanitarian response.
Furthermore, one of the key prerequisites for an efficient and effective emergency nutrition intervention was not fulfilled during the early stages of the crisis. An adequate general food ration was not provided for all in need.
Standard 1
General Nutritional Support Standard 1: Nutrient Supply.
The nutritional needs of the population are met.
Awareness of the Sphere Project and the Minimum Standards
There was limited awareness among field staff of the existence of internationally established minimum standards for humanitarian assistance. Generally, it was agency head office staff rather than 'front-line' staff who were aware of the project. In some instances, Minimum Standards were invoked as a basis for assessing the performance of agency interventions. In retrospect, a number of critical observations about the role and application of the minimum standards can be made.
When standards can not be attained
The two following boxes describe aspects of the therapeutic feeding programmes implemented by an MSF section in 1998 and my personal experience of adapting guidelines when faced with a complex and overwhelming situation. This highlights potential conflict with Sphere project minimum standards and the key indicators used to measure attainment of those standards. The standard in question is 'standard 2' (see box on previous page) for targeted nutritional support for severe malnutrition while the relevant key indicators are "There is a mean weight gain of > 8g per kg per person per day" and "Nutritional and medical care is provided to people who are severely malnourished, according to clinically proven therapeutic care protocols".
Adapting the guidelines - Example 1
After appraising the situation in one site which had a limited number of locally available qualified staff, a high level of insecurity for international staff, and resolute mothers who were reluctant to sit in a centre all day - I recommended that a simplified TFC regime be put in place.
I recommended a two tier TFC. The two tiers were for children who did or did not have an appetite based on the assumption that those without appetite required more supervision. Malnourished children with an appetite would either come in the morning or the afternoon for approximately four hours depending on the allocated shift. Children without an appetite would be encouraged to spend more than half a day at the centre. All children received a take home ration of made up milk and BP5 biscuits. If necessary, and with time and sufficient training, I assumed that it would be possible to build on the simplified model so that it would eventually have the characteristics of a conventional TFC. The rationale for such a design was:
- to free up time for mothers thereby reducing the likelihood of other children being admitted;
- due to the limited number of qualified national staff available such a system meant that there were less children at the centre at any given time so that the TFC could more easily adhere to another of the key SPHERE indicators "Nutrition worker to patient ratio is at least 1:10";
- to enable national staff to run the programme if international staff were evacuated for security reasons.
Cattle Camp, South Sudan '99. (UNICEF)
This deliberately simplified TFC regime deviated from certain aspects of standard therapeutic care protocols/guidelines e.g. a three-phase system with 12-24 hour supervision. Understandably, this received critical attention from certain experienced MSF team members. Their concerns were real and justifiable, MSF had years of experience and who was I to adapt internationally recognised MSF nutrition guidelines. "Minimum standards for therapeutic feeding were not being met."
Eventually, the team agreed to implement the suggested design. During the course of the programme children successfully gained weight (but at a slower rate than 8gms/kg/day) and the approach was replicated in other sites later on in the crisis. It is difficult to establish scientifically the merits of this particular intervention (after several weeks the programme was closed due to insecurity and some of the relevant data were lost). However, in Panthou during the later stages of the crisis the above design was implemented and the recovery rates were 75%. I believe such an approach was appropriate and effective for the given context.
Limitations of minimum standards in programme assessment - Example 2
During the crisis some MSF programmes reduced the admission criteria for the TFC from <70% wt-for-ht to <60% wt-for-ht in order to be able to cope with the overwhelming numbers. It could be argued that the Minimum Standards for targeted support to reduce mortality, morbidity and suffering associated with severe malnutrition were being met as far as possible, given the difficult circumstances encountered (including an inadequate and erratic general food ration). However, some of the relevant indicators for the minimum standard such as the "proportion of exits from a therapeutic feeding programme who have died is <10%" and the "proportion of exits from therapeutic feeding programme recovered is > 75%" could no longer be reasonably applied as children < 60% wt-for-ht are likely to suffer higher mortality. If such indicators were applied without consideration of the context one would conclude (unfairly) that the programme was of poor quality and ineffective.
A number of critical observations about the role and application of minimum standards can be drawn from these experiences:
- Assessing standards in a particular context.
While the Sphere Project offers a set of standards and indicators, neither these standards nor other internationally recognised nutritional guidelines were able to prepare or offer solutions for "front line workers" for the array of constraints and challenges faced by humanitarian agency staff during the 1998 food crisis. - Distinguishing between innovative and poorly managed programmes.
During the crisis, there appeared to be inadequacies in the capacity of some commentators to distinguish between organisations which had adopted 'innovative approaches' to deal with the overwhelming situation (which in some cases meant deviating from guidelines), and organisations which were implementing poorly managed targeted feeding programmes (which also sometimes occurred). The use of the Sphere Project as a tool did little to strengthen (and may even have undermined) the capacity to make such distinctions. In some situations, optimal programme design (as advocated in guidelines) had to be modified in order to maximise the achievement of the minimum standard.
There were certainly instances where this apparent deviation from standard protocols/guidelines was perceived as a failure to meet standards as suggested by Sphere (e.g. the key indicator suggested as a means of assessing attainment of the minimum standard is adherence to standard protocols). The overall situation was not helped by the fact that professionals did not appear to agree readily on the most appropriate strategy for nutrition interventions, given the complex and challenging circumstances. - The application of Minimum Standards and their respective indicators
Where programme design is modified in order to maximise attainment of standards the relevant key indicators for any given standard may not be appropriate or attainable, and if applied, may indicate poor programme performance. - The misleading nature of the term 'Minimum Standards.'
Some professionals argue the standards, and their respective indicators, are appropriate for accessible and relatively safe refugee settings while in complex emergencies, they may be the ideal, but not really achievable. For example, water supply standards were not achievable throughout most of southern Sudan during the '98 crisis. But the term 'Minimum Standards' suggests they should be achievable. In certain situations, when standards and their indicators are unrealistic, the Sphere Project is considerably weakened as a tool to challenge poor practice. Perhaps a more appropriate and less confusing term may be 'international references' or 'international standards'. - Using the Minimum Standards as a measure for greater accountability.
Though well intentioned, the attempts to make agencies more accountable by promoting the adoption of the Minimum Standards in southern Sudan, did not always achieve this objective. One reason appears to be that criticism was being received defensively. In addition, due to the strains experienced by the main co-ordination body (in this case, the UN) and the lack of capacity found in local authority structures, some professionals assumed an ad hoc watchdog role. As there was no agreed mandate for such a role, this had, at times, the inadvertent effect of making agencies less willing to be transparent and did little to improve accountability. - The 'right' to comment
At the onset of the crisis, MSF was among a number of agencies who publicly voiced their concern over the World Food Programme's capacity to meet the scale of needs facing the vulnerable population. However, a number of MSF workers questioned whether it was appropriate for MSF to continue to comment on the capacity of WFP to respond to the situation when MSF could also be criticised for not adhering to Minimum Standards. This was one of the reasons why MSF reduced efforts to high-light the difficulties facing WFP. - The impact of the Sphere Project in shaping the response to the crisis.
Even with greater awareness of the project, it is unlikely that the project would have greatly helped to improve the quality and efficiency of the response, for the following reasons:
- The Sphere Project would not have offered practical solutions to the constraints being faced by practitioners
- Many of the Sphere Project standards would have appeared unrealistic, and it is possible that the 'baby would have been thrown out with the bath water'.
- Where programmes had adapted their interventions and therefore appeared not to attain the Minimum Standards, indicators could no longer be appropriately applied in order to determine the quality and effectiveness of the intervention.
One factor which would have significantly helped to improve the effectiveness and quality of the overall nutrition response, would have been a wider use of internationally recognised operational nutrition guidelines (even though I have later recommended that these need to be revised to provide recommendations on 'optimal' practice in the face of overwhelming circumstances). This is particularly true for agencies that had large numbers of inexperienced professional staff, and/or agencies with limited institutional experience of selective feeding programmes. Several agencies I visited which were implementing feeding programmes, struggled with practical issues like maintaining adequate registration books. Such difficulties could have easily been solved by the greater use of recognised nutrition operational guidelines.
Suggestions for strengthening the Sphere project
The Sphere Project should be commended and supported for aiming to improve practice within the humanitarian arena. However, the Project has weaknesses. Below are some suggestions to help minimise these weaknesses and maximise the value of Sphere.
- Reconsider the term 'minimum'
The term 'minimum' is misleading and confusing and should be replaced by the term 'international standards' or 'international references'. The fact that Minimum Standards in certain contexts are unrealistic needs to be addressed. Criteria could be established to determine under what circumstances and how, minimum standards can be adapted to specific contexts: but always with the eventual aim of achieving international Standards. An additional chapter could be devoted to this. This process should also be supported by revising existing guidelines to include recommendations for situations where standard protocols cannot be adhered to, and compromise measures might need to be introduced. These measures may go some way towards reducing the intimidating aspects of the standards and prevent innovative ideas being stifled for fear of falling short of the standards. - Promote the use of operational guidelines
The Sphere Project should more actively promote the use of recognised agency operational guidelines in order to compliment the Sphere Project document. - Create the necessary environment to promote accountability and transparency
It is a matter of urgency to improve existing accountability systems and to ensure the correct environment is created to encourage agencies to be accountable and transparent. The current Ombudsman project (instigated at the World Disasters Forum in 1997) seeks to encourage agencies to adhere to the main codes and standards in humanitarian work. The project, co-ordinated by the British Red Cross, is investigating the feasibility of creating an accountability mechanism for humanitarian assistance. The Ombudsman will provide a mechanism to "help bridge the accountability gap between agencies and the claimants" of humanitarian assistance by having an independent office to investigate complaints or problems. - Strengthen the link between the policy maker and the practitioner
The link between the policy maker, researcher and practitioner needs to be strengthened. Practitioners need to be better informed of latest research findings and their link to policy development while policy makers need to be better appraised of the realities on the ground. The Sphere Project has taken the initiative to raise awareness of appropriate intervention standards around the world. This is undoubtedly a positive step and should be applauded. However, the project can only have limited impact unless there is a corresponding commitment by the agencies to institutionalise the principles, policies and values of the Project while assisting practitioners to apply these in a flexible and appropriate manner.
Supplementary Feeding Centre in South Sudan '99. (UNICEF)
Post Script
By Sean Lowrie, Training Manager, Sphere Project
Humanitarian practitioners are becoming more technically proficient, and the above article is an excellent exploration of the dilemmas of operating in a difficult situation, while maintaining loyalty to as scientific and ethical an approach as possible. The author raises valid questions about the application of the Minimum Standards and Key Indicators.
The Sphere Minimum Standards were developed to reflect a qualitative level of disaster provision applicable across all operating environments. The standards define the requirements for life with dignity in relatively general terms, while the indicators attach either qualitative or quantitative values to associated standards. It would be a disservice to the rights of populations affected by disasters to call the levels reflected in the current Sphere handbook international - hopefully international levels would be higher!
It might be argued that agencies and staff were effective given the limitations of Sudan in 1998. The Humanitarian Charter and Minimum Standards make a line in the sand (the right to dignity, quantified in the five basic sectors) from which we can measure our programmes, describe a particular context, and justify results and the indicators we use to measure those results. Perhaps one way to look at the Key Indicators in the Sphere handbook is to insist that they be maintained as written. They are minimal after all, and what NGOs need to do better is describe in more credible detail what the reality is in the field. With this line in the sand that fixed indicators would help define, humanitarians can describe needs and report on their results with reference to something concrete. (Thus there is a big difference between inappropriate indicators and unattainable ones). Obviously in Sudan in 1998 there was a pretty big gap between the line and the reality on the ground. That gap can be explained in terms of time to implement an operation, resources and other contextual factors like security and access.
The Sphere handbook does not contain operational guidelines because it is a book of Minimum Standards and indicators. How agencies and their staff will respond in a particular situation will depend on their mandate, capacity and experience. One might argue that 'front line workers' could better lobby for resources and support by explaining their operating context with reference to that "line in the sand". Whether agencies have time to do this analysis, reporting and advocacy is another matter, and a problem that we all face.
Distinguishing between innovative and poorly managed programmes is compromised when one applies only a technocratic application of the quantitative indicators. The difference between innovation and shoddy programming is in the ability to articulate the analysis done and the assumptions made about the causeeffect relationship between actions and the impact on people's ability to live with dignity.
Accountability requires some sort of standard, and so the creation of the Minimum Standards is an important step in improving accountability. The Sphere Project is in fact a process, and that process is continuing to evolve and improve. A revised edition of the handbook will be published in the year 2003, based on the suggestions, advice and feedback from practitioners in the field, and lessons learned from the application of the handbook in practice. Those comments should be directed to the Project Office using the following email: sphere@ifrc.org .
Let us remember that a situation in which entrance criteria must be reduced, or indeed, in which a TFC is needed at all, is a horrible injustice facing people in the developing world. The fact that most humanitarian workers must make decisions when in a dilemma, based on minimal information, with inadequate resources and access is one of the most difficult things about field work. It is also one of the things that humanitarian agencies don't speak about enough. The essence of accountability in this particular context would not be to say whether a standard is being met or not, but to measure the gap between what was possible and what is aspired, and to explain why that gap exists. This article explains why the Minimum Standards were not met, and any donor would understand. Any recipient would also understand, but the fundamental question remains, why does this happen in the year 2000? The humanitarian system needs to blow the whistle on injustices, and having a common language to work from will only strengthen our unique and independent actions toward this common purpose.
Lowrie@ciuk.org or sean_lowrie@hotmail.com Tel: (44)20-7379-5247 ext. 255 Fax: (44)20- 7379-0543 Mailing address: c/o CARE International in UK Tower House, 8-14 Southampton Street, London WC2E 7HA, UK http://www.sphereproject.org
*Co-ordinating a Humanitarian Response in Sudan by Murphy et al, Field Exchange Issue 6
Imported from FEX website