CCSD’s systemic problem and its expensive consequences

Part 4: CCSD management's ERP failure is par for the course for government entities

Steven Miller

“Change is hard for any organization, but especially so for employees in the government and public sector,” observes the 12-year-old independent Enterprise Resource Planning (ERP) advisory firm, Panorama Consulting.

“Long employee tenures, outdated and well-entrenched legacy systems and business processes, and lack of employee incentive to embrace change are all factors that commonly increase a government organization’s resistance to change.

“Without a clear and deliberate plan to help employees migrate from the ‘as-is’ of their old processes and systems to their ‘to-be,’ an ERP implementation literally has zero chance of succeeding.”

Panorama, based in Denver, offers ERP-specific consulting services on software selection, implementation, staffing, project management oversight, project recovery, business process reengineering and organizational change management, among other ERP-related specialties. The firm also provides expert-witness testimony when litigation involves SAP, Oracle, Microsoft Dynamics or Epicor ERP implementations.

Given the firm’s expertise and broad experience with both private- and public-sector ERP projects, its assessment of public-sector organizations in the face of ERP projects has great credibility.

Moreover, a 2012 Panorama white paper, “Lessons Learned from a Government ERP Failure,” reveals that Clark County School District’s ERP implementation failed for the precise reasons that ERP implementations regularly fail in other government agencies.

The subject of the white paper was a state that requested Panorama’s services (and which Panorama chooses to not identify) that:

… began experiencing issues in this area when it established an unrealistic implementation timeline based on faulty assumptions, such as the number of resources required and how quickly state employees could help define and validate business requirements. These unrealistic expectations led to time and cost overruns from the start.

Our experience and research shows that an effective organizational change management plan is of paramount importance to a government ERP software initiative. Unfortunately, most government buyers do not understand what organizational change management means – or worse yet, don’t consider this critical success factor at all during their RFP and evaluation process (Emphasis added). Most often, the resulting outcome is that the government entity chooses a system integrator without considering its abilities to help in this area. Without a robust and effective organizational change management methodology, government ERP initiatives are destined to fail.

The project also was not managed well once it was underway. Both the state and its system integrator failed to properly manage scope and milestones, and made choices to add the implementation of more modules to an already overly aggressive timeline and sign off on extensive customization that was not necessarily required.

Chronic causes for public-sector ERP project failure that also appeared in CCSD’s woeful effort include:

1. Lack of due diligence during the ERP software evaluation and decision phase.

CCSD had its mind set on an expensive SAP system before it even fully understood what the district actually required.

Likewise, in the unnamed state’s project described by Panorama, the project team and its system integrator eventually identified more than 400 gaps between the state’s needs and the functionality offered by out-of-the-box software.

“To add insult, most of these gaps were not identified until nearly two years into the implementation. Had these needs been identified and documented in the evaluation and selection phase of the project, it is likely that the state would have purchased a different ERP system. In addition, and as discussed below, the tardy business requirements definition led to huge customizations and cost overruns over the course of the failed implementation…

“As we explicated in the 2012 ERP Report, ‘The costs of customization often come as a shock to implementing companies. Those who perform their due diligence of blueprinting and requirements gathering on the front end, however, will frequently find that the software chosen is a much better fit and requires less customization (and build-ons) to start providing benefits….”

“One of the flaws with the government purchasing model is that agencies submit blind RFIs and RFPs for enterprise and financial system replacements without fully defining their business requirements. Most of the government RFIs and RFPs we see are overly focused on cost and the vendor’s track record of implementing at government entities. This approach is flawed because it does not take unique regulatory and operational accounts into consideration, leading the organization to blindly choose a software solution based on largely irrelevant criteria.”

2. Fixed-price contract.

“A common misconception in the public sector is that fixed-price contracts will mitigate risk and cost. While this may seem true on the surface, our state client found this to be problematic. In the state’s case, it requested and accepted a fixed-bid proposal from its large system integrator. The contract specified which critical project activities were in the system integrator’s scope, as well as those that were assumed to be conducted by state employees. However, lack of state employee bandwidth and expertise led some of these critical project activities to slip, leading to project milestone and budgetary overruns.

“Similar to many of our other public-sector clients, the state found that its fixed-bid contract created conflicting incentives between its system integrator and its customer. In these types of arrangements, the system integrator is financially incentivized to cut scope, accelerate activities at the compromise of quality, and provide lower-cost resources to the project. What is intended to be a mechanism to mitigate and control an organization’s risk instead ends up creating more problems than it helps resolve. In addition, these types of contractual arrangements often cause less sophisticated government executives and managers to assume that they have, in essence, “outsourced” their entire ERP implementation, without fully realizing the hidden costs and resource requirements associated with the contract.”

3. Poor business requirements and system design.

“As mentioned previously, our state client identified more than 400 gaps between its business requirements and the capabilities of its chosen financial ERP system. This is partially due to the fact that it was trying to forcefit a solution that wasn’t necessarily a good fit for the organization. Other contributing factors included organizational resistance to the functionality of the new software and the embedded business processes, as well as poor management of scope and project controls. These three factors led the state to customize more of the software than it should have.

“The end result of the poor business requirements and design is that the solution was a sort of moving target. Needs were defined and changed as the implementation progressed, leading to massive cost and time overruns. In addition, while the state’s chosen software vendor and system integrator had indicated that it could handle more than 90-percent of the state’s needs (as outlined in the RFP) with little to no customization, the system turned out to need heavy customization as requirements became better defined.

“We find that most of our government clients wish to implement a vanilla, off-the-shelf ERP or financial system with very little to no customization. However, this task is impossible without a clear definition of an organization’s detailed business requirements. In addition, we have found that complex government system implementations – especially those with diverse business processes affecting large number of employees – must conduct extensive business blueprinting in order for the project to succeed. Most RFIs and RFPs that we’ve seen from government and public sector organizations inadequately define detailed business blueprinting and requirements, which leads to inaccurate or incomplete assumptions about scope, cost, time, and resource requirements. These deficiencies also tend to lead to software designs that are misaligned with the organization’s operational and regulatory needs.”

4. Inadequate project planning and controls.

“Project management is typically not a core competency of government organizations. However, strong project management, planning, governance, and controls are required to make any ERP implementation successful. Our state client began experiencing issues in this area when it established an unrealistic implementation timeline based on faulty assumptions, such as the number of resources required and how quickly state employees could help define and validate business requirements. These unrealistic expectations led to time and cost overruns from the start.

“The project also was not managed well once it was underway. Both the state and its system integrator failed to properly manage scope and milestones, and made choices to add the implementation of more modules to an already overly aggressive timeline and sign off on extensive customization that was not necessarily required. In addition, the joint implementation team never established a formalized change control or sign-off process when team members wanted to change scope or customize the software, which led to scope creep outside the confines of the state’s original RFP.

“Many of our government clients rightfully expect that their system integrators will ensure that the implementation contains proper project controls and governance. While this is true to some degree, organizations ultimately ‘own’ their own ERP projects and have to recognize when there are breakdowns or shortcomings. They need to begin by first defining and validating a realistic project plan and monitoring the project timeline, scope and resources throughout the implementation.”

5. Under-qualified project resources and poor project staffing.

“The effective implementation of financial and ERP systems at government entities requires a project staff with a strong set of tools, methodologies and experience to make the project successful. In its failed ERP implementation, our state client experienced problems with both its internal and external team resources.

“In the RFP response, the state’s system integrator suggested that it would provide 60- to 70-percent of the total project resources required to make the implementation successful. This expectation was to mitigate the fact that the state’s employees were not well-versed or experienced in ERP implementations, so would need to lean on their system integrator to provide the appropriate guidance and expertise.

“Once the implementation was underway, however, the system integrator staffed the project with half of the full-time equivalents (FTEs) outlined in the RFP response, while the state provided nearly twice as many staff members as had been recommended by the integrator. As discussed above, this was partially due to the perverse incentives of the fixed-cost arrangement between the state and its system integrator. The other contributing factor was that the system integrator sorely underestimated the resources required from the state’s team. Instead of providing the 60- to 70-percent of the total project resources outlined in its RFP, the system integrator was providing just 12-percent by the final phase of the project.

“In addition to an understaffed project, the state also suffered from high turnover on the project team. The system integrator replaced several of its project managers throughout the project, some at the request of the state and others at the discretion of the integrator. In addition, several other team members turned over during the implementation, resulting in discontinuity, project delays, and ultimately cost and time overruns.

“We have found that finding and staffing the right project team is an extremely important and often underestimated activity, especially for government and public sector organizations. However, many organizations don’t focus enough on this critical success factor during the software selection and implementation planning phase and instead direct attention to finding the lowest cost software vendor with the most impressive overall track record in the public sector. While cost and track record are indeed important, they do little to ensure an effective implementation team with the right toolset, methodologies and experience to make the project successful.”

6. Lack of attention to organizational change management.

[The three paragraphs that began this article, then:]

“Even with the most perfectly designed, configured, and tested software solution, a government entity will not be successful if employees have not fully adopted and embraced the new ERP system and related business processes.

“There’s no doubt that organizational change is hard and needs proper planning to address. Our 2012 ERP Report showed that 63-percent of companies experienced difficulty in addressing process and organizational change issues.

“In the case of our state client, it and its system integrator did not develop or execute a proper organizational change management, training and communications plan. Instead, the state relied heavily on canned and generic training materials provided by the system integrator, which did not take into account the state’s unique business processes or software customizations. As a result, the training was largely irrelevant to the majority of the employees that were expected to use the new system.

“In addition, the state and its system integrator did not develop organizational change management activities outside of training. Although the changes associated with migrating from a mainframe-based legacy system to a fully modernized financial and ERP system were extreme, the project team did not communicate those changes until end-user training shortly before go-live. More specifically, the project team did not conduct a gap analysis between the “as-is” and “to-be” processes, develop a communication plan targeted for each of the impacted employee workgroups, create a benefits realization framework, or facilitate executive and stakeholder alignment, which all are critical to the success of an ERP implementation. The result of these oversights was extreme organizational resistance to the new system.

“Our experience and research shows that an effective organizational change management plan is of paramount importance to a government ERP software initiative. Unfortunately, most government buyers do not understand what organizational change management means – or worse yet, don’t consider this critical success factor at all during their RFP and evaluation process. Most often, the resulting outcome is that the government entity chooses a system integrator without considering its abilities to help in this area. Without a robust and effective organizational change management methodology, government ERP initiatives are destined to fail. Companies like Panorama that specialize in ERP and organizational change are depended on to provide effective organizational change management guidance to augment a system integrator’s more technical and software competency.”

7. Lack of independent verification and validation oversight

“Government system implementations are typically very complex, costly and risky, which is often more than a single firm can effectively handle. As a result, most government entities leverage the services of independent verification and validation (IV&V) oversight experts to mitigate the risks discussed above. In this case, our state client did not leverage such assistance, which led to a host of problems, including mismanaged expectations, unrealistic plans, and several of the other issues previously discussed. The end result was a project that ran far over budget, took longer than expected, and fell very short of delivering the expected business benefits. In other words, the project failed.

“Had the state enacted services from an outside IV&V firm, it might not have experienced the issues it did. IV&V processes are typically the last line of defense to ensure that an implementation project stays on track and protect it against failure. Even if the above six lessons had still occurred, an effective IV&V program would have identified and mitigated those risks as they developed. Using its proprietary implementation assessment and IV&V framework and methodology, Panorama often provides these services to its government and public sector clients (when we are not the prime project manager on their ERP or financial system implementations).”

Actually, CCSD did retain an independent firm for verification and validation, but then proceeded to ignore its recommendations, rather than upset a powerful department head.

Coming in Part Five: Disgusted, a highly paid ERP consultant walks away

———-

Steven Miller is managing editor of Nevada Journal and senior vice president at the Nevada Policy Research Institute

Links to the entire eight-part investigative series

 

Steven Miller

Senior Vice President, Nevada Journal Managing Editor

Steven Miller is Nevada Journal Managing Editor, Emeritus, and has been with the Institute since 1997.

Steven graduated cum laude with a B.A. in Philosophy from Claremont Men’s College (now Claremont McKenna). Before joining NPRI, Steven worked as a news reporter in California and Nevada, and a political cartoonist in Nevada, Hawaii and North Carolina. For 10 years he ran a successful commercial illustration studio in New York City, then for five years worked at First Boston Credit Suisse in New York as a technical analyst. After returning to Nevada in 1991, Steven worked as an investigative reporter before joining NPRI.

News You Can Use from Nevada Journal

Editors: Reprint permission, in whole or in part, is granted under a Creative Commons Attribution-ShareAlike 3.0 license.

Nevada Journal, a member of the Nevada Press Association (NPA) and Investigative Reporters & Editors (IRE), is an independent nonprofit reporting effort that adheres to the SPJ standards of professional journalism and specializes in in-depth and investigative journalism.

For the last 20 years, Nevada Journal has been published by the Nevada Policy Research Institute, a non-partisan public-policy think tank.