Showing posts with label performance measures. Show all posts
Showing posts with label performance measures. Show all posts

October 6, 2009

Measurement is Essential to Results

Mission execution and performance results are the highest goals of enterprise architecture.

In the book Leadership by Rudolph Giuliani, he describes how performance measurement in his administration as mayor of NYC resulted in tremendous improvements, such as drastic decreases in crime. He states: “Every time we’d add a performance indicator, we’d see a similar pattern of improvement.”

How did Giuliani use performance measures? The centerpiece of the effort to reduce crime was a process called Compstat in which crime statistics were collected and analyzed daily, and then at meetings these stats were used to “hold each borough command’s feet to the fire.”

What improvements did Giuliani get from instituting performance measurements? Major felonies fell 12.3%, murder fell 17.9%, and robbery 15.5% from just 1993-1994. “New York’s [crime] rate reduction was three to six times the national average…far surpassed that of any other American city. And we not only brought down the crime rate, we kept it down.”

How important was performance measurement to Giuliani? Giuliani states, “even after eight years, I remain electrified by how effective those Compstat meetings could be. It became the crown jewel of my administration’s push for accountability—yet it had been resisted by many who did not want their performance to be measured.”

From an architecture perspective, performance measurement is critical—you cannot manage what you don’t measure!

Performance measurement is really at the heart of enterprise architecture—identifying where you are today (i.e. your baseline), setting your goals where you want to be in the future (i.e. your targets), and establishing a plan to get your organization from here to there through business process improvement, reengineering, and technology enablement.

In the end, genuine leadership means we direct people, process, and technology towards achieving measureable results. Fear of measurement just won't make the grade!


Share/Save/Bookmark

December 21, 2008

Engineering Employee Productivity and Enterprise Architecture

Ever since (and realistically way before) Fredrick Taylor’s time and motion studies, employers have looked to “engineer” the way employees do their work to make them more efficient and effective.
The Wall Street Journal, 17 November 2008, reports that “Stores Count Seconds to Trim Labor Costs.”
Companies “break down tasks such as working a cash register into quantifiable units and devise standard times to complete them, called ‘engineered labor standards.’ Then it writes software to help clients keep watch over employees.”
So for example, in some retailers, “A clock starts ticking the instant he scans a customer’s first item, and it doesn’t shut off until his register spits out a receipt.”
Employees who don’t meet performance standards (e.g. they fall below 95%), get called into for counseling, training, and “various alternatives” (i.e. firing).
The result is “everybody is under stress.”
So, is this workforce optimization or micromanagement? Is this helping employees learn do a better job or is this just scare tactics geting them under the management whip?
Some employers are claiming improved productivity and cost savings:
One retailer, for example, claims saving $15,000 in labor costs across 34 stores for every one second shaved from the checkout process.
But others are finding that customer service and employee morale is suffering:
Check clerks are not as friendly. They don’t chat with customers during checkout. Cashiers “avoid eye contact with shoppers and generally hurry along older or infirm customers who might take longer to unload carts and count money.”
Additionally, as another cashier put it, “when you’re afraid you’re going to lose your job, you make more mistakes.”
Other employees are gaming the system to circumvent the rigid performance measures and for example, improving their time by hitting the suspend button to stop the clock more than they are supposed to—it is meant only for use when remotely scanning bulky merchandise.
The other problem with the engineered labor standards is that they often don’t take into account the “x factors”—the things that can go wrong that adversely affect your performance times. Some examples: customers who don’t have enough cash or those “digging through a purse,” credit cards that don’t swipe, “an item with no price or item number,” customers who forget something and go back or those that ask for an item located at the other end of the store.
It seems obvious that while we need to measure performance, we need to make sure that we measure that right things and in the right way.
What good is measuring pure speed of transactions to “boost efficiency” if at the same time we
  1. alienate our customers with poor service or
  2. harm employee morale, integrity and retention with exacting, inflexible, and onerous measurements?
Like all sound enterprise architecture efforts, we need to make sure that they are reasonable, balanced, and take into account not just technology, but people, and process.
In this case, we need to ensure the process is customer service driven and the employees are treated fairly and humanly. Without these, the productivity savings of engineered labor standards will be more than offset over time by the negative effects to our customers and employees.

Share/Save/Bookmark

September 27, 2008

Intel is King of Change and Enterprise Architecture

Intel is one of the most amazing companies. They are the world’s largest semiconductor company, and the inventor of the popular x86 microprocessor series found in most PCs. Intel has around $40 billion in annual revenue, and ranked 62 in the Fortune 500 last year.

The Wall Street Journal 27-28 September 2008 has an interview with CEO of Intel, Paul Ostellini, that offers some useful lessons for enterprise architects:

  • Plan for change—“A CEO’s main job, because you have access to all of the information, is to see the need to change before anyone else does.” It’s great when the CEO has access to the information for seeing ahead and around the curves, but many do not. Information is critical and leaders need plenty of it to keep from steering the enterprise off a cliff. An important role of enterprise architects is provide business and technical information to the CEO and other executives to give them clear vision to the changes needed to grow and safeguard the business. (Perhaps better information would have prevented or reduced the damage to so many companies in dot-com bubble a few years ago and the financial crisis afflicting Wall Street today!)
  • Question repeatedly—a prior CEO of Intel, Andrew Grove, taught him “Ask why, and ask it again five more times, until all of the artifice is stripped away and you end up with the intellectually honest answer.” It easy to accept things on face value or to make snap judgments, but to really understand an issue, you need to get below the surface, and the way you do this is to question and dig deeper. I think this is critical for enterprise architects who are evaluating business and technology and providing recommendations to the business that can potentially make or break change efficacy. Architects should not just capture information to plunk into the architecture repository, but should question what they are seeing and hearing about the business, validate it, categorize it, and analyze it, to add value to it before serving that information up to decision makers.
  • Measure Performance—“we systematically measured the performance of every part of the company to determine what was world class and what wasn’t. Then as analytically as possible, --we made the cuts…and saved $3 billion in overall spending.” Measuring performance is the only way to effectively manage performance. If decisions are to be anything more than gut and intuition, they need to be based on quantifiable measures and not just subjective management whim. Enterprise architects need to be proponents for enterprise-wide performance measurement. And not just at the top level either. Performance measures need to be implemented throughout the enterprise (vertically and horizontally) and dashboard views need to be provided to executives to make the measures visible and actionable.
  • Communicate, communicate—“I made it my job to communicate, communicate, communicate the positive message. I did open forums, I did Webcasts, I told the employees to send me questions via email and I’d answer them...you have to convince them through reasoning and logic, the accuracy of your claims.” Good communication is one of those areas that are often overlooked and underappreciated. Leadership often just assumes that people will follow because they are “the leaders”. NOPE! People are not sheep. They will not follow just because. People are intelligent and want to be respected and explained to why….communication early and often is the key. The approach to architecture that I espouse, User-centric EA, focuses on the users and effectively communicating with them—each the way they need to absorb the information and at the level that is actionable to them. Making architecture information easy to understand and readily available is essential to help make it valuable and actionable to the users. User-centric EA uses principles of communication and design to do this.
Intel, in its 40 year history, has repeatedly planned for change, measured it, and managed it successfully. Intel’s CEO, Gordon Moore, is the epitome of driving change. Moore, the founder of Moore’s Law, captured the exponential change/improvement in silicon chip performance—identifying that the number of transistors packed on silicon chip would double every two years. Intel’s subsequent obsession with Moore’s Law has kept them as the dominant player in computer processors and may lead them to dominance in cell phones and other mobile devices as well.
Share/Save/Bookmark

September 26, 2008

Treating the Root Cause and Enterprise Architecture

All too often, when there are issues in our organizations, we treat the symptoms instead of the problems. Just like this is bad medicine in treating illness and healing patients, so too it is ineffective in architecting our organizations.

The Wall Street Journal, 22 September 2008, has an article entitled “Making the Most of Customer Complaints.”

The quick-fix problem resolution:

"Companies have customer service sort out the immediate problem, offer an apology or some compensation, then assume all is well. This approach does nothing to address the underlying problem, practically guaranteeing similar failures and complaints.”

This “has enormous impact on customer satisfaction, repeat business, and ultimately profits and growth.”

The three actors and their conflicting approaches:

The customer—“can be left feeling their problem was not addressed seriously, even when they’ve received some form of compensation.” Customers are fairness-minded; they want to know why the problem occurred and that it will not happen again.

The service rep—“can start seeing complaining customers as the enemy, even though they point out flaws that need fixing.” Customer service reps are yelled at and abused by frustrated and angry customers who hold the service reps responsible for failures that are out of their control.

The managers—“can feel pressure to limit flows of critical customer comments, even though acting on the information will improve efficiency and profits.” Managers need to learn from failures and reengineer the processes to correct problems, but instead they fear reporting negative customer satisfaction and shun reporting these. In essence, they are taught to just make the problem go away!

The result:

“Fewer than 8% of the 60 organizations” in the wall Street Journal study did well integrating these actors and their perspectives to resolve problems at their root cause.

The focus unfortunately is on short term results instead of architecting long term success.

“Our experience with managers interested in improving service recovery indicates that most hope for a quick fix…but quick fixes only treat the symptoms of underlying problems. Real resolutions should involve closer integration among the three stakeholders, such as gathering more information from customers and sharing it throughout the company, and adopting new structures and practices that make it easier to spot problems and fix them.

There is an important enterprise architecture lesson here:

While executive management often want to achieve a quick turnaround and show results ASAP, and getting the low hanging fruit is often quite tempting, it is not often going to lead to substantive improvement in our organizations without a commitment and plan to address root cause.

Sure, in architecting the organization, we need to start somewhere, show progress, and continuously build on initial success (i.e. it’s an evolutionary process). However, there must be a long term plan/architecture that deals with genuine, deep-seated organizational issues, improves our underlying processes and their technology enablement, and leads to fundamental growth and enterprise maturation. A quick fix just will not do!


Share/Save/Bookmark

September 21, 2008

Home Depot and User-Centric Enterprise Architecture

Operational efficiency can be the downfall of customer service.

Home Depot, with approximately $80 billion in sales is #22 on the Fortune 500. They are the world's largest home improvement specialty retailer with over 2200 retail stores, and after Wal-Mart, they are the second largest retailer in the U.S.

Yet, Home Depot has been on a slide, according to Fortune Magazine, 29 September 2008.

“Over the past several years a trip to the big orange box has so often ended in frustration that the company once famous for its helpful employees became fodder for late-night TV jokes and home to hundreds of blog rants about bad experiences and disengaged or scarce employees."

How has this affected business?

“On the University of Michigan’s American Customer Satisfaction Index, Home Depot fell eight points in seven years, to 67 at the end of 2007. It was the largest drop for any retailer in the index, while rival Lowe’s remained steady at 75…In this third year of decline, Home Depot’s same-store sales dropped 7.9% in 2008 second fiscal quarter; rival Lowe’s posted a 5.3% drop.”

What went wrong at Home Depot?

In 2000, Robert Nardelli of GE took over as CEO, acquired 30 companies and nearly doubled revenues, but he also imposed the rigorous GE style “systems- and data-culture, to help centralize purchasing and merchandising…[focusing] on growth and efficiency” and assessing store managers on 30 metrics, but “none related to customer service.”

Can you believe that Home Depot used 30 measures and NOT ONE had to do with customer service???

Unfortunately, says Ken Langone, one of the founders of Home Depot, Nardelli “didn’t appreciate the importance of a kid on the floor with an apron on.”

“The focus was on the metrics below the sales line, but not sales itself,” says a regional manager. “Stores became dirty, employees, surely or scarce. The result a company that looked better on paper, felt much unhappier in person. And in the retail business, where the customer experience is what matters most, that unhappiness eventually showed up at the cash register.”

Back to customer basics:

Now, under new CEO Frank Blake, Home Depot is returning to its customer-driven roots, and as a result they are closing the same-store sales gap with Lowes and stopping the slide in customer satisfaction. But regaining the trust of their customers will certainly be a challenge and a road to recovery.

As I read this story in Fortune about Home Depot and internalized it, I came to appreciate more than ever the duality and criticality of User-centric Enterprise Architecture (UCEA).

UCEA is not just developing the enterprise architecture with our users in mind (i.e. providing critical strategic information and governance services to the executive decision makers, line of business program and project managers, and IT professionals)—that is only one part. Perhaps the more critical element of User-centric EA is focusing the enterprise’s architecture on its customers. The way to continuously move the organization into the future is to always to focus and refocus on the organizations’ customers—on their needs, tastes, and continuous satisfaction.

The key is to align the business and technical architecture with customer needs. The organization will only succeed if its users are getting what they need and that is the architecture that must be developed and refined over time.
Share/Save/Bookmark

September 12, 2008

“Postmodern IT” and Enterprise Architecture

We all want to know where IT is going in the future, what the trends are, so we can meet our future in it head-on.

CIO Magazine, 1 May 2006, had an article called, “The Postmodern Manifesto”, predicting what the postmodern IT department will look like. 2+ years have passed (a long time in IT according to Moore’s Law), but these IT trends remain solid and true.

  • Business innovation—“IT will assume responsibility for business innovation across the company. IT has spent the better part of 40 years automating business processes…IT’s role in process innovation will only increase…’we’ve gone from being the engineers of new processes to being the movers of innovation across the company,’” says Judith Campbell CIO of New York Life.

This view is consistent with the Federal Enterprise Architecture Practice Guidance, November 2007 that states: “Results-oriented architecture is developed with the context of the Performance Improvement Lifecycle broken down into three-phases: ‘Architect’, ‘Invest’ and ‘Implement’. Each lifecycle phases is comprised of tightly integrated processes which combine to transform an agency’s top-down strategic goals and bottom-up system needs into a logical series of work products designed to help the agency achieve strategic results.”

Bottom line is the IT function and enterprise architecture in particular is viewed as the discipline for business process reengineering, improvement, and the introduction of new technologies, and the measure of success is results—cost-savings, cost-efficiencies, and performance improvements.

  • Federated governance—“IT governance will settle on the federated model and shared services…CIO’s have come to a consensus on the overall model for IT: a mix of centralized and local services known as the federated model, which is governed centrally by a small headquarters staff that gives varying degrees of autonomy to IT groups allied with different business units, functions or geographies.”

This is consistent with the need for IT organizations to be interoperable, secure, share information and services, and be cost effective, yet at the same time stay nimble and allow “unique resources to remain local.”

  • Return on Investment (ROI)—“IT ROI will become even more difficult to prove…Tacit IT is not about automation…Tacit IT is all about decision support, knowledge management, business intelligence and artificial intelligence…And the pressure will be on vendors to make technology think rather than automate.”

IT has always been challenged in measuring return on investment (or in the government return on mission), but it is especially difficult when it comes quantifying the return on an abstract called information.

This performance measurement challenge is manifest in the field of enterprise architecture as well.

At the 1105 Government Information Group Enterprise Architecture Conference in DC this past week, Keith Herrington of the Defense Intelligence Agency (DIA) presented the following:

“• Observation: Within the Federal government there is no observed link between the maturity of the enterprise architecture effort and the performance of the enterprise as a whole.”

I too have personally seen many agencies struggle to quantify the results of their IT and architecture programs and hence, anecdotal evidence, unfortunately continues to prevail as the default “measurement.”

  • Transformation—“CIOs will have to step up…’the concept of providing a secure, stable infrastructure is merely the price of admission,’ says Jeffrey Campbell, CIO of BNSF Railway. ‘[to survive], you have to be a transformational CIO.’”

So true! According to an article in Architecture and Governance Magazine, Volume 3, Issue, “Metrics that Matter”: “IT should measure three types of attributes in what is essentially a modified form of the Balanced Scorecard approach to measure performance and change management. Those three attributes are: strategic value, project management effectiveness, and operational effectiveness. Ironically, while the first two matter the most to executives in most cases, IT typically focuses on the third area, which executives only care about if the IT department has a history of failure and thus needs to be closely monitored on the basics.”

Yes, we need to make sure the IT computer and server “lights” stay on, the network is up and the communications are available, but more importantly we need to take IT to the next level, to strategically partner with the business to architect, govern, and achieve genuine, measureable ROI and transformation!


Share/Save/Bookmark

July 3, 2008

Earned Value Management and Enterprise Architecture

“Earned Value Management (EVM) is a project management technique used for measuring project progress in an objective manner. EVM combines measurements of technical performance (i.e., accomplishment of planned work), schedule performance (i.e., behind/ahead of schedule), and cost performance (i.e., under/over budget) within a single integrated methodology. When properly applied, EVM provides an early warning of performance problems.” (Wikipedia)

There is a terrific article on EVM called “If the Pharaoh Had Only Used An Earned Value System in Building the Pyramids,” by Lt. Col. William Neimann USAF (Ret.) Lt. Col. Neimann demonstrates very effectively how to use EVM (a scary topic to many) in a humorous scenario of ancient Egypt and the building of the pyramids.

The article starts as follows:

"The developer of the great pyramid of Egypt might be looked upon as the father of program management. He had one of the first programs in recorded history that required a great deal of integration and coordination (i.e. program management). He did not, however, have the relatively new concept of "earned value" to assist in the management of this ambitious program. An "earned value" concept is the heart of all defense contractor management information systems, which comply with DoD Instruction 5000.2 concerning the earned value management control system (EVMCS). But let's go back nearly 5,000 years to the construction of the pyramids to see if "earned value" would have been of any utility in managing that program.”

So what are the key measures in EVM for identifying cost and schedule variances?

(Positive is favorable, Negative is unfavorable)

  • Cost Variance (CV) = Budgeted Cost for Work Performed (BCWP) - Actual Cost for Work Performed (ACWP)

So, if the Pharaoh’s project manager budgeted 14 million shekels for the pyramid construction, but actual cost came in at 13 million shekel, then the project has a positive or favorable cost variance of 1 million shekels. The pyramids are under budget.

  • Schedule Variance (SV) = Budgeted Cost for Work Performed (BCWP) – Budgeted Cost for Work Scheduled (BCWS)

So, if Pharaoh’s project manager calculates that work performed was budgeted at $10 million shekels, but was scheduled to be 14 million shekels complete, then the project has a negative or unfavorable schedule variance of 4 million shekels. In other words, the pyramid builders have performed 4 million less work than planned. The pyramids are that behind schedule.

To calculate the overall project status at any given time:

  • % Schedule = (Budgeted Cost for Work Scheduled (BCWS)/Budget At Completion (BAC)) * 100
  • % Complete = (Budgeted Cost for Work Performed (BCWP)/Budget At Completion (BAC)) * 100
  • % Spent = (Actual Cost for Work Performed (ACWP)/Budget At Completion (BAC)) * 100

How efficient is the project?

Greater than 1 is favorable, less than 1 us unfavorable:

  • Cost efficiency = Budgeted Cost for Work Performed (BCWP)/Actual Cost for Work Performed (ACWP)
  • Schedule efficiency = Budgeted Cost for Work Performed (BCWP)/Budgeted Cost for Work Scheduled (BCWS)

(Adapted from Earned Value Management Gold Card, Defense Acquisition University)

There are a number of other measures, but you get the idea.

EVM is important to Enterprise Architecture, why?

Enterprise architecture planning and IT governance is all about making order out of chaos in managing IT. By setting strategic direction with the architecture and enforcing it with sound governance, we set the stage for more successful IT project delivery. EVM is a way to measure IT projects success in terms of cost, schedule, and performance. Through EVM, we can measure our IT projects to ensure that we are meeting our EA plan and making course corrections as necessary through the governance process.

EA, IT governance, and EVM are ways to ensure that we no longer manage IT by the “seat of our pants” approach (gut, intuition, politics, and subjective management whim). We now have tools to plan, govern, and measure transformation.


Share/Save/Bookmark

May 9, 2008

Gamers and Enterprise Architecture

More and more people are turning to gaming for entertainment, social interaction, some thrills and fun and even some challenge.

Many in society think that gamers, because they like to “play”, are childish, slovenly or irresponsible. However, there are many characteristics that gamers demonstrate that demonstrate that they are perhaps some of the best employment “catches” around.

Harvard Business Review, February 2008, states that “the gamer disposition has five key attributes. More than attitudes or beliefs, these attributes are character traits that players bring into game worlds and that those worlds reinforce. We believe that gamers who embody this disposition are better able than their non-gamer counterparts to thrive in the twenty-first century workplace.”

What are the gamer characteristics that can enable them to succeed in the modern workplace?

  1. Performance-oriented—“gamers like to be evaluated, even compared with one another, through systems of points, rankings, titles, and external measures. Their goal is not to be rewarded, but to improve.”
  2. Value diversity—“diversity is essential in the world of the online game. One person can’t do it all; each player is by definition incomplete. The key to achievement is teamwork, and the strongest teams are a rich mix of diverse talents and abilities.”
  3. Desire change—Nothing is constant in a game; it changes in myriad ways, mainly through the actions of the participants themselves…gamers do not simply manage change,; they create it, thrive on it, seek it out.”
  4. Learning is fun—“for most players, the fun of the game lies in learning how to overcome obstacles.”
  5. Innovative—“gamers often explore radical alternatives and innovative strategies for completing tasks, quests, and challenges. Even when common solutions are known, the gamer disposition demands a better way, a more original response to the problem.”

How do gamers, or for that matter people in general, relate to enterprise architecture?

Gamers are a growing segment of the population and their characteristics and skill sets need to be integrated in support of our business processes and technologies. The way to do this is through an enterprise architecture that speaks to a human capital perspective.

Many times, I have written about the need for a human capital perspective (reference model) to be added to the Federal Enterprise Architecture (FEA). This would address the “people/who” perspective of the Zachman Framework and address the critical issues of the most important asset of the organization, its people.

Unfortunately, the FEA is still anchored in the industrial revolution, with factories served by “indentured” workers on the assembly line; people no more important than the mind-numbing, repetitive tasks that they performed 12 or more hours a day for little pay and certainly little respect.

The Federal Enterprise Architecture needs to enter the information age, where knowledge workers are the catalyst of innovation, engineering, modernization and transformation. The addition and focus on a human capital perspective to the architecture would be a good start to recognizing the centrality of people and brain-power to the competitiveness and future of our industries and nation.

One of the issues that the human capital perspective should address are the types of skills and attributes (such as those that gamers demonstrate) that are best aligned to support the requirements of the enterprise and its mission.


Share/Save/Bookmark

May 2, 2008

Executive Dashboards and Enterprise Architecture

Enterprise architecture makes information visible to enable better decision making in the organization. One tool to help do this is the executive dashboard.

In management information systems, a dashboard is a executive information system user interface that (similar to an automobile's dashboard) is designed to be easy to read. For example, a product might obtain information from the local operating system in a computer, from one or more applications that may be running, and from one or more remote sites on the Web and present it as though it all came from the same source. (Wikipedia)

Dashboards help manage information overload:

  • “After three decades of aggressive computerization, companies are drowning in data and information. People produced about five exabytes of new information in 2002, twice the amount created just two years earlier” (Trend: The New Rules of Information Management by Jeffrey Rothfeder)
  • Dashboard are a way to take the fire hose flood of information that we get every day and make it more actionable by structuring it, focusing it, and making it more understandable often through visual displays. Note, this is similar to User-centric Enterprise Architecture’s use of principles of communications and design, such as information visualization to effectively communicate the baseline, target, and transition plan in the organization.

Dashboards provide business intelligence:

  • Dashboards, like enterprise architecture itself, contribute to translating data into business intelligence. EA does this by capturing, analyzing, cataloging, and serving up information in useful and usable ways to enhance decision making by the end-users. Dashboards do this by capturing and aggregating performance metrics, and displaying them in easy-to-read and often, customizable formats.

Dashboards generally focus on performance:

  • Dashboards generally are used for displaying, monitoring, and managing an organization’s performance metrics. Note, “performance” is one of the perspectives of the enterprise architecture, so dashboards are a nifty way to make that EA perspective really come alive!
  • According to DM Review, 15 April 2008, “Dashboards Help Drive and Improve Performance Metrics…Presented in highly visual charts and graphs, this data can provide each level of the organization with the information it needs to best perform…Dashboards also can be a key driver of performance improvement initiatives, offering a simple and graphical way to make key performance indicators (KPIs) visible throughout the enterprise.”

Dashboards typically provide activity monitoring and drilldown capability:

  • “The most effective dashboards allow users to drill down into the KPIs to find root cause or areas likely to cause problems. Some can even be configured to alert maintenance or support personnel when performance drops” or dangerous thresholds are crossed. Dashboard also help “make comparisons of multiple data sources” over time. These functions are called business activity monitoring, and when applied to the organization’s network, for example, is referred to a network monitoring.
  • The ability to monitor and manage performance using the dashboard is similar to ability to monitor and manage the organization’s track along it roadmap using EA!
  • The most effective dashboards, like the most effective enterprise architectures, are those that provide information in multiple layers of detail, so that the executives can get the high-level summary, the mid-level managers can understand the relationships between the information, and the analysts can drill down and get the detail.

Dashboards—an effective human-machine interface:

  • Dashboards done right, are an effective EA tool, and serve as a window into the organization’s performance; they provides real-time, summary and granular information for making quick and specific decisions to positively affect performance.

Share/Save/Bookmark

April 30, 2008

Customer Experience Management and Enterprise Architecture

Customer service is so important. We need to architect it in every fiber of the organization. Good customer service is a critical differentiator for organizations and it offers a strategic competitive advantage to those enterprises that embrace it and make it central to their product offering.

DM Review, 25 April 2008, reports that “companies are under unprecedented pressure to optimize the customer experience.”

Customer Experience Management (CEM) is emerging as an increasingly important tool. CEM is the practice of actively listening to customers, analyzing what they are saying to make better business decisions and measuring the impact of those decisions to drive organizational performance and loyalty.”

CEM information should be considered an essential component of the business perspective of the enterprise architecture. CEM should be incorporated into EA planning and governance to accelerate and improve enterprise decision making such as “tailoring products to customer desires to save investment in unwanted innovations.” The overall goal is to provide the customer with world-class service and an overall high satisfaction interaction.

How are organizations achieving CEM?

  1. Chief Customer Officer (CCO)—establishing executive positions that are focused on the customer experience and on earning high marks for customer satisfaction.
  2. Measurement—“putting tools in place that measure the customer experience” and provide feedback to the organization. These tools include customer satisfactions surveys, focus groups, blogs, point-of-sale data/trends, and customer relationship management (CRM) systems that “hold valuable comments from emails, support cases, and online conversations between contact centers and customers.”
  3. Process improvement—using customer feedback and measurement to tune processes, streamline them, and eliminate defects.

Unfortunately, “still at many companies today, the potential of CEM remains untapped.” It behooves the enterprise architects to help drive CEM as a major source of business intelligence and for use in enterprise architecture planning and governance for new investments.

Ultimately, just like the EA end-user is the final arbiter for driving the development of the EA information products (so they are useful and usable), so too the customer is king when it comes to influencing the organizations’ future direction for product, process, technology, and service. If we’re not satisfying our customers, they will find a better supplier to give their business to.


Share/Save/Bookmark

April 18, 2008

Requirements Management and Enterprise Architecture

Requirements management is critical to developing enterprise architecture. Without identifying, understanding, and rationalizing the organization’s requirements, no meaningful enterprise architecture planning can occur.

“The purpose of Requirements management is to manage the requirements of a project and to identify inconsistencies between those requirements and the project's plans and work products. Requirements management practices include change management and traceability.”

Traceability is the identification of all requirements back to the originator, whether it be a person, group, or legal requirement, or mandate. Traceability is important to ensure alignment of end products with the origination of the requirements, prioritization of requirements, and determining requirements’ value to specific users. Traceability should ensure that requirements align to the organization’s mission (intended purpose) and its strategic plan. (Wikipedia)

How is requirements management done?

  1. Stakeholders—identify program/project stakeholders.
  2. Requirements—capture, validate and prioritize stakeholder requirements.
  3. Capabilities—analyze alternatives and plan for capabilities to fulfill requirements.
  4. Resources—ascertain resource needs for capability development
  5. Activities—perform activities to develop the capabilities to meet the requirements.
  6. Measures—establish measures to demonstrate requirements have been met.

How does EA bridge requirements and capabilities?

Enterprise architecture captures strategic requirements—high-level mandates or needs. It uses this to establish an integrated set of functional requirements areas or cross-cutting categories of requirements. These drive strategic capability development to meet mission needs and achieve results of operation. Strategic capabilities are reflected in the enterprise architecture in the target and transition plan. This is used to evaluate proposed new IT projects, products, and standards to ensure that they align to and comply with the EA.

EA is the glue that binds sound IT investment decision making to strategic requirements and technical alignment.


Share/Save/Bookmark

April 13, 2008

Strategy and Enterprise Architecture

Enterprise architecture develops the organization’s IT strategic plan and influences its business strategic plan. In order to do this, EA itself must have a strategic roadmap.
Harvard Business Review, April 2008, states that “companies that don’t have a simple and clear statement of strategy are likely to fall into the sorry category of those that have failed to execute their strategy or, worse, those that never had one. In an astonishing number of organizations, executives, frontline employees, and all those in between are frustrated because no clear strategy exists for the company or its lines of business.”
Elements of a strategic plan
What are the elements of a strategic plan?
  1. Mission— “why we exist;” this is the purpose of the organization
  2. Values—“what we believe in and how we will behave”
  3. Vision—“what we want to be
  4. Strategy—“What pour competitive game plan will be; this includes the following: A) Objectives—what we want to achieve: goals and objectives B) Scope—“the domain of the business; the part of the landscape in which the firm will operate.” C) Advantage—the means or initiatives that define how you will achieve your objectives; “what your firm will do differently or better than others,” defines your competitive advantage.
  5. Balanced scorecard—“how we will monitor and implement that plan” A strategic plan for EA
    According to the American Management Association, the mission statement defines what the ultimate purpose of the organization is. It tells who you are, what you are, what you do, who do you serve, and why do you exist.
    The mission statement takes the form of: The [blank] is a [blank] that [produces blank] for [blank] to [help blank].
    For example, the mission statement for enterprise architecture:
    The [enterprise architecture program] is an [office of the CIO] that [develops information products and governance services] for [the employees of ABC organization] to [improve decision-making].
    The values of EA are: driving measurable results, aligning technology with the business, information-sharing and accessibility, service interoperability and component reuse, technology standardization and simplification, and information security.
    The vision of EA is to make information transparent to enable better decision-making.
    The strategy provides the conceptual way you will pursue your mission and vision.
    Defining the objective, scope, and advantage requires trade-offs, which Porter identified as fundamental to strategy.” For example, a growth or market size strategy may obviate profitability, or a lower price strategy may hinder fashion and fit. The point is that an organization cannot be everything to everybody! Something has got to give.
    So for example, in EA, we must trade off the desire to be and do all, with the reality that we must focus on entire enterprise. Therefore, we distinguish ourselves from segment architecture and solutions architecture. In EA, we focus on strategic outcomes and delegate line of business architectures and systems architectures to the lines of business and solution developers.
    Finally, EA implements a balanced scorecard by instituting mechanisms for monitoring and implementing its plans. These include performance metrics for both information products and governance services.
    In sum, to get a meaningful EA plan in place, we have to answer these fundamental elements of strategy for the EA program itself.

Share/Save/Bookmark

September 28, 2007

Getting Performance Metrics Right

Architecture and Governance Magazine, Volume 3, Issue 3 has a great piece on developing “Metrics that Matter”.

The idea is that metrics are a critical management tool for tracking, managing, and ultimately, changing organizational behavior!

All too often, organizations do not develop or keep metrics on anything below a top-level organizational view, and even then just develop metrics that either make them look good (i.e. the metrics are very achievable) or that are easy to measure (i.e. the measures are readily available from existing data).

Organizations cannot really drive improved performance if they do not measure systemically and strategically thoughout the enterprise!

For IT metrics, Architecture and Governance Magazine proposes that we use three core categories of metrics:

  1. Strategic Value—The most difficult area to measure, but one of the most valuable from the business point of view; it “identifies the degree of a business unit’s effective use of technology,” to achieve mission execution and and results of operation.
  2. Project Management Effectiveness—this should “cover the quality, scope, and milestones…includes schedule adherence, functional delivery requirement specifications, and—the least often measured—return on investment for several years after deployment.”
  3. Operational Effectiveness (And Efficiency)effectiveness, which is the more important metric, involves measuring such things as customer satisfaction, cost-savings, income generation, or ehanced mission capabilities; efficiency, on the other hand, is where IT leaders often “drown executives in operational data such as help-desk resolution times and network uptimes—data that is meaningless to the corporate strategy and cements IT’s reputation as being little more than a janitorial service for technical systems.” Additionally, “if they demonstrate only efficiency, they play into the bean-counter mentality that all that matters is extracting more efficiency from the system. That’s an easy road to continued cuts…‘this cost focus had led to the suboptimatization of IT’…[and] can even lead to the eventual outsourcing of IT.”

In general, emphasize the top 2 categories of measures, and focus only on the 3rd “if the IT department has a history of failure and thus needs to be closely monitored on the basics.”

Finally, “a good rule of thumb is that there should be less than a half-dozen key metrics provided to executives…if they need more detail, provide the drill-down capabilities, but don’t make it part of the standard report.”

In User-centric EA, performance metrics are one of the primary perspectives of the enterprise architecture (which include performance, business, information, service, technology, security, — and human capital, in the future). The performance measurement view of EA is the pinnacle of the architecture, where we identify mission execution and results of operation goals and then track and manage to these. The performance measures cascade throughout the organization to build performance results, bottom-up, to achieve mission execution and the performance goals set at the highest levels.

Additionally, IT needs to take a front position (i.e. lead by example) in developing and managing to solid performance measures that not only demonstrate the effectiveness of its utility operations, but that demonstrates effective management of new IT investment dollars to bring new and enhanced capabilities to the end-users and most importantly, that it adds to the strategic results of the enterprise.


Share/Save/Bookmark

September 18, 2007

Performance Metrics and Enterprise Architecture

In User-centric EA, we are focused on delivering value to the end-user, and to do this we measure and track our performance results to ensure that we are meeting EA program and end-user goals.

In general, you can’t manage, what you don’t measure.

In User-centric EA, we measure both program and product metrics.

  • Program metrics—measures of the major program areas in EA; these include development, maintenance, and use of architecture products and governance services. Examples of program measures includes: information products developed per time period, total information products under maintenance (‘the maintenance burden’), and under usage—EA system reviews conducted at the agency, Product and Standard reviews conducted at the agency, end-user information requests fulfilled, departmental decision requests supported, external data call responded to, EA website hits, and so on.
  • Product metrics—measures of the amount of data (functions, information objects, systems, technologies, etc.) and their attributes in the EA products and repository; this is used to understand that breadth and depth of the architecture information being provided to end-users and to ensure that it is the ‘right’ information in terms of its scope to enhance decision-making. Additionally, the product measures help understand the general complexity of the information areas, and the challenge of maintaining them and keeping them relevant in terms of currency, accuracy, and completeness.
One of the perspectives or views of information in the EA is performance measures for the enterprise. EA is not only the repository for those corporate measures, but EA itself develops and uses performance measures to ensure that it is meeting enterprise goals and end-user requirements.
Share/Save/Bookmark