Five Uses of a Prioritization Scoring Model

Project prioritization is one of the most common topics in portfolio management literature. Within the context of project prioritization is the matter of scoring models because scoring models are the most widely used approach to prioritize projects. Although there are a lot of opinions on the effectiveness of common scoring models, they are nonetheless the most common method for prioritizing projects. However, most people may not realize the many uses of a scoring model and how it drives better decision making beyond project prioritization. In this post, we will look at five uses of a scoring model.

1) Project prioritization is the most common reason for using scoring models. As we saw in a previous post, project prioritization is for resource allocation. Since portfolio management is about delivering the most business value through projects, it is logical to ensure that resources are spent on the most important work. Ranking projects helps provide a common understanding of what is most important in the organization and scoring models are one of the easiest ways of establishing a rank order. For more information on using prioritization scoring models to rank order projects, please see Mastering Project Portfolio Management.

2) A prioritization scoring model is also used for project selection. The idea is to rank projects from highest value to lowest value and select projects until resources run out. This approach has merits over other approaches that do not sufficiently take account of strategic drivers. However, it can be shown that even simple optimization techniques can yield a higher value portfolio at the same cost. For organizations that do not employ portfolio optimization techniques, using a scoring model to rank order projects and fund projects until resources runs out is a reasonable way to go.

3) Portfolio optimization is very useful for identifying higher-value portfolios than merely using scoring models as discussed in the previous paragraph. The scores for each project can represent a “utility score” which can then be used as the input for the optimization calculations. In this way, projects are optimized based on all the scoring inputs, not merely on net present value or some other financial estimate. For more information about this technique, please refer to Richard Bayney’s book Enterprise Project Portfolio Management: Building Competencies for R&D and IT Investment Success.

Efficient Frontier Example

4) A prioritization scoring model can also be used to make go/no-go decisions at gate review meetings. There are at least two ways to accomplish this:

A) Organizations can predetermine a threshold score that projects must exceed in order to be considered for inclusion in the portfolio (known as a scoring hurdle).

B) An alternative approach is to use a scoring range to provide better input to the decision makers. In other words, if the scoring range were from 0 to 100, scores below 30 might represent high-risk/low-value investments that should otherwise be rejected, but may only get approved if there were other intangible factors not considered by the scoring model. Projects in the middle range of scores might be approved with more scrutiny, and projects in the upper range would likely get approved. The prerequisite to taking this approach is to have an adequate number of historical scores from past projects to compare against. Statistical analysis would further help refine this approach. Another assumption is that the scoring model would have to remain fairly consistent over time with few changes. Otherwise, historical scores could not be used to determine the correct range unless special adjustments are made to the scores.

5) Finally, scoring models provide the input to build risk-value bubble charts, which provide great visual information to senior leaders. The scoring model needs to contain both value elements and risk elements as inputs for the diagram. Normally, these scores are summed to become a single number, but with the risk-value bubble chart, we need to break out the total value score and the total risk score in order to correctly plot the data on a chart. With further data elements such as strategic alignment and expected cost (or return), more information can be displayed on the bubble charts (see example below).

Portfolio Bubble Chart

Book Review-A Fish In Your Ear

After reading the first three chapters of A Fish In Your Ear, I stopped reading it for about a year. A lot of time is spent discussing the psychology of decision making, which is not often covered in the PPM literature, but it wasn’t enough to keep my attention. I came back to the book a year later and am glad I did because the best part of the book is in chapters 4-7.

Chapter 4 describes the importance of managing portfolio data, data integrity, and how to collect the right data. He opens up the chapter with a great quote by Bill Gates, “How you gather, manage, and use information will determine if you win or lose.”  Early on Menard mentions that an organization’s central nervous system is its information management system and that an organization is only as effective as its knowledge is good.  After a solid discussion on variables, data integrity, data-quality influencers, and other items he concludes the chapter on data collection. The list of questions in this section is one of the gems of the book. Menard does a great job of highlighting how asking the right questions can uncover the data needs of the organization.

A Fish In Your Ear

Chapter 5 builds on chapter 4 and discusses decision criteria. Having the right information is important, but it is even more important that senior leaders have defined and agreed-upon criteria to discriminate between projects. In the middle of the chapter he gives a great explanation for why having clear objectives is a necessity for making the right decisions. “Once we clarify our objective and can clearly state and compare it to alternatives, it becomes a guiding star helping us navigate to our chosen destination.”

Chapter 6 continues with a good discussion of data visualization. I fully agree that in order to make sense of so much data, it has to be visualized. Not only GenSight, but companies like Tableau are working hard to help users visualize data. The results can be very enlightening. In this chapter, Menard discusses the various elements to help visualize data: color, shapes, size, and matrices. He concludes with visual rules: give people what they want, show what matters, make it rich, make it valid, and have a purpose.

Chapter 7 focuses on portfolio selection. He brings up two burning questions early in the chapter: “will this portfolio deliver our strategic goals?” and “do we have enough appropriate resources to execute the portfolio?” The first question touches the matter of what the organization should do, the second on what they can do. The second half of the chapter provides a great discussion on the matter of portfolio optimization.

In short, chapters 4-7 of A Fish In Your Ear are worth the price of the book and provide some of the best explanations of collecting and utilizing portfolio data that I have read. Rating: 4 out of 5 stars.

The Purpose and Goal of Prioritization

Prioritization is firstly about focus—where to assign resources and when to start the work. It is not primarily about scoring methods and ranking mechanisms.  Without defining project priorities, it is difficult to effectively distribute personnel to carry out the highest valued projects. Project priorities enable management to assign their employees to the most important projects. Gaylord Wahl of Point B says that priorities create a ‘true north’ which establishes a common understanding of what is important. Prioritizing projects enables organizations to make the best use of company resources. Without a clear and shared picture of what matters most, lower-value projects can move forward at the expense of high-value projects. Again, prioritization is about focus—WHERE to assign resources and WHEN to start the work. Prioritization and resource allocation go hand in hand.

Resource Priority and Schedule Priority

In the diagram above we see that prioritization relates to resource priority and schedule priority. Resource priority drives the question, “where are we going to invest our resources now?” The fundamental resources are money and people. Since there is often more work to be done than there are resources available, senior leadership needs to provide guidance of where to investment money and where to allocate human resources.  This requires an understanding of how to get the most important work done within existing capacity constraints. However, not all projects can be initiated immediately. Prioritization can also help direct the timing and sequencing of projects. In some cases, high priority projects may have other dependencies or resource constraints that require a start date in the future. In other cases, lower priority projects get pushed out into the future. In both cases, schedule priority helps answer the question “when can we start project work?”   Having the right human resources available to do project work is a critical success factor. High priority projects have a higher likelihood of success due to adequate staffing. Lower priority projects may face more resource contention and have a higher risk of project delays due to inadequate resource time. Lower priority projects that get pushed out into the future have an even lower likelihood of success since these projects face challenges around project initiation and higher resource contention.

The purpose of prioritization is to allocate resources to the most important work. Prioritization provides focus—WHERE to assign resources and WHEN to start the work. The goal of prioritization is to accomplish the most important work to deliver maximum business value. Although prioritization is a critical need in many organizations, in the next post we will highlight cases where prioritization is a waste of time.

PMI Standard for Portfolio Management Third Edition

The PMI Standard for Portfolio Management Third Edition is the first edition that is worth buying. Having read the 1st and 2nd editions and reviewed the exposure draft for the 2nd and 3rd, PMI has come a long way with the third edition. Nearly all the major components of portfolio management are referenced in this edition (gate reviews being the most significant omission). At the time of this review, I am preparing for the PfMP exam and have read over most of the 3rd edition twice and have studied several sections in detail. It is still not perfect as there are several inconsistencies and items I consider too theoretical (hence the 4 out of 5 star rating), but overall it is a worthy addition to the portfolio management library. 

Chapters 1-2 do a great job of giving an overview of portfolio management with the roles and responsibilities needed to make it work. Chapter 3 also does a pretty good job of creating a structure around which to organize the remaining chapters by setting each of the five knowledge areas (Portfolio Strategic Management, Portfolio Governance Management, Portfolio Performance Management, Portfolio Communication Management, and Portfolio Risk Management) in a table with the three process groups (Defining, Aligning, and Authorizing/Controlling). Chapters 4-5 in my opinion are the weakest parts in the book. There are some great additions such as the portfolio strategic plan and the portfolio roadmap, but some of the strategic processes seem out of order (e.g. prioritizing projects before they have been evaluated by a governance board) or are omitted (e.g. gate reviews). In addition, the Portfolio Charter deliverable is just too theoretical for most organizations to adopt. Chapter 6 does a good job of addressing resource capacity management and benefits realization (two big omissions in previous editions). I found chapter 7 to be very useful related to portfolio communication and I got fresh insight on portfolio risk management from chapter 8.

In short, the PMI Standard for Portfolio Management Third Edition is worth buying and offers great information for portfolio management practitioners.

Book Review – IT Governance

Book review of IT Governance by Peter Weill and Jeanne Ross (Harvard Business School Publishing, 2004)

IT Governance

Synopsis

“IT governance is the most important factor in generating business value from IT.”

“Good governance design allows enterprises to deliver superior results on their IT investments.”

“Effective IT governance is the single most important predictor of the value an organization generates from IT”

The quotes above should draw attention to the importance of well defined and well communicated IT governance. Although not exciting, IT governance helps generate greater value from IT. The authors define governance as “specifying the decision rights and accountability framework to encourage desirable behavior in using IT.” “Governance determines who makes the decisions. Management is the process of making and implementing the decisions.”

Much of the book is spent developing two questions. The first question focuses on the types of decisions that must be made to ensure effective management and use of IT. The authors answer this question by describing five key areas of IT governance that require decision making:

IT Principles—a related set of high level statements about how IT is used in the business.

IT Architecture—the organizing logic for data, applications, and infrastructure, captured in a set of policies, relationships, and technical choices to achieve desired business and technical standardization and integration.

IT infrastructure—determining shared and enabling services.

Business Application needs—specifying the business need for purchased or intentionally developed IT applications.

IT Investment and Prioritization—choosing which initiatives to fund and how much to spend.

The second question addressed in the book focuses on who makes these decisions. The authors address this question by describing six archetypes (decision-making styles) used by enterprises in IT decision making:

Business Monarchy—top managers

IT Monarchy—IT specialists

Feudal—each business unit making independent decisions

Federal—combination of the corporate center and the business units with or without IT people involved

IT Duopoly—IT group and one other group (for example, top management or business unit leaders)

Anarchy—isolated individual or small group decision making

Much research and analysis was made by the authors in connecting the decisions being made with the right decision makers. They conducted an extensive survey of over 250 companies across 23 counties. Based on the results, they concluded that the best performers conducted IT governance differently from the low performers and drew conclusions of what distinguished the two groups.

Commentary

IT Governance was very useful to me personally as it is the most thorough work on the topic that I have read and provided a lot of good insight into how to make governance work. Project portfolio management (PPM) is tightly linked with IT governance, “Portfolio management without governance is an empty concept” (Datz). In order to make portfolio management processes successful a proper governance structure must be in place. Project governance is very much about the types of decisions being made and the people who participate in the decision making. The Project Management Institute’s Standard for Portfolio Management 2nd Edition briefly discussed governance but did not go into the same level of detail as this book. Another well respected PPM expert, James Pennypacker, developed a portfolio management maturity model which identifies governance as a key criteria. This book strongly supplements that maturity model.

This book enlarged my view of IT governance particularly with the five key areas of: IT Principles, IT Architecture, IT infrastructure, Business Application Needs, IT Investment and Prioritization. PPM is very focused on the last area of investment and prioritization, but the four preceding areas lead up to the point of making the investment decisions. It was very clear that a governance structure needs to be set up to account for all five areas.

This book also strengthened my view concerning the people involved with governance. I liked the quote stating, “IT governance is a senior management responsibility. If IT is not generating value, senior management should first examine its IT governance practices—who makes decisions and how the decision makers are accountable.” Governance cannot be delegated to someone else. The authors made it very clear that one of the critical success factors of IT governance is the involvement with senior/executive leadership. Without the adequate leadership, solid governance is likely to fail. In addition, “If business leaders do not assume responsibility for converting [IT capabilities] into value, the risk of failure is high. With high risk comes the likelihood of frustrated business leaders who often respond by replacing the IT leadership or abdicating further by outsourcing the whole ‘IT problem’”. Here the point was made that outsourcing IT may come out of a frustration by the business leaders with IT. Yet, the source of the frustration may very well lie in the poor governance structures established.

Another striking point that affects my current work is the need for improved communication with senior management. Governance communication cannot happen too much. The authors found that “the best predictor of IT governance performance is the percentage of managers in leadership positions who can accurately describe IT governance.” They found that most senior managers could not explain their own governance processes, which would explain why their IT governance doesn’t work properly. These points reinforce my need to continually educate senior management and communicate both the process and the results of our governance procedures so that we have greater project success.

The book was reasonably well written. Although the content was great, I felt that the case studies and diagrams were really lacking. I normally like case studies, but I do not feel that the cases used in this book added any value to me. Many of the diagrams could have also been explained better. As far as improvements, the topic of project portfolio management was barely discussed and is quite important in terms of executing strategic change within an organization. I overlooked it because of the book’s value to the topic of governance, but I definitely feel the authors should have spent more time on this topic. Otherwise, this is a great book for a topic that is overlooked but very necessary. I would definitely recommend it to anyone that is involved with portfolio management or any part of IT governance.

Book Review – Mastering Project Portfolio Management

Mastering Project Portfolio Management is focused on helping organizations master the decision making science of project portfolio management and is best suited for mature organizations wanting to perform advanced portfolio management. It is also great for MBA or Executive MBA students wanting to learn how to develop an organizational data-driven decision making process. Mastering Project Portfolio Management is perhaps the strongest book on the market related to the decision-making science of PPM; the authors state in chapter 1 that “the essence of PPM is reasoned decision making”.  The authors arranged for readers to access Expert Choice, a leading decision making software tool, and include significant material on how to utilize the software to make better portfolio management decisions. In addition, each chapter of the book is based on a portfolio management framework they developed, which helps provide structure for the material.

Chapter 1 provides a great overview of PPM. In one example, the authors compare portfolio management with a ship captain ordering course corrections to the helmsman. “As strategic plans change, the portfolio must change, requiring the portfolio process to be adaptable, flexible, and responsive to rapidly adjust its limited resources in an ever changing global market place.” Chapter 2 covers four key steps for establishing the strategic foundation for solid portfolio management (defining the mission, developing the vision, establishing goals, determining objectives).

Mastering Project Portfolio Management

In my mind, chapters 3 and 4 are the real heart of the book as it goes into detail on the importance of ratio scale measurements and using the Analytical Hierarchy Process (AHP) to prioritizing objectives and projects. “The ability to structure decisions, measure options, and synthesize the measurements to derive priorities is critical to implementing an effective PPM process and in selecting optimal portfolios.” This book provides the clearest explanation on why ratio scale measurements should be used and how AHP enhances portfolio decision making.

Chapters 5-9 continue to develop the PPM framework for identifying, evaluating, and selecting a project portfolio. Chapters 10 focuses on portfolio governance and chapter 11 covers the implementation and evaluation phases by discussing how to utilize earned value management (EVM) to evaluate performance. For organizations ready for advanced portfolio management, Mastering Project Portfolio Management is worth looking at.

Project Pipeline Management

Effective Project Pipeline Management

Project pipeline management is an important component of project portfolio management (PPM) because it encompasses the work needed to “select the right projects”. Pipeline management involves steps to ensure that an adequate number of project proposals are generated, evaluated, and screened out at various stages of the intake process that meet strategic objectives. There are three major sub-components to pipeline management: ideation, work intake processes, and phase-gate reviews illustrated in the figure below.

Ideation – The Starting Point of Pipeline Management

Ideation is the process by which new project ideas are generated. This is slightly different from the work in-take process by which project requests are formally brought forward to a governance board. Ideation is important for collecting the best ideas from the organization, for collecting a sufficient number of project proposals to generate higher quality projects, and to maintain a healthy organization by engaging employees to submit their ideas.

Opportunity Management – The Backlog of the Project Pipeline

Opportunity management complements ideation and further strengthens the project selection process. Some ideas may be great, but for one reason or another, the timing is not right or some other constraint makes the execution of the idea difficult or impossible. For this reason, organizations should establish a “parking lot” of good ideas waiting to enter the project pipeline. This parking lot is really a collection of all of the opportunities waiting to be captured.  The processes for managing opportunities are similar to the processes for managing risks except that opportunities are future events that could produce positive outcomes for the organization. Opportunities often fall into the “should do” or “could do” categories, but enable organizations to achieve more or perform better than planned. Without an opportunity management process, organizations risk losing visibility of potentially beneficial future projects.

Work Intake – The Entry Point of Project Pipeline Management

The work intake process refers to the steps of developing a project proposal and bringing it to the governance board for a go/no-go decision. This process works in conjunction with both ideation and phase-gate, but can also be a standalone process. When used with ideation and phase-gate, the work in-take process helps bridge these other two processes together.  The work in-take process is important so that all project proposals are created in a consistent manner with common tools and processes. The unintended consequences of not having a work in-take process include organizational confusion, time delays, and quality erosion.

Phase-Gates

Phase-gates (also known as Stage-Gate™) are a critical component of project pipeline management. A winning portfolio must contain winning projects, therefore the portfolio management team (PMT) must be able to discriminate between good projects and great projects. The decision gate process enables the PMT to review these projects based on preselected strategic criteria at the gate reviews of the decision gate process. At each of those gates, important project information is provided to the Portfolio Management Team to make a go/no-go decision related to the project. Without this mechanism, unnecessary or poorly planned projects can enter the portfolio and bog down the work load of the organization, hampering the benefits realized from truly important and strategic projects.

Project Pipeline Management
Project Pipeline Management

Pipeline Management and Portfolio Maturity

Pipeline management supports portfolio definition (as seen by ideation, opportunity management, work intake, and Stage-Gate) but also portfolio optimization in relation to project sequencing and project dependencies. Pipeline management is one component of healthy portfolio maturity and you should regularly assess the maturity of your portfolio management processes.

Portfolio Roadmaps

A common method for getting visibility of the active work in your pipeline is a portfolio roadmap. This tool will highlight when major initiatives start and stop and can further support work intake.

Portfolio Management Professional (PfMP)

Project Management Institute (PMI) recently announced that a new Portfolio Management Professional (PfMP) certification would be available later this year. This is very exciting since PMI had released their 3rd edition of the Portfolio Management standard yet had not made a certification previously available in portfolio management. The eligibility requirements are steeper than the PMP.

“PfMP Eligibility Overview
To apply for the PfMP, you need to have either:

A secondary degree (high school diploma, associate’s degree, or the global equivalent), with at least seven years (10,500 hours) of portfolio management experience within the past 15 consecutive years.

OR

A four year degree (bachelor’s degree or the global equivalent), with at least four years (6,000 hours) of portfolio management experience within the past 15 consecutive years.

AND

Since portfolio management focuses on strategic investment matters and high level organizational decisions, it is pertinent to have a foundation of professional business experience. All applicants must possess a minimum of eight years (96 months) of professional business experience.

The PfMP Exam Content Outline is expected to be made available by September 2013. Applications are expected to be made available in Q4 2013. The first opportunity to test during the pilot is expected to be late Q4 2013.”

I can’t wait for the Portfolio Management Professional certification to be officially available.

 

Effective Pipeline Management: Funnel or Tunnel

Project pipeline management is an important component of project portfolio management (PPM) and involves steps to ensure that an adequate number of projects are being evaluated and screened out at various stages of the intake process to meet strategic objectives.  Other factors such as organizational budget and resource capacity also come into play so that the organization is not overloaded with work, which can be a risk factor for completing organizational and strategic goals.

Pipeline Management Question

The question you should ask yourself today is whether or not your organization’s project pipeline resembles a funnel or a tunnel. In theory, as projects pass through the work intake process, those that do not meet key criteria or are deemed of lower value should be screened out. This would cause the project pipeline to look more like a funnel (shown below).

Pipeline Management: Project Funnel
Pipeline Management: Project Funnel

Unfortunately, in reality, this is not often the case. I know of one large Fortune 500 company that killed three times (3x) more projects after they were authorized than when they were initially being evaluated.  In this case, there is hardly a funnel, but more of a tunnel (shown below)  in which most projects get approved. This can cause organizational chaos since more work is authorized than people have time to work (a capacity management issue). Good project pipeline management should evaluate governance decision making effectiveness to understand the rate of up front project approvals. When the portfolio governance team is approving more than 95% of projects, something needs to done to adjust decision making, otherwise project reviews are not effective.

Ineffective Pipeline Management
Ineffective Pipeline Management

In a future post we may explore success factors for managing the project pipeline, but for now it is sufficient to highlight two success factors: strong strategic leadership and clear screening criteria. When senior leaders can say “no” to projects for the right reasons, this will foster a leaner project pipeline and healthier project portfolio. Clear screening criteria make it easier for senior leadership to say no to misaligned projects, which requires a solid understanding of organizational goals and objectives.

Portfolio Management V-Model Part 2

In part 1 of the portfolio management V-model we looked at the left side of V (process and data) that drives better decision making. In part 2 we will look at the right side of the V (leadership and governance) and then tie everything together. Let’s start with governance.

PPM V-Model

Establishing portfolio management governance is a critical component for successful execution of PPM. Peter Weill and Jeanne Ross, authors of IT Governance, define governance as “specifying the decision rights and accountability framework to encourage desirable behavior in using IT. Governance determines who makes the decisions. Management is the process of making and implementing the decisions.” They make the point that IT governance is the most important factor in generating business value from IT and that good governance design allows enterprises to deliver superior results on their IT investments.

Governance is the foundation for all of the other portfolio mechanics, and without it, PPM doesn’t work. All benefits of project portfolio management hinge on the execution of portfolio governance. According to Howard A. Rubin, former executive vice president at Meta Group, “a good governance structure is central to making [PPM] work.” Furthermore, “Portfolio management without governance is an empty concept”. These quotes highlight the need for a well-defined and properly structured governance in order to manage the project portfolio.

Leadership is a critical component that brings the governance framework and the visionand goals of the organization together. Good leaders will develop the right goals and strategies for the organization. At the same time, good leaders will also develop the necessary governance infrastructure to make good decisions that will drive the execution of the strategy they have put in place. Moreover, good leaders will hold management accountable for following the governance process and will take ownership for achieving the organizational goals. In sum, leadership drives accountability.

Good governance processes enable better decision making but do not ensure it. The real decision makers on the portfolio governance board should be strong strategic leaders who make the right decisions at the right time. Portfolio management requires prioritization and trade-off decisions, which can be difficult tasks amidst strong politics and/or dynamic environments. True leaders will not compromise and accept mediocre results, even when that is the easiest path to take. Good strategic leaders will make difficult decisions (aka “the right decisions”) in the face of difficult circumstances. This is why leadership is needed in addition to governance for making better strategic decisions.

We can connect all of the components together now and see how they fit together. Good decision making requires having the right data at the right time, and it also requires strong leadership to utilize that data for making the best decision possible at any point in time. In order to have good data, organizational processes are required to collect the data and maintain it. Governance processes are also needed to ensure that the governance board operates efficiently and effectively. Even if there are good governance processes and place, and the roles and responsibilities are well understood, real leadership is needed to make difficult decisions that best utilize resources and accomplish company goals (even when not popular among all stakeholders). These decisions relate to the projects and programs in the portfolio that will execute strategy and meet company objectives. The simple portfolio management V-model helps tie together four critical components of PPM that lead to better decision making and result in greater strategic execution.

Portfolio Management V-Model Part 1

I recently constructed a portfolio management-oriented V-model. The traditional V-model has been used in software and product development, but this PPM variant differs in that the end result comes together at the point of the V. This is not an exhaustive list of PPM components, but does represent critical components and how they come together to drive better decision making resulting in optimal strategic execution. The model also makes a big assumption that the organization has sufficient strategy development capabilities in place.

Let’s work backwards (from the point back to the tips of the V) to understand how components on the left side supports the model.

 PPM V-Model

One of the primary goals (if not the foremost goal) of portfolio management is to execute strategy. There is an important distinction between strategy creation and strategic execution. Possessing a strategy (and spending the energy to create one) is meaningless if the organization cannot accomplish the strategic goals. Although many people acknowledge that strategic projects are vehicles for a accomplishing a strategy, senior leadership needs to make the right project decisions at the right time to advance the goals of the company. Hence, making smarter and better decisions is a precursor for solid strategic execution.

In order to make smarter and better decisions, the right data needs to be available at the right time. I have written about this in the past. Senior leaders should know what data is important and valuable for making the right decisions at the right time. Data collection costs money as does data analysis. Organizations should be mindful of the amount of effort needed to collect data and only collect data that is most important to the company. In another post, I wrote about a virtuous data cycle by which senior leaders need to actually use the data collected, communicate that the data is being used, and explain how the data is being used. This will encourage higher quality data collection resulting in better decision making. However, in order for the right data to be collected at the right time, processes need to be in place to facilitate the data collection process. Processes for work in-take, business case development, status updates, and resource management help provide the right data in the portfolio management lifecycle to promote better decision making.

The next post will explore the right side of the model and tie all the points together.

Using Gamification to Teach Portfolio Management Principles

This is a fun blog post with tips on using gamification to teach portfolio management principles (PPM). Portfolio management is not rocket science, but quickly conveying key concepts to people not familiar with project and portfolio management disciplines can be difficult. I learned this the hard way recently through my participation at two business competitions in Seattle. As I was working to come up with a simple message to explain portfolio management, I was reminded of a game I used to play in high school called Klax that actually contained many portfolio management principles. Klax is similar to many other puzzle games requiring players to connect multiple objects together of the same color. The basic game play involves colored tiles coming down a conveyor belt and the player needs to catch the tiles before they fall off and successfully drop them into a holding container (5 tiles by 5 tiles big) where points are scored by lining up at least three tiles in a row of the same color. The player can hold up to 5 tiles in order to better plan when and how to drop colored tiles into the bin.  When colored tiles are lined up, points are scored and the tiles disappearing clearing up more space to drop more tiles. A vertical stack of three tiles scores the least amount of points, horizontal connections score more, and diagonal connections score even more. Skilled players can connect 4 and 5 tiles together to score more points and lining up tiles to form an “X” scores a massive bonus. The game becomes more and more challenging as the number of colored tiles increases and come faster down the conveyor belt. The game ends when a player has missed too many falling tiles or fills the container bin (demo).

Connection to PPM

As you can probably guess by now, such a simple game has some interesting correlations to help teach portfolio management principles. Each tile could represent a project proposal and aligning three or more proposals of the same type (color) to organizational goals or strategies drives greater value to the organization. The holding bin itself could represent organizational resource capacity to complete project work. Each vertical section of the holding bin could represent a different business unit or customer. Some projects (vertical stacks) focus only on a single customer or business unit, whereas other projects (horizontal and diagonal connections) are developed for multiple business units. Clearly, these sets of projects are harder to complete when multiple stakeholders are involved and represent higher risk to the portfolio. Vertical stacks of 3 tiles are the easiest to complete but score the lowest amount of points. Higher scores are generated by lining up 4 and 5 tiles together, which requires more skill and planning to make those connections. Players need forethought of when and how to place the tiles in order to generate maximum points. Certain levels also have certain goals that need to be achieved before the player can advance to the next level. For example, the player may need to complete five diagonals before the level is over. Creating vertical and horizontal stacks may still earn points and may be needed to clear space in the bin but does not directly achieve the required goal.

Portfolio Management Principles

Here are a few of the portfolio management principles that are easily displayed through the game:

1) Governance: the paddle that catches the tiles could represent a governance board that needs to decide which projects to do and when to do them. If too much work is proposed (on the conveyor belt), the governance board loses control, and chaos ensues.

2) Value maximization: a governance board should not only focus on getting work done, but ensure that the right work gets done at the right time to generate greater value. In the game, a vertical stack of three tiles helps clear the board and generates a few points, but nowhere near the value of larger horizontal and diagonal stacks.

3) Organizational goals: just as the game has a goal to be achieved before a player can advance to the next level, so organizations have their own goals and it is important to realize that not all projects support the goals of the organization. Appropriate portfolio planning is needed to achieve organizational goals.

4) Portfolio Risk: larger horizontal and diagonal stacks are harder to achieve and could represent organizational risk. Trying to get too much work done at once (setting up multiple diagonals or horizontals) jeopardizes the entire organization and could result in nothing truly getting done unless adequate attention is paid to managing the portfolio risk.

5) Pipeline management: the conveyor belt represents the current pipeline of project proposals and the speed at which the tiles come down the conveyor belt is a significant factor for determining the difficulty level of the game. Likewise, ensuring that there is a steady flow of projects that are dispatched appropriately is a success factor for portfolio management.

Try out the game and let me know what you think and how well it applies to portfolio management principles. A newer version of the game can be found here, but is only available for Apple products.

Portfolio Planning vs Strategic Planning

Too often, the modus operandi for many organizations is to receive requests and filter them through a stage-gate process in order to evaluate the merit of the request and select the right projects. If the project is selected, a project team is assembled and the project planning begins. There is nothing wrong with this process, in fact, it is an important component of portfolio management.  The shortcoming relates to the lack of strategic planning and portfolio planning.

Strategic planning occurs once a strategic direction has been established within the organization. It is beyond the scope of this post to discuss how strategy is developed. Rather, our focus is on executing the strategy. The primary assumption is that strategies have been developed. From here, the senior leaders should be able to outline the major items they believe are necessary to accomplish or fulfill the strategy. These major items help define what the company intends to do on a larger scale (“the big whats”).  Going one step further, the senior leaders may have an idea of when these major items need to be initiated. With this information, a strategic roadmap can be built to lay out when major components of the strategies should be executed. This strategic roadmap is a critical component of strategic planning.  At this point, we are looking at strategic components from a 50,000 foot view. Few details may exist for each major component listed. If more information can be provided, all the better. The critical point is that the senior leaders outline some of the major items needed for the completion of the strategy.

Before the traditional portfolio management practitioners raise their arms in protest, I would point out that all of these projects will be reviewed like any other project and need to be prioritized. The creation of a strategic roadmap does not violate key PPM principles. Rather, the strategic roadmap aids the portfolio planning process by acknowledging major efforts that need to be undertaken. Without this view, it is all too easy for decision makers to approve projects (perhaps the right projects) at the wrong time. The creation of a strategic roadmap is a proactive step of leadership to better manage the portfolio. It is far easier to anticipate resource shortages when you can see all of the major efforts on the horizon. It is also easier to acknowledge the need for strong prioritization when key strategic projects compete for resources with smaller projects. The strategic roadmap is a key deliverable of the strategic planning process and is a major input for good portfolio planning.

Portfolio planning at a more tactical level helps senior leadership know when projects will get worked. Portfolio planning improves overall portfolio success by taking into account the limited resources (financial and human) and comparing this against known project dependencies in order to properly sequence projects. Strategic planning is proactive work that outlines the major components needed to accomplish strategic goals. Strategic planning will not account for the numerous small projects that get requested throughout the year (that’s the role of the portfolio management process).   Portfolio planning utilizes select information from all project requests (large and small) to sequence the projects (based on dependencies, resource constraints, and priorities) in a way that creates an ideal portfolio at a given point in time.

Portfolio Planning3

The chart above highlights three parallel steps of the planning process: strategic planning, portfolio planning, and project planning. Strategic planning often covers a 1-3 year planning horizon (or longer) and is generally longer than portfolio planning and project planning (except for large and/or complex projects).

The Simplicity Effect of PPM 2.0

“A fascinating trend is consuming Silicon Valley and beginning to eat away at rest of the world: the radical simplification of everything.”

PPM vendors would be wise to take notice of this article by Fast Company. Portfolio management is not rocket science, yet many of the software offerings on the market can be difficult to use. Unfortunately, very few of the vendors have a user experience in place that matches the current expectation of software. As this article points out, this leaves the door open for better vendors to come in. There were several noteworthy quotes which I will share below:

“Ultimately, any market that doesn’t have a leader in simplicity soon will”

“If you’re not the simplest solution, you’re the target of one”

“Any product with an interface that slows people down is ripe for extinction”

A related article by the NY Times, stated that design now rivals technology in importance. These articles highlight the shift that is taking place with technology and software. Merely having the best technology or the most functionality is no longer good enough; design is critical. More specifically, user experience is critical for new software going forward. Unfortunately, for the current portfolio management vendors, this means some expensive re-designs of existing systems.

User experience is a key component of PPM 2.0. Companies need solutions that are easy to use and will garner strong user adoption. I know from extensive first-hand experience with one of the “leaders” in the portfolio management space, that being a “leader” means nothing, delivering useful solutions means everything. Powerful solutions need to  be simple. Simplicity is important because without it, user adoption suffers and the benefits of portfolio management decline. Many of today’s “leaders” led the charge as part of PPM 1.0. However, with the emergence of cloud, mobile, and social, PPM 2.0 promises even more value with easier to use solutions.

Benefits Realization Summary

The purpose of validating benefits is to ensure that real value has been delivered from projects post-implementation as well as increase value from future projects when shortfalls have been identified in present projects. Although the business case promises to deliver a certain amount of value (in most cases), few companies take the time to ensure that real value gets delivered post-implementation. It requires real organizational discipline and rigor to do it well. The following three questions capture the full scope of benefits realization:

1. What benefits are we expecting in the future?

2. What benefits have we realized?

3. How do we ensure we realize full benefits on future projects?

Question one starts with the business case, specifically with cost-benefit analysis. There are no benefits to measure in the future if they don’t get captured before the project is fully initiated. Business case development is an important capability in portfolio management. Reasonably mature organizations will develop the capabilities of measuring anticipated benefits, often with the help of a senior business analyst. Unfortunately, some organizations are jaded when it comes to cost-benefit analysis and may not do it because of bad experiences in the past and the lack of accountability in the process. The purpose of tracking benefits is to help the organization ensure it gets the value it is expecting and to take action when the value is not realized.

Question two focuses on measuring the benefits after a project has closed down. The person accountable for delivering the project benefits (e.g. project sponsor) should use the same metrics documented in the business case to help track and validate the project benefits. In a mature organization, the effort to track benefits will resemble the effort at the start of the project to document expected benefits. The problem many companies face is that a gap often exists between the stated benefits and the actual benefits. This leads to question three.

Apparently, tracking benefits should be the end of the validation process. However, question three addresses the problem of gaps between anticipated and actual benefits. The scope of validating benefits is complete once gaps are addressed and resolved. This requires that the company take the time to analyze why the benefit gaps exist and to capture lessons learned that will be used by future project teams to do a better job of realizing benefits. This step completes the portfolio lifecycle of selecting the right projects, optimizing portfolio value, protecting portfolio value, and delivering portfolio value.

Virtually all of the benefit to a company comes after a project has been delivered. In order to increase the benefits realized from its projects, the organization should track the benefits that are actually received. According to Gaylord Wahl of Point B, such post-implementation evaluations can help improve business case development, which, in turn, increases the odds that the project portfolio will contain more winning projects going forward.