Chapter 1. Introduction – Our Emerging Foresight Field

The 80/20 and 95/5 Rules of Change 

Power law distribution. "Fat head" in green, "long tail" in yellow.

Power law distribution. Here the “fat head” is in green, and “long tail” in yellow.

Have you heard of the Pareto principle, also called the 80/20 rule? It is fundamental rule of foresight that all practitioners should understand. Complexity scholars know it by a more arcane title, the power law rule. Power laws describe the distributions of variables in many natural complex systems. In systems subject to power laws, 80% of the effects come from 20% of the causes (picture right)

For a few examples, 20% of the citizens in many capitalist economies usually have 80% of the wealth, 20% of cities have 80% of the population, 20% of the titles in the bookstore get 80% of the sales, and when we are solving problems, 20% of the effort (ideally, our highest priority actions) will often deliver 80% of the results we seek. This 20% is called the “fat head” of the power law. Conversely, the remaining 80% of the citizens, cities, books, and problem solving activities, while they hold the vast majority of diversity, contribute only 20% of the impact on many natural variables. This 80% is called the “long tail” of the power law.

As we’ll see later, this rule tells us a basic, universally common relationship between processes of evolution and development. From the perspective of natural selection, we can argue that the “fat head” in any power law-dependent community of actors has self-organized to deliver most of the community’s impact, and the “long tail” has self-organized to be a reservoir for most of the community’s diversity. Both impact and diversity are very important to being adaptive in a complex, unpredictable world. Both ends of the power law curve are very important to see and to cultivate, to be adaptive.

This rule is obviously very important for foresight. It challenges us look for power law relationships, and for that small number of actions and strategies that will generate the most impact. It also challenges us to be aware of, and to nurture, a wide range of more narrowly useful alternatives to our current actions and strategies, as any one of those could become the “fat head” tomorrow, if our competitive environment changes.

For more, Richard Koch’s books The 80/20 Principle (1999), Living the 80/20 Way (2004) and The 80/20 Manager (2013) offer great advice on using the 80/20 rule in life and management. Another good book on the use of power law strategy in marketing, focused on getting value from the 80%, is Chris Anderson’s The Long Tail (2006).

The 95/5 rule is another basic and universal relationship between processes of evolution and development. As I developed it myself in 2008, it is virtually unknown by comparison to the 80/20 rule, but I think it is no less important. The 95/5 rule describes the interaction between possible (unpredictable) and probable (predictable) processes in all living, natural systems, including our complex technologies, which are also becoming increasingly inspired by natural systems, as we will see.

In biological organisms, roughly 95% of our genes engage in unpredictable evolutionary recombination. Just like the long tail of the power law, these evolutionary genes pursue the chaotic creation of diversity, and the exploration of the possibility space of form and function. The remaining 5% of our genes (to a rough approximation in eukaryotes) are involved in predictable developmental conservation. Just like the fat head of the power law, these genes have self-organized in their environment for a special kind of predictable impact, that which advances the development of the organism.

We can observe this 95/5 rule, a 95%/5% evo/devo, bottom-up/top-down, divergent/convergent, unpredictable/predictable ratio, in a wide variety of complex systems in nature. Let’s look briefly at a few examples, to see the great breadth of operation of this apparently universal rule of change:

  • Genetic activity. A very small subset of our genetic material, roughly 5%, is ‘ultra-conserved’ across complex organisms like humans, mice, and rats, and central to the way those organisms converge, top-down, on a series of future-predictable states over their life cycles. For example, everything that happens predictably the same to identical twins over their lifetime is due to that very small and special set of developmental genes and processes, our ‘developmental (or ‘evo-devo’) genetic toolkit.’ But the vast majority of genes in living organisms, the other 95%, are constantly changing, and work in a bottom-up fashion to allow each organism to be different from the next, in unpredictable ways, from both its neighbors and all the organisms before it. See my article Evo Devo Universe? (2008) for details.
  • Intelligence. Levin and Yuste, in “Modular Cognition,” (Aeon, 2022), consider all intelligence itself from this perspective. In a lovely article that considers the evo-devo intelligence in a single cell, they describe intelligence as a network process in which pattern completion, by a few actors (the 5%), activates an entire circuit of interdependent actors (biochemical networks, gene-protein regulatory networks, neural networks). Modular hierarchies of such circuits, built bottom up, under replication, variation, and selection, keep the entire system within predictable developmental parameters. Contingencies of expression still abound, for organisms living in a stochastic world (the 95%) but these networks guide complex systems to an expanding set of predictable adaptive responses.
  • Human thinking. Leonard Mlodinow describes a 95/5 ratio in Subliminal (2013) when he explains that the vast majority (perhaps 95%) of human thinking is bottom-up, creative, and unpredictable, driven by our unconscious synaptic networks. Only a critical subset (let’s guess, 5%) of human thinking is top-down, optimization oriented, and conscious. Psychologists measure this “conscious” or “deliberate” time in minutes out of a typical day, versus hours we spend in largely unconscious, bottom-up, and locally-driven behaviors.
  • Organizational dynamics. Kevin Kelly describes the 95/5 rule in Out of Control (1994) when he explains that the vast majority of decisions made in organizations (again, say 95%?), even in highly hierarchical ones like the military, happen in bottom-up, creative ways, based on the initiative and judgment of individual actors. Leaders try to set up fair and useful top-down rules and directives (the 5%), but the time and energy people in most organizations spend paying attention to those directives, versus making their own bottom-up decisions, is likely as short as the conscious vs unconscious thinking we do in a typical day.
  • Ideas for change. Robinson and Schroeder, in The Idea-Driven Organization (2014) show that the great majority of ideas for change also flow from the bottom-up, from employees, stakeholders, and customers to upper management, rather than vice versa. Whether those ideas are listened to or not is another matter.
  • Social processes are subject to the 95/5 rule as well. If most social processes are 95% evolutionary and only 5% developmental to a first approximation, this helps us understand why it is so easy to see creative and unpredictable evolutionary “noise” around us, and so hard to see convergent and predictable developmental “signal”Some scholars make the classic mistake of concluding that all social change is bottom-up, random and unpredictable. But as we will see later, the 5% of developmental processes in any complex system, few as they are, are at least as important as the 95% of evolutionary processes in shaping the future, in living systems, social systems, and the universe as a system. Even though they are in a small minority, developmental processes have a huge influence on the futures of biological organisms.

In a nutshell, the 95/5 rule tells us that the vast majority of change in any replicating complex system is evolutionary and unpredictable, but a critical subset is just the opposite, developmental and predictable. In living systems, both processes of change are equally important to adaptation. Developmental processes, though they are rarer and harder to see, are just as important as evolutionary processes to an organism’s survival.

If our organizations, societies, and our most advanced technologies are also complex adaptive systems undergoing some form of natural selection, as we argue in Chapter 11, they too are driven by both unpredictable, bottom-up, and predictable, top-down processes of change. If we live in such an “evo devo universe”, we will need to see and manage both processes better if we are to do good foresight work.

Consider the 95/5 rule’s implications for organizations. In adaptive organizations, only a critical subset, something like 5%, of organizational activities are driven by top-down commands and constraints, the initiatives and rulesets provided by leaders. The vast majority of change always happens instead in local, bottom-up contexts, subject to individual choice and initiative. This fact of nature is why overcontrolling an organization from the top quickly becomes a recipe for employee disengagement, inflexibility, and predatory power politics in top management. At the same time, a lack of critical frameworks and rulesets at the top is a recipe for anarchy and lack of direction.

Maintaining well-designed incentives, norms, processes and policy may be only 5% of the job of management, but getting that 5% right is very important for preventing organizational dysfunction. There’s a great rule, Hanlon’s razor, which says “Never attribute to malice that which can be explained by stupidity.” The risk manager Douglas Hubbard offers Hanlon’s corrollary: “Never attribute to malice or stupidity that which can be explained by moderately rational individuals following misaligned incentives, norms, processes or policy in a complex system.” Amen! Organizational behavior experts tell us that systemic bias in our top-down rulesets is the root cause of many of our social, organizational, and team problems.

Frederic Laloux’s Reinventing Organizations (2014) is book that recognizes primarily bottom-up controlled, people-centric organizational structures work more like biological systems, and that these are usually more adaptive in more environments than are top-heavy hierarchies, which work best only when control, not innovative diversity, is the overriding concern. Laszlo Bock’s Work Rules! (2016) also takes this perspective. It describes Google’s experience with objectives and key results (OKRs), a largely bottom-up form of people management in which individual employees determine their own objectives (to some degree) and key results to be measured against in achieving those objectives (to a much larger degree), and those OKRs roll-up to their managers, rather than having performance standards set in a mostly top-down manner, as in traditional organizations.

In a slow-moving environment, a manager’s top-down regulations and control initiatives can grow easily grow past the 5% that is most adaptive, most of the time. But as John Kotter argues in Accelerate (2014), as the pace of change quickens, the performance cost of maintaining large top-down hierarchies keeps growing, until that hierarchy threatens firm survival, and is shattered into more bottom-up networks, either by internal reform, or more commonly, by competition, the marketplace, bankruptcy, merger, and downsizing of the too-top-heavy firm.

Knowing the 95/5 rule, and seeing it at work in human and other systems, is a great aid to foresight. Throughout this Guide, and in our chapter on evo devo foresight, we will argue that just as important as seeing our evolutionary opportunities, risks, options, and alternative futures is understanding and taking advantage of the small subset of social processes that are top-down, optimizing, convergent and highly probable, our developmental futures. Both the possible and the probable, the “evo” and the “devo”, appear equally important to life, to society, and to the universe itself.

As it says in the subtitle, this Guide will help you become a better leader in Predicting (anticipating, seeing probable futures), Creating (exploring possible futures) and Leading (steering toward preferable futures) change. As we will see, correctly anticipating that 5% of predictable trends, processes, and future destinations is the foundation of good foresight. The more thinking you and your team do about relevant high-probability trends, the more predictable future outcomes you will also discover. Those trends and outcomes will usefully constrain, guide, and empower all your other foresight activities.

Showing 5 comments
  • Tony Castle
    Reply

    The following sentence is used twice:
    “Everything that happens predictably the same to identical twins over their lifetime is due to that very small and special set of developmental genes and processes.”

    Great resource.

    • Kevin Russell
      Reply

      Fixed, Thank you:)

  • Oleksiy Teselkin
    Reply

    As a biologist-turned-foresighter, I like the way the 95-5 rule is worded here in application to evolution and individual development. Indeed, the 95% of the highly variable DNA, previously dubbed ‘junk’ one, is, in fact, what makes the remaining 5% possible and so miraculously ‘fit’ to the environment. I also believe that the phrases “evolutionary recombination” and “developmental conservation” are very good descriptors. Chaotic recombination of everything with everything, “to explore of the possibility space of form and function,” does away, however, with any “trees” on the geological scale, such as the one referenced in the Fig. 17 of the above-referenced Author’s older publication, Smart, John M. 2008-13. Evo Devo Universe? A Framework for Speculations on Cosmic Culture. In: Cosmos and Culture: Cultural Evolution in a Cosmic Context, Steven J. Dick, Mark L. Lupisella (eds.) There is so much overflow of genetic information between different branches that “trees” quickly become unrecognizable for anyone not trying to find one. We get more evidence for the scale of these horizontal processes with every passing year.

  • Ibrahim
    Reply

    In the following sentence, the color coding of probable (should be blue) & possible (should be green) is swapped and should be reversed:

    The 95/5 rule describes the interaction between possible (unpredictable) and probable (predictable) processes in all living, natural systems, including our complex technologies, which are also becoming increasingly inspired by natural systems, as we will see.

    • John Smart
      Reply

      Thanks Ibrahim! Made the fix. Warm regards, John

Leave a Comment

Contact Us

We're not around right now. But you can send us an email and we'll get back to you, asap.

Table of Contents

guideintrobookwhite

Chapter 2. Personal Foresight – Becoming an Effective Self-Leader

Chapter 2: Personal Foresight

Becoming an Effective Self-Leader

Chapter 4. Models – Foundations for Organizational Foresight

Chapter 4: Models

Foundations for Organizational Foresight

Chapter 7. Acceleration – Guiding Our Extraordinary Future

Chapter 7: Acceleration

Guiding Our Extraordinary Future (In Process)

II. Global Progress: 5 Goals, 10 Values, Many Trends

Innovation: Our Abundant Future
Intelligence: Our Augmented Future
Interdependence: Our Civil Future
Immunity: Our Protected Future
Sustainability: Our Rebalanced Future

III. Universal Accelerating Change

Great Race to Inner Space: Our Surprising Future
Entropy&Information: We’re Running Down & Up
The Puzzle of Meaning: We Have No Einstein Yet
Trees, Funnels & Landscapes: Intro to Evo Devo
Big Picture Change: Five Scales of Accelerating ED
Transcension Hypothesis: Where Acceleratn Ends?
IDABDAK: Social Response to Accel & Developmnt
We’re On a Runaway Train: Being Accelaware

IV. Evo Devo and Exponential Foresight

Seeing It All: Accel., Diverg, Adapt, Convrg, Decel.
Natural (I4S) Innovation: The Evolutionary Drive
Natural (I4S) Intelligence: The Human-AI Partnership
Natural (I4S) Morality: Why Empathy and Ethics Rule
Natural (I4S) Security: Strength from Disruption
Natural (I4S) Sustainability: The Developmental Drive
S-Curves: Managing the Four Constituencies
Pain to Gain: Traversing the Three Kuznets Phases
Hype to Reality: Beyond Hype Cycles to Reality Checks
Exponentials Database: Measuring Accelerations
TINA Trends: Societal Evolutionary Development
Managing Change: STEEPCOP Events, Probs, Ideas
A Great Shift: A Survival to a Sentient Economy

V. Evo Devo and Exponential Activism

Building Protopias: Five Goals of Social Progress
Normative Foresight: Ten Values of Society
Top & STEEPCOP Acceleratns: Positive & Negative
Dystopias, Risks, and Failure States
Three Levels of Activism: People, Tech & Universe
A Great Opportunity: Exponential Empowerment

 

Chapter 8. Your Digital Self – The Human Face of the Coming Singularity

Chapter 8: Your Digital Self

The Human Face of the Coming Singularity (In Process)

I. Your Personal AI (PAI): Your Digital Self

Digital Society: Data, Mediation, and Agents
Personal AIs: Advancing the Five Goals
PAI Innovation: Abundance and Diversity
PAI Intelligence: Bio-Inspired AI
PAI Morality: Selection and Groupnets
PAI Security: Safe Learning Agents
PAI Sustainability: Science and Balance
The Human Face of the Coming Singularity

II. PAI Protopias & Dystopias in 8 Domains

1. Personal Agents: News, Ent., Education
2. Social Agents: Relat. and Social Justice
3. Political Agents :  Activism & Represent.
4. Economic Agents:  Retail, Finance, Entrep
5. Builder Agents :  Work, Innov. & Science
6. Environ. Agents : Pop. and Sustainability
7. Health Agents :  Health, Wellness, Death
8. Security Agents :  Def., Crime, Corrections

III. PAI Activism & Exponential Empowerment

Next Government: PAIs, Groupnets, Democ.
Next Economy: Creat. Destr. & Basic Income
Next Society: PAI Ent., Mortality & Uploading
What Will Your PAI Contribution Be?

Chapter 10. Startup Ideas – Great Product & Service Challenges for Entrepreneurs

Chapter 10: Startup Ideas

Great Product and Service Challenges for Entrepreneurs (In Process)

I. 4U’s Idea Hub: Building Better Futures

Air Deliveries and Air Taxis: Finally Solving Urban Gridlock
Ballistic Shields and Gun Control: Protecting Us All from Lone Shooters
Bioinspiration Wiki: Biomimetics and Bio-Inspired Design
Brain Preservation Services: Memory and Mortality Redefined
Carcams: Document Thieves, Bad Driving, and Bad Behavior
Competition in Govt Services: Less Corruption, More Innovation
Computer Adaptive Education (CAE): Better Learning and Training
Conversational Deep Learning Devsuites: Millions of AI Coders
Digital Tables: Telepresence, Games, Entertainment & Education
Dynaships: Sustainable Low-Speed Cargo Shipping
Electromagnetic Suspension: Nausea-Free Working & Reading in Cars
Epigenetic Health Tests: Cellular Aging, Bad Diet, Body Abuse Feedback
Fireline Explosives and Ember Drones: Next-Gen Fire Control
Global English: Empowering the Next Generation of Global Youth
Greenbots: Drone Seeders and Robotic Waterers for Mass Regreening
High-Density Housing and Zoning: Making Our Cities Affordable Again
Highway Enclosures and Trail Networks: Green and Quiet Urban Space
Inflatable Packaging: Faster and Greener Shipping and Returns
Internet of Families: Connecting People Over Things
Kidcams: Next-Gen Security for Child Safety and Empowerment
Kidpods: Indoor & Outdoor Parent-Assistive Toyboxes
Microdesalination: Democratizing Sustainable Fresh Water Production
Noise Monitors: Documenting and Reducing Noise Pollution
Oceanside Baths: Sustainable Year Round Beach Enjoyment
Open Blood Scanners: DIY Citizen Health Care Sensor Tech
Open Streaming Radio: User-Centered Audio Creation and Rating
Open Streaming Video: User-Centered Video Creation and Rating
Open Values Filters: Social Rankers, Arg. Mappers, and Consensus Finders
Personal AIs: Your Private Advisor, Activist, and Interface to the World
Pet Empowerment: Next-Gen Rights and Abilities for Our Domestic Animals
Safe Closets: Fire-, Earthquake-, and Intruder-Proof Retreat Spaces
Safe Cars: Reducing Our Insane 1.3M Annual Auto Deaths Today
Safe Motorcycles: Lane Splitting in Gridlock Without Risk of Death
Shared Value Insurance: User-Centered Risk Reduction Services
Sleeperbuses and Microhotels: Demonetized Intercity Travel
Space-Based Solar Power: Stratellite Powering and Weather Management
Stratellites: Next-Gen Urban Broadband, Transparency, and Security
Touch DNA: Next-Gen Home Security and Crime Deterrence
View Towers: Improving Urban Walkability, Inspiration, and Community

Chapter 11. Evo Devo Foresight – Unpredictable and Predictable Futures

Chapter 11: Evo Devo Foresight

Unpredictable and Predictable Futures

Appendix 1. Peer Advice – Building a Successful Foresight Practice