Friday, September 29, 2023

The place where we feel we belong

The so-called "Age of Enlightenment" was an intellectual and cultural movement in the 18th century that emphasized reason over superstition and science over blind faith.  One of the leading intellectuals during this period was the English scientist Isaac Newton, who introduced his three laws of motion which explained how the whole universe operated.  Scientists coming after Newton believed that his laws applied everywhere in the universe and provided a framework by which the natural world could be easily understood and future events predicted.  The universe was simple, machine-like, predictable, and controllable, and events occurred like clockwork.  All of the events that occurred throughout time and throughout the universe could be reduced to a set of mathematical equations.

Newton's metaphor of a clockwork universe became the template for all the other thinkers in the Age of Enlightenment and through the Industrial Age, including Sigmund Freud in psychology, August Compte in sociology, John Locke and John Stuart Mill in political philosophy, and Frederick Winslow Taylor in management.  Taylor published his book, The Principles of Scientific Management in which he proposed an approach to management based upon scientific and mathematical principles that were designed to increase worker productivity.  However, the 20th century ushered in a new era, with Einstein's theory of relativity, Schrödinger's cat, Heisenberg's uncertainty principle, and the science of quantum physics.  These discoveries were followed soon after by chaos theory and complexity theory.  While Taylor's book remains a classic text in management, his scientific management principles, largely based upon Newton's conception of the clockwork universe, may no longer be appropriate in our world of complexity science and quantum physics.  As our notion of the clockwork universe changed, so too did the ways we approached leadership and management.

I still believe there is a role for the Frederick Winslow Taylor and the scientific principles of management in organizations today.  However, as I've posted recently (see in particular, "Connecting the dots" and "Tame the chaos" which discuss the Stacey Matrix and Grint's Wicked Problem framework, respectively), our leadership approach should be dictated by the complexity of the task or problem at hand.  Today I want to focus on one last framework called the Cynefin Framework, which was developed in 1999 by David Snowden when he was working for IBM.

The word cynefin is a Welsh word (pronounced "ku-nev-in") that literally translates to habitat or place.  More specifically, it can be defined as the place where we feel we belong, where the people and landscape around us are familiar, and the sights and sounds are reassuringly recognizable.  The idea of the Cynefin Framework is that it offers leaders a "sense of place" from which to view their perceptions of the world around them.  Snowden described the five domains of the framework in an article published in the journal IBM Systems Journal in 2003 ("The new dynamics of strategy: Sense-making in a complex and complicated world") and in an article in Harvard Business Review in 2007 ("A leader's framework for decisionmaking").  The framework is shown below:

















The framework proceeds in a counter-clockwise manner in which problems are categorized as clear (also known as simple in earlier versions), complicated, complex, chaotic, or confusion.  If you've been reading my last few posts, you will undoubtedly note that there is significant overlap between the Stacey Matrix, Grint's Wicked Problem framework, and the Cynefin Framework.  The first four domains in the Cynefin Framework require leaders to appropriately recognize and diagnose the problem and respond as contextually appropriate.  The fifth domain (confusion) applies when leaders are unable to categorize the problem into one of the first four domains.

Clear Problem - Best Practice

Clear problems are analogous to Stacey's simple problems and Grint's tame problems.  Using the infamous Rumsfeld Matrix, clear problems are "known knowns."  In other words, these problems are clear, linear, cause-and-effect relationships, and the right solutions are generally well-known and undisputed.  Here, the leader's role is to sense, categorize, and respond, often using a standardized approach that is commonly accepted and considered "best practice."

Complicated Problem - Good Practice

Complicated problems are analogous to Stacey's complicated problems (of course) and are still within the domain of Grint's tame problems.  They are complicated because there may be several correct solutions to the problem.  Moreover, while these problems are usually linear and cause-and-effect in nature, not everyone can clearly see that is the case.  There are the "known unknowns" of the Rumsfeld Matrix, and the leader's role here is to sense, analyze, and respond and apply good practice, not best practice.  In other words, there is usually not a widely accepted, standardized best practice here, because multiple approaches have been used to successfully solve the problem in the past.

Complex Problem - Emergent Practice

Complex problems are analogous to Stacey's complex problems and Grint's wicked problems.  We've crossed over into the domain of complexity science and complex adaptive systems and the world of "unknown unknowns" of the Rumsfeld Matrix.  Here the leader's role is to probe, sense, and respond.  Instead of attempting to impose a "tried and true" course of action, leaders should be patient and allow the path forward to reveal itself, i.e. emergent practice.  

Chaotic Problem - Novel Practice

Chaotic problems are analogous to Stacey's chaos, and they probably fall into Grint's crisis domain.  These problems are "unknowable" (a term not used in the Rumsfeld Matrix).  Here the leader's role is to act to establish some semblance of order, then sense where stability is present, and respond by working to transform the situation from chaos back to complexity (act, sense, and respond).  These kinds of problems are generally those that the leader (or anyone else for that matter) have not encountered in the past, and so they require solutions that have never been tried before (i.e. novel practice).

Snowden provided a great "leader's guide" in the Harvard Business Review article "A leader's framework for decisionmaking".  The American author F. Scott Fitzgerald reportedly once said, "The test of intelligence is the ability to hold two opposed ideas in the mind at the same time and still retain the ability to function."  In regards to my last three posts, perhaps it is fair to say that, "The test of leadership is the ability to apply the right style of leadership to the problem at hand."

Wednesday, September 27, 2023

Tame the Chaos?

Hopefully I am starting to convince you that leaders working in organizations today should adopt and modify their leadership and management (i.e. decision-making and level of control) to the particular nuances and context of the situation at hand.  Last time I presented the Stacey Matrix as a framework for leaders to do just that.  I also mentioned Keith Grint's Critical - Tame - Wicked framework, which is very similar in concept to the Stacey Matrix.  I've posted about Keith Grint and wicked problems several times in the past (see, in particular, "What style of leadership works best? It depends on the problem at hand..." but also "Murphy's Law, the U.S. Navy SEALs, and High Reliability Organizations", "Wicked", and "...like a stand of trees").

Grint writes, "Much of the writing in the field of leadership research is grounded in a typology that distinguishes between Leadership and Management as different forms of authority...with leadership tending to embody longer time periods, a more strategic perspective, and a requirement to resolve novel problems."  Well that is certainly the classic distinction between leadership and management, at least in most of the literature that I've read, but I want to dig a little deeper into this distinction.  Perhaps Ralph Stacey was right - the application of leadership versus management should depend upon the type of problem at hand.  The classic tools of scientific management may work for the simple problems that organizations encounter, but we unfortunately live in a VUCAT world and our problems are never quite that simple.

Grint further writes, "Another way to put this is that the division is rooted partly in the context: management is the equivalent of déjà vu (seen this before), whereas leadership is the equivalent of vu dàjé (never seen this before)."  He continues, "If this is valid then the manager is required to engage the requisite process to resolve the problem the last time it emerged. In contrast, the leader is required to facilitate the construction of an innovative response to the novel problem, rather than rolling out a known process to a previously experienced problem."  Here is where his Critical - Tame - Wicked framework comes into play:












Again, the framework follows the classic 2x2 matrix with the degree of uncertainty on the vertical axis and the need for collaboration and/or compliance on the horizontal axis.  Rather than the classifying problems as simple, complicated, complex, or chaotic as in the Stacey Matrix, Grint uses the terms critical, tame, and wicked, depending on where on this 2x2 matrix the problem falls.

Tame problems are analagous to Stacey's simple and complicated problems (but really, how many problems in our VUCAT world are truly simple?).  They are those problems that, while complicated have probably occurred before.  The solution to Tame problems is fairly straightforward.  Here, Management probably works best.  

Wicked problems, analagous to Stacey's complex problems, have probably never occurred before.  The solution to Wicked problems aren't readily apparent, and they may be as complicated and complex as the problem itself.  Here, the Leadership style that leverages the expertise of the group ("deference to expertise") fits the best.

The last category is most similar to Stacey's chaos, which organizations should try to avoid at all costs.  When you think of Critical problems, think of a crisis.  The world is falling apart all around you, everyone is looking to you to tell them what to do.  In other words, with Critical problems, Command is the best approach.

So what is exactly the difference between wicked problems and tame ones?  I've alluded to some of the differences between these two types of problems above.  Let's look at the problem of climate change - is there a straightforward solution here?  Not really.  Are we able to apply some of the lessons we've learned in the past?  Probably not.  If the solution was readily available and straightforward, we would've probably done so by now.  So climate change is really a wicked problem.  In this same vein, increasing the utilization of renewable energy sources such as solar and wind would be a tame problem.  Make sense?


1. They do not have a definite formulation.

2. They do not have a "stopping rule" (i.e., there is no way to tell for sure when you've reached a solution).

3. There is no way to test the solution to the problem - trial and error approaches will not work (sounds a lot like what High Reliability Organizations have to contend with, right?).

4. There is no real end to the number of approaches or solutions that can be attempted.

5. Every problem is unique and has probably never been dealt with before.

6. They can always be described as a symptom of another problem (e.g., climate change is a symptom of global warming, etc).

Next time, I want to introduce one last framework for describing problems, the Cynefin Framework, and then I will hopefully tie all of these last several posts together in a nice package!

Monday, September 25, 2023

Connecting the dots...

The last several posts have included topics on complex adaptive systems ("The myth of the ant-queen"), network science ("Six degree of Kevin Bacon"), small world networks ("It's a small world after all..."), self-managed teams ("A flock of starlings"), teal organizations ("Today's color is teal...").  I wanted to take a brief moment and try to connect all of the dots here, as I was being very intentional in how I sequenced this series of posts.  

It's seems a little strange (at least it did to me) that a blog on leadership would focus on self-managed teams, which sound a lot like leaderless teams.  I promise that there has been a method to my madness!  I still feel that leadership (good leadership anyway, because I do think there is such a thing as bad leadership) is critically important to the success of any organization (see my last post, "Any old map will do...").  My two main points are (1) we live in a complex world (it's a VUCAT world) and (2) our complex world requires a different type of leadership.

I recently started reading a book (it's an older one, but I still find it relevant) by the British organizational theorist Ralph Stacey entitled Managing the Unknowable: Strategic Boundaries Between Order and Chaos in Organizations.  Stacey was one of the first to apply the disciplines of chaos theory and complexity science to organizations and argued that organizations are complex adaptive systems.  Recall that complex adaptive systems consist of (1) systems made up of many individual parts or agents that (2) interact with each other and follow simple rules that lead to the emergence ("the whole becomes greater than the sum of the individual parts") of complex behaviors that occurs (3) in the absence of any centralized leader who is coordinating the interactions of the individual parts or agents.  Stacey further argued that because organizations are complex adaptive systems, leaders could rarely forecast or predict all of the consequences of their actions (i.e. their strategy and tactics).  As such, management is not always the rational, analytic, and scientific decision-making process as outlined by individuals like Frederick Winslow Taylor (see The Principles of Scientific Management).  Instead, leaders within complex adaptive systems should adopt and modify their leadership and management (i.e. decision-making and level of control) to the particular nuances and context of the situation at hand.

Stacey created a diagram of contingency leadership that is now called the "Stacey Matrix" (apparently he regretted creating it).  It's a classic 2x2 matrix, with the "degree of certainty" on the horizontal axis and "level of agreement" on the vertical axis:



















Degree of Certainty

Problems, issues, or decisions are close to certainty when a strong cause-and-effect relationship can be established or if a similar problem or issue has been addressed in the past.  In other words, leaders can easily extrapolate from their past experience to predict the outcomes of an action or decision with a high level of confidence.  Conversely, when problems, issues, or decisions are new and unique, extrapolating from past experience may not be possible, hence the proper course of action is far from certain.  

Level of Agreement

If the group or team has come to a consensus about a problem, issue, or decision, then the group is close to agreement.  Conversely, when consensus cannot be achieved, the group is far from agreement.

The figure above is slightly different than the typical 2x2 matrix, which forms four distinct quadrants (albeit with some overlap at the margins).  There are still four zones, but they are more dynamic and fluid than the usual four quadrants.  What is valuable with the Stacey Matrix is that it provides a way for leaders to select the appropriate management action in a complex adaptive system, based on the degree of certainty and level of agreement on the problem or issue in question:

Simple problems are those in which there is a high degree issues or problems are usually amenable to Taylor's scientific principles of management.  The goal is to repeat what has worked in the past and monitor the efficiency and effectiveness of the tried-and-true approach. 

Complicated problems can involve those in which there may be a high level of certainty / low level of agreement or low level of certainty / high level of agreement.  The former requires coalition building, negotiation, and compromise in order to reach consensus on how the problem will be solved.  Focusing on a shared mission and vision (remember there is a high level of agreement) will help the team to move to an agreed upon future state, even if the specific path to get there cannot be determined in advance.

Complex problems exist in what is often referred to as the "edge of chaos" (Stacey himself called this area the "zone of complexity").  The traditional leadership and management approaches will not work here.  Complex problems require creativity, innovation, and breaking with the past.  

Chaos (also known as "Anarchy" in some versions of the Stacey Matrix) is characterized by very high levels of disagreement and uncertainty.  Organizations should try to avoid chaos, if at all possible.

The Stacey Matrix is often compared to two other models called the Cynefin Framework (pronounced coon-a-fin) and Keith Grint's Wicked, Tame, Crisis Framework (the one I prefer the most).  Regardless of which framework that is used, all three suggest that the same leadership and management approach can't be used to solve every problem that an organization faces.  Instead, the best approach is to use the best leadership and management approach for the specific problem at hand.  And here is where self-managed teams (and similar concepts that I will cover soon) and "deference to expertise" assume critical importance.

Saturday, September 23, 2023

"Any old map will do..."

There's a famous story, likely apocryphal (more on that below) of a group of Hungarian soldiers who were sent on a scouting mission in the Alps during World War I.  They were caught in a heavy snowfall and quickly became lost.  After they failed to return to base after several days, their captain assumed that they had all perished in the mountains.  One day, they showed up unexpectedly back at the base.  The captain asked what had happened, and one of the sergeants replied:

"We were lost in the snowstorm and started running low on food and water.  We had given up hope and resigned ourselves to die. Then one of the men found an old, crumpled and tattered map in his pocket. With its help we knew we could find our way back. We made camp, waited for the snow to stop, and then as soon as we could travel, we found our way back to base."

The captain nodded and replied, "Show me your map."  When the captain unfolded the map, he discovered that it wasn't a map of the Alps.  It was a map of the Pyrenees!  

The old, crumpled and tattered map of the Pyrenees proved valuable because it represented hope.  Rather than waiting until they froze to death in the mountains, the soldiers now had something believable and tangible to follow. The map of random mountains and valleys had, fortuitously, pointed the way towards home.

The story of the lost Hungarian stories has a rather interesting backstory.  As I mentioned in the first sentence of this post, I'm not even sure that it is true.  I've read versions where the story takes place during World War I and others where it takes place during World War II.  The story has always involved Hungarian stories though, perhaps because it was first told by the Hungarian physician-scientist, Albert Szent-Györgyi whose medical studies were interrupted by World War I (notably, Szent-Györgyi was awarded the 1937 Nobel Prize in Medicine for his discovery of vitamin C).  Szent-Györgyi told this story several times over the years to different individuals, including to the Czech immunologist and physician Miroslav Holub.  Holub was also an accomplished poet and wrote a poem about the Hungarian stories, called "Brief Thoughts on Maps" in 1977:

Albert Szent-Györgyi, who knew a lot about maps
according to which life is on its way somewhere or other,
told us this story from the war
due to which history is on its way somewhere or other;

The young lieutenant of a small Hungarian detachment in the Alps
sent a reconnaissance unit out onto the icy wasteland.
It began to snow
immediately, snowed for two days and the unit
did not return.  The lieutenant suffered: he had dispatched
his own people to death.

But the third day the unit came back.
Where had they been? How had they made their way?
Yes, they said, we considered ourselves
lost and waited for the end. And then one of us
found a map in his pocket. That calmed us down.
We pitched camp, lasted out the snowstorm and then with the map
we discovered our bearings.
And here we are.

The lieutenant borrowed this remarkable map
and had a good look at it. It was not a map of the Alps
but of the Pyrenees.

Goodbye now.

Apparently, the organizational psychologist (and one of the leading investigators on high reliability organizations, HROs), Karl Weick heard this story and used it routinely in his writings and lectures.  Weick often ended his retelling of the story with, "The moral of the story - when you are lost, any old map will do." Unfortunately, he apparently didn't credit Holub or Szent-Györgyi and claimed the story was a true one (and occurred in Switzerland), leading to claims of plagiarism, which Weick vehemently denied.  Regardless, the lessons here are important, especially given the topic I've been discussing in the last several posts.

I've introduced and talked about the concept of self-managed teams and self-organizing teams, particularly as they relate to complex adaptive systems.  While not every organization has completely adopted self-managed teams (Morning Star, a tomato processing company - see the HBR article "First, Let's Fire All the Managers!" and Zappos - see the HBR article, "Beyond the Holocracy Hype" are at least two) or the concept of Teal Organizations, several companies are starting to flatten the traditional hierarchical org chart and adopting methods like Agile, which emphasize self-managed teams and self-organizing teams.  The logical question, then, in these new organizational structures, what, if any, role does a leader play?  Here is where the story of the Hungarian soldiers becomes important.  Just like the tattered and crumpled old map of the Pyrenees, leaders "show the way."

Let me be clear - it would not be right to say that "any old map will do" if we are using the word map in this context as a metaphor for leadership!  Leadership still matters, even in the world of Teal, Agile, flattened hierarchies, and self-managed teams.  Whether that leadership comes from an individual at the top or from amidst the team itself doesn't matter as much, as long as someone is "showing the way".  Here is a summary of the key differences in leadership within a hierarchical organization versus a self-managed team:






When I think about self-managed teams, I am reminded of the Navy SEALS, who emphasize decentralized leadership, the U.S. Army Rangers motto Sua Sponte, the U.S. military doctrine of "commander's intent", the German Wehrmacht doctrine of "Auftragstaktik", and of course the High Reliability Organization principle of "Deference to Expertise".  The message is not lost on me (and I hope it's not lost on you either) that all of the aforementioned examples come from military organizations, who are traditionally considered very hierarchical.  Perhaps not.  If the military is moving more towards decentralized leadership and "deference to expertise", why aren't other organizations doing so?

Thursday, September 21, 2023

Today's color is Teal...

Towards the end of my last post, I referenced a concept known as Teal organizations.  I wanted to take a moment to explain this concept further.  Teal is a greenish blue color (as opposed to turquoise, which is a bluish green color).  The name apparently comes from a species of duck called the Eurasian teal (Anas crecca) that has a teal-colored stripe on its head.  Teal was quite popular as a color in the 1990's, with several sports teams - including the Miami Marlins of MLB, the Jacksonville Jaguars of the NFL, the San Jose Sharks of the NHL, and the Charlotte Hornets of the NBA - adopting the color for their uniforms during this period.  I have to be 100% honest though, I'm not sure I could tell the difference between the colors teal, turquoise, and aqua.  Regardless, the management consultant Frederic Laloux uses the color teal to describe organizations that have adopted self-managed teams.  

Laloux wrote a book called Reinventing Organizations (for a shortened version, see his article "The Future of Management is Teal" in Strategy + Business) in which he described different types of organizations using a color scheme developed by the social psychologist Ken Wilber.  Wilber's integral theory of consciousness claims that humans have different levels of consciousness, each of which have a different associated color.  Laloux argues that just as human consciousness evolved in stages, organizations evolved at the same time and to a similar degree as well (as shown in the Figure below).  Each stage of development, denoted by a color, correlates to a particular time in human evolutionary history when these levels of consciousness, and the respective stage of organizational development, were prevalent.











Laloux claims that over the course of human history, there have been at least five distinct organizational paradigms.  Teal organizations are the latest developing paradigm and are based on worker autonomy, self-management, and flattened hierarchical structures (if hierarchy exists at all).  Red, Amber, Orange, and Green organizations, on the other hand, are based on hierarchy and meritocracy.  It's an interesting theory, and given the topic I've been discussing with the last few posts, it's probably worth discussing in a little more detail.

Laloux starts over 10,000 years ago, when humans first shifted away from small bands or tribes to form proto-empires.  These early "organizations", which Laloux labels Red organizations (he also uses the metaphor "wolf pack"), were based upon the division of labor and command authority with little in the way of hierarchical structure aside from a sole leader at the top who had power over the rest of the organization.  These organizations remained successful as long as the leader was able to exercise power over the rest of its members, similar to the alpha wolf in a pack.

Starting around 4000 BC in Mesopotamia, Amber organizations (he also uses the metaphor "army") became the most prevalent type of organization, which are the classic pyramid-shaped hierarchical, process-driven, command-control organizations.  Formal roles were clearly defined and allowed organizations to scale up in size.  Workers at the bottom of the pyramid had be told what to do and how to do it by those at the top of the pyramid.    

Starting with the Renaissance and lasting up until the early Industrial Revolution, innovation (through research and development), accountability, and meritocracy came into fruition.  This era saw the the creation of modern HR practices, budgets, KPIs, yearly evaluations, and bonus systems for performance.  Organizations adopted Frederick Taylor's principles of scientific management, and the concept of management by objectives first came into use.  Laloux labels these Orange organizations (he also uses the metaphor "machine").

Green organizations (Laloux uses the metaphor "family" here) emphasized cooperation over competition, equality, and empowerment.  While these organizations operated with the pyramidal structure of the Amber and Orange organizations, leaders share at least some of the control over what goes on in the organization.  These organizations follow the stakeholder theory of the firm as opposed to the shareholder theory first advanced by the economist Milton Friedman.  Empowerment and egalitarian management are the order of the day.

Beyond the Green organization, we finally have the Laloux's Teal organization (he uses the metaphor "living organism" here), where self-management replaces the hierarchical pyramid and organizations are seen as living organisms.  In Teal organizations, the whole is the greater than the sum of the individual parts.  Here, we see organizations as complex adaptive systems.  

Laloux writes, "Every stage of organizational evolution is more mature and effective than the previous stage, because of the inherent attitude toward power. A Red leader asks, How can I use my power to dominate? An Amber leader asks, How can I use it to enforce the status quo? An Orange leader asks, How can we win? A Green leader asks, How can we empower more people? A Teal leader asks, How can everyone most powerfully pursue a purpose that transcends us all?"






One of the main criticisms of Laloux's work is that there is little scientific basis for some of the arguments he made in his book.  I am less concerned with the historical or scientific accuracy of his claims and more interested in his conceptual model of the different types of organizations.  I do think he makes some very interesting points here.  Laloux talks about several organizations that have adopted the Teal organizational structure, including Patagonia, Morning Star, and Sun Hydraulics.  

Whether the Teal organization will become more common is still under debate.  According to a review published in 2004 in the journal Public Performance & Management Review, large numbers of U.S. businesses are experimenting with the use of self-managed teams.  A survey of Fortune 1000 companies found that 27% of organizations used self-managed teams in 1987, though more recent estimates suggest that this percentage could be as high as 82%.  So, as I have stated in the last few posts, I do think there is a place for these models in organizations today.  If you choose to call organizations that utilize self-managed teams, "deference to expertise", or some of the characteristics that we find in complex adaptive systems a Teal organization or not is entirely up to you.  

Tuesday, September 19, 2023

A Flock of Starlings

I talked about two concepts, self-managed teams (albeit very briefly) and complex adaptive systems (to a greater extent) in my last post, "The Myth of the Ant-Queen".   To recap, an ant colony is a great example of a complex adaptive system, which is defined as a group of semi-autonomous agents or individuals who interact in interdependent ways to produce system-wide patterns.  The behavior of each individual ant in the colony is governed by a few simple rules, yet the behavior of the colony as a whole can be quite complex.  Simple rules lead to complex behavior, in the absence of any centralized coordination or leadership.  The ant-queen is not really a leader at all - all she does is lay eggs to sustain or grow the colony.  Nigel Franks, a specialist in ant behavior, wrote, "The solitary army ant is behaviorally one of the least sophisticated animals imaginable...Yet put a half million of them together, and the group as a whole becomes what some have called a superorganism with collective intelligence."  As it turns out, all insect colonies (ants, termites, bees, etc) behave similarly, in that the individual behavior of each insect is governed by a surprisingly few number of rules, leading to a significantly more complex behavior when considering the colony as a whole.   

Admittedly, insect behavior is not the same as human behavior.  Can groups of higher order animals, even humans, behave in a similar fashion to that of the ant colony?  As it turns out, they certainly can and do.  Witness the incredible beauty, order, and symmetry of a flock of starlings in flight (see a beautiful video here).  It's called murmuration, and it's absolutely fascinating to observe.  


I would argue that starlings are a lot more intelligent than ants, termites, and bees.  However, it would be wrong to assume that starling murmuration is centrally coordinated or orchestrated by the leader of the flock (if there is any such thing).  Individual starlings, like the ants I mentioned in my previous post follow a set of simple rules that produces the complex group behavioral patterns demonstrated in murmuration.

Surprisingly, in the late 1980's a scientist named Craig Reynolds wrote a simple computer program that simulated starling murmuration.  Reynolds called his simulated starlings "boids".  By following three simple rules, the "boids" recapitulated the complex behavior of murmuration (see the video of Craig Reynold's "boids" algorithm here and here):

1. Separation - steer to avoid crowding local boids and other objects
2. Alignment - steer towards the average heading of local boids
3. Cohesion - steer to move towards the average position of local boids

I first talked about starling murmuration in a post from a few years ago (see "Don't be an agent of chaos!").  Scientists have studied the flocking behavior of a number of different animal species, including starlings.  For example, we can observe similar behavior with schools of fish (technically, it's not called murmuration, but rather shoaling or schooling instead).  

These complex behaviors have been worked out mathematically (see "Effective leadership and decision-making in animal groups on the move"), and similar processes have even been observed in humans in the laboratory setting (see "Consensus decision making in human crowds").  We are, in fact, part of the animal kingdom.  So, whether our ability to move through crowds or in crowds is our innate "animal senses" or some other as yet unrecognized pattern of human behavior, the fact remains that we can create order out of chaos, in ways very similar to the murmuration behavior of starlings.

Just to finish my point, here's another example of murmuration-like behavior involving humans - maybe now we should avoid the term "murmuration" and label this kind of behavior, self-organization (individuals follow simple rules to produce complex group behavior with little to no centralized coordination or leadership direction).  Hisashi Murakami, a professor at the Kyoto Institute of Technology recently published the results of a series of outdoor experiments performed on the campus of Tokyo University, in which he and his colleagues filmed two groups of students walking down a narrow path about 30 feet long (see "Mutual anticipation can contribute to self-organization in human crowds").  The two groups walked towards each other at a normal walking pace.  Murakami and his colleagues noted that the groups of students effortlessly and spontaneously formed separate channels through the traffic (again, see my post, "Don't be an agent of chaos!" to learn what happened next).

My take-home point from these last two posts is that group behavior, from ants all the way to humans is incredibly complex and follows at least some of the characteristics of complex adaptive systems.  The logical follow-up question is whether organizations today can leverage some of the characteristics of these systems for better operational efficiency.  As it turns out, companies like Morning Star, a U.S. based tomato processing company (see the HBR article "First, Let's Fire All the Managers!") and Zappos (see the HBR article, "Beyond the Holocracy Hype") have embraced, at least for a time, the concept of self-managed teams (see also, the concept of Teal Organizations).  Companies like these (and others, though on a more limited scale) have flattened the traditionally hierarchical organizational structure to run more like an ant colony or flock of starlings.  And interestingly enough, when you start to look at these organizational structures, we start to see evidence of networks!

Sunday, September 17, 2023

The Myth of the Ant-Queen

I can't remember exactly when it was during my childhood that I tried to start an ant colony.  I walked around our backyard until I found an ant mound, and I dug as deep as I could (which wasn't very deep) and placed all of the dirt and the ants - into a large glass jar.  My father showed me how to use a hammer and nail to poke holes in the jar's lid, so that the ants could breathe.  I don't remember asking my father whether the ants could leave the jar through those same holes, but maybe we should have considered that possibility.  Perhaps that’s why my mother made me keep the jar outside!  I remember being absolutely fascinated watching how the ants dug this elaborate network of tunnels in the dirt.  I think my colony eventually died out, not because of a lack of food, water, or oxygen, but due to the lack of a queen.

I have been reading some fascinating articles about the social behavior of insects, such as ants and termites (for example, check out the article “Swarm Smarts” in Scientific American from 2008).  And apparently I’ve always misunderstood the role of the queen of the colony.  The “queen” is not like what we usually think of when we hear the term queen.  As it turns out, Hollywood has misrepresented the role of the “queen” too, in animated films such as Antz or A Bug’s Life.  The “queen” is NOT the leader of the colony, but rather the “mother” of the colony.  Her only job is to lay eggs.  That’s it.  

So who, then, is leading the colony?  The surprising answer is that no one is leading the colony!  Each ant plays a specific role, whether it is foraging for food, building the network of tunnels in the ground, or guarding the colony from rival colonies or other species of insects.  And each ant plays its role without any direction or without any leader telling it what to do or how to do it.  The entire colony is leaderless, yet it still thrives!

The social behavior of the colony is entirely determined by the collective, simple behavior of the individual ants in the colony.  Here's another example.  It is a well-known fact that ants have the remarkable ability to work together to build "ant bridges" across obstacles that block their search for food (check out a video of a massive ant bridge here).  The ants work together to form a bridge using only their individual bodies, and what is amazing is that they do so without any direction or instruction from a leader ant.  Instead, each individual ant follows three very simple rules: (1) if you come to an obstacle or gap, slow down; (2) if you feel another ant walking across your body, stay put; (3) when you no longer feel ants walking across your body, start moving again.  That's it!  Three simple rules leads to rather complex behavior!  And again, NO LEADER!

Here's one last example from the insect world.  Termites, like ants, form social colonies and build complex structures using simple rules of behavior.  Interestingly enough, we humans are borrowing some of the "design principles" (and I use that term lightly, for reasons that I will explain in a moment) that the termites use to construct their homes (this interesting and growing field is called biomimetic architecture).  For example, the Eastgate building, a shopping center and office building in Harare, Zimbawe was designed and constructed similar to a termite mound.  The building is self-ventilating and can stay cool with very little utilization of energy - see the figure below:










Again, it bears repeating that the termites build and construct these complex mound colonies with essentially no direction or leadership (the irony is not lost on me that the construction company that built the Eastgage building likely had one architect in charge of design as well as an engineer in charge of construction).  

As it turns out, this ability to self-organize and self-manage is one of the fundamental characteristics of what is called a complex adaptive system.  A  complex adaptive system is defined as a group of semi-autonomous agents who interact in interdependent ways to produce system-wide patterns, such that those patterns then influence behavior of the agents.  These systems are characterized by three fundamental concepts:

1. A system of individual parts or agents that interact with each other
2. Interaction follows simple rules that lead to emergence (the whole becomes greater than the sum of the parts)
3. There is no centralized leader who is coordinating the individual parts or agents.

Examples of complex adaptive systems, aside from ant and termite colonies, include the immune system, the brain, the stock market, and the national economy.  I would argue, as others have done, that health care organizations also represent examples of complex adaptive systems (more on this in future posts).  One of the most interesting characteristics of complex adaptive systems, at least in my opinion, is the third point above - the fact that there is no centralized coordination of the collective actions of the different parts or agents.  And this is a topic that I wish to further explore in future posts.