image missing
Date: 2025-08-22 Page is: DBtxt003.php txt00004881

Technology ... Big Data
Big Data in Health

Healthcare and big data: Don't toss out the rules of the road

Burgess COMMENTARY
I made the following comment on the post by Marion Cook:

I am amazed at what is possible with modern 'Big Data'. As someone who installed a mainframe computer with 4K of main memory in the 1960s, I understand something of the change in technology ... and I love it.

But like almost everything ... technology can be used for good or bad ... and my guess is that the bad will be the winner unless 'we the people' become engaged responsibly.

'Big Data' has the potential to empower in ways that have not been possible before. Two big things happened in 1776 ... the US Declaration of Independence and the publication of Adam Smiths book 'Wealth of Nations'. Many things have changed in the intervening period, especially technology and the structure of the market ... and some have stayed the same.

What can be done with 'Big Data' is exciting ... especially if it can be used to address the analysis of important things. For me this means doing better than the terrible trio of economics and finance: (1) money profit for business; (2) stock prices for investors; and (3) GDP growth for policy makers.

In their place, I want analysis that shows how economic activity impacts people, place, planet and profit ... the 4Ps. I see all of these as important, not just the profit. Measurement of state, progress and performance should not only be for the organization and the investors, but should also be about the community (people and place) ... and the measurement should not be just about money flows, it should be about value flows. The concept of money wealth needs to be complemented by the value of quality of life and happiness. GDP growth that accelerates the depletion of natural resources and increases pressure on the environment should be retired and replaced by something that encourages productivity that results in less use of finite resources while improving quality of life and happiness. Optimizing for these results is not simple ... but we can certainly do better than what my generation of leadership has been doing for the past 40 years! Peter Burgess TrueValueMetrics


Peter Burgess

Healthcare and big data: Don't toss out the rules of the road

With the promise of big data (solving the unsolvable problems, informing better decision making, creating new products and services, discovering patterns and acting on them, etc.) on the horizon, what has really changed? Does this mean that everything we know and do with not-so-big data should be tossed?

Not so fast. While big data as a mainstream concept is somewhat new, traditional information management is not. It can still be a valuable organizing structure to bring order to chaos. After all, organizations big enough for big data ought – ought – to have an information governance program already in place. And big data should be part of that program. According to “Big Data Governance” by Sunil Soares, a book I recommend:

Big data governance is part of a broader information governance program that formulates policy relating to the optimization, privacy, and monetization of big data by aligning the objectives of multiple functions. ...

... The traditional disciplines (of an information governance program) are organization, metadata, privacy, data quality, business process integration, master data integration, and information lifecycle management.

These disciplines are exactly what data big and small need. The rules of the road do still apply.

I am not making light of the significant issues facing effective big data usage, or the need for different tools to handle it. To abuse a lyric from the wise philosopher and rapper Eminem, these issues come from both the top down and bottom up, like “when a tornado hits a volcano.”

Representing the top down tornado: massive amounts of regulation, the convergence of traditional patient, payer, provider and life science roles, and the rapid introduction of new, frequently disruptive technologies. While we IT professionals have always been in the business of change, even our definition of normal has been blown away.

Representing the bottom up volcano, as discussed in previous posts (HIT legacy systems: Outrunning the Zombie Apocalypse and Fracking healthcare big data: Drilling for value or just hot gas?), there are issues with the current state of existing data:

  • Legacy systems house significant data, usually in mysterious ways
  • Vendors allow non-standard data entry within their own systems, and do not play nicely with others
  • Clinical data is corrupted as it is translated across standards, regional and national registers and Health Information Exchanges
And there is the very nature of what big data is: “high volume, velocity and/or variety of information assets” (Gartner Group) that traditional methods and tools cannot handle well. A bubbling cauldron of data, to be sure.

So yes, I get it. But let’s take a big step back. We’ve seen this sort of ‘the old rules don’t apply’ froth before. The term ‘big data’ is currently enjoying quite a ride on the hype cycle (is the term “Chief Big Data Officer” far behind??? Please, no!). Tornados, volcanoes and hype-mongers aside, it still is, after all, just data, even if your data center (or cloud) needs its own zip code...


Marian Cook is a speaker, author, and business and technology leader. As a Senior Director at The College of American Pathologists, Marian Cook leads the Strategic Alliance Center of Excellence, and IT Strategy and Solutions.
SITE COUNT Amazing and shiny stats
Copyright © 2005-2021 Peter Burgess. All rights reserved. This material may only be used for limited low profit purposes: e.g. socio-enviro-economic performance analysis, education and training.