Machine Learning Authors: Pat Romanski, Yeshim Deniz, Liz McMillan, William Schmarzo, Jason Bloomberg

Related Topics: @DXWorldExpo, Machine Learning , @ThingsExpo

@DXWorldExpo: Article

Data and Economics 101 | @CloudExpo #IoT #AI #M2M #BigData #Analytics

Economics is the science that deals with the production, distribution, and consumption of commodities

As more organizations try to determine where best to deploy their limited budgets to support data and analytics initiatives, they realize a need to ascertain the financial value of their data and analytics - which means basic economic concepts are coming into play.  While many of you probably took an economics class in college not too long ago, some more "seasoned" readers may be rusty.

The starting point for this topic began with a blog that I wrote several months ago titled "Determining the Economic Value of Data" and this key observation that started that conversation:

Data is an unusual currency. Most currencies exhibit a one-to-one transactional relationship. For example, the quantifiable value of a dollar is considered to be finite - it can only be used to buy one item or service at a time, or a person can only do one paid job at a time. But measuring the value of data is not constrained by those transactional limitations. In fact, data currency exhibits a network effect, where data can be used at the same time across multiple use cases thereby increasing its value to the organization. This makes data a powerful currency in which to invest.

So to better understand how economics can help determine the value of an organization's data and analytics, I sought the help of an old friend who is passionate about applying economics in business. Vince Sumpter (Twitter: @vsumpter) helped deepen my understanding of some core concepts of economics, and consider where and how these economic concepts play in a business world that is looking for ways to determine the financial - or economic - value of their data and analytics.

The economic concepts that seem to have the most bearing on determining the economic value of data (and the resulting analytics) that this blog will cover include:

  • Scarcity
  • Efficiency
  • Postponement Theory
  • Multiplier Effect
  • Capital

It is our hope that this blog fuels some creative thinking and debate as we contemplate how organizations need to apply basic economic concepts to these unusual digital assets - data and analytics.

Defining Economics
I found the below two definitions of "economics" the most useful:

  • Economics is the science that deals with the production, distribution, and consumption of commodities. Economics is generally understood to concern behavior that, given the scarcity of means, arises to achieve certain ends[1].
  • Economics is a broad term referring to the scientific study of human action, particularly as it relates to human choice and the utilization of scarce resources[2].

I pulled together what I felt were some of the key phrases to come up with the following definition of the "economics of data" for purposes of this blog:

Economics of Data:  The science of human choice and behaviors as they relate to the production, distribution and consumption of scarce data and analytic resources.

Economics is governed by the law of supply and demand that dictates the interaction between the supply of a resource and the demand for that resource. The law of supply and demand defines the effect that product or service availability and the demand for that product or service has on price. Generally, a low supply and a high demand increases price, and in contrast, the greater the supply and the lower the demand, the lower the price tends to fall.

Now, we will explore the most relevant economic concepts in context to the Economics of Data.

refers to limitations-insufficient resources, goods, or abilities to achieve the desired ends. Figuring out ways to make the best use of scarce resources or find alternatives is fundamental to economics.

Scarcity Ramifications

Figure 1: Scarcity Ramifications

Scarcity is probably the heart of the economics discussion and ties directly to the laws of supply and demand.  Organizations do not have unlimited financial, human or time resources, consequently as we discussed previously, organizations must seek to prioritize their data and analytic resources against those best opportunities.  Scarcity at its heart forces organizations to do two things that they do not do well:  prioritize and focus (see "Big Data Success: Prioritize ‘Important' Over ‘Urgent'").

Scarcity plays out in the inability, or the unwillingness, for the organization to share all of its data across all of its business units.  For some business units, scarcity drives their value to the organization; that is, he who owns the data owns the power.  This short-sighted mentality manifests itself across organizations in the way of data silos and IT "Shadow Spend."  For example, if you are a Financial Services organization trying to predict your customers' lifetime value, having analytics that optimize individual business units (checking, savings, retirement, credit cards, mortgage, car loans, wealth management) without seeking to optimize the larger business objective (predict customer lifetime value) could easily lead to suboptimal or even wrong decisions about which customers to prioritize with what offers at what times through what channels.

Scarcity has the biggest impact on the prioritization and optimization of scarce data and analytic resources including:

  • Are your IT resources focused on capturing or acquiring the most important data in support of the organization's key business initiatives?
  • Are your data science resources focused on the development of the top priority analytics?
  • Does your technical and cultural environment support and even reward the capture, refinement, and re-use of the analytic results across multiple business units?

Consequently, the ability to prioritize (see "Prioritization Matrix: Aligning Business and IT On The Big Data Journey") and carefully balance the laws of supply and demand are critical to ensure not only that your data and analytics resources are being prioritized against the "optimal" projects.

Postponement Theory
is a decision to postpone a decision (which is itself a decision). It can occur as one party seeks to either gain additional information about the decision and/or to delay for better terms from the other party.

Postponement has the following ramifications from an economics of data perspective:

  • Case #1: Organizations may decide to postpone a decision in order to gather more data and/or build more accurate analytics in order to dramatically improve the probability of making a "better" decision
  • Case #2: People and organizations may postpone a decision in order to get better terms especially given certain time constraints (e.g., car dealers get very aggressive with their terms near the end of the quarter)

While Case #2 may not have an impact on the economics of your organization's data and analytics, Case #1 has direct impact.  In order to make a postponement decision, organizations need to understand:

  • What is the estimated effectiveness of the current decision given Type I/Type II decision risks (where a Type I error is a "False Positive" error and a Type II error is a "False Negative error)? See "Understanding Type I and Type II Errors" for more details on Type I/Type II errors.
  • What data might be needed to improve the effectiveness of that decision?
  • How much more accurate can the decision be made given these new data sources and additional data science time?
  • What are the risks of Type I/Type II errors (the costs associated with making the wrong decision)?

is a relationship between ends and means. When we call a situation inefficient, we are claiming that we could achieve the desired ends with less means, or that the means employed could produce more of the ends desired.

Data and analytics play a major role driving efficiency improvements by identifying operational deficiencies and proposing recommendations (prescriptive analytics) on how to improve operational efficiencies.

The aggregation of the operational insights gained from efficiency improvement might lead to new monetization opportunities in enabling the organization to aggregate usage patterns across all customers and business constituents.  For example, organizations could create benchmarks, share, and index calculations that customers and partners could use to measure their efficiencies and create goals around efficiency optimization from the aggregated performance data.

Multiplier Effect
The multiplier effect refers to the increase in final income arising from any new injection of spending. The size of the multiplier depends upon household's marginal propensity to consume (MPC), or the marginal propensity to save (MPS).

The Multiplier Effect is one of the most important concepts developed by J.M. Keynes to explain the determination of income and employment in an economy. The theory of multiplier has been used to explain the cumulative upward and downward swings of the trade cycles that occur in a free-enterprise capitalist economy. When investment in an economy rises, it can have a multiple and cumulative effect on national income, output and employment.

The multiplier effect is, therefore, the ratio of increment in income to the increment in investment.

When applied to our thinking about the Economics of Data, the multiplier effect embodies the fact that our efforts to develop a new data source, or derived analytic measure, could have that same multiplier effect if the new data/analytics were to be leveraged beyond the initial project.

For example, when CPG manufacturers worked with retailers to implement the now ubiquitous UPC standard in the early 1980's, their primary motivation was a desire to drive more consistent pricing at the cash register... Few imagined the knock-on benefits that would accrue by now having much deeper understanding of actual product movement through the supply chain...let alone the shift in balance-of-power that subsequently ensued from CPG Manufacturer to today's Retailers!

Multiplier Effect

Figure 2:  Multiplier Effect

Price Elasticity
Price elasticity
of demand is the quantitative measure of consumer behavior that indicates the quantity of demand of a product or service depending on its increase or decrease in price. Price elasticity of demand can be calculated by the percent change in the quantity demanded by the percent change in price.

In today's big data environment, the price of data science resources (i.e. their salaries) seems almost price inelastic (inelastic describes the situation in which the quantity demanded or supplied of a good or service is unaffected when the price of that good or service changes).  That means that the demand for data science resources is only slightly affected when the price of data science resources increases.

This price inelasticity of data science resources can only be addressed in a few ways:  train (and really certify) more data scientists or dramatically improve the capabilities and ease-of-use of data science tools.

However, there is another option:  train your business users to "think like a data scientist."  The key to this process is training your business users to embrace the power of "might" in collaborating with the data science team to identify those variables and metrics that might be better predictors of performance.  We have now seen across a number of projects how coupling the creative thinking of the business users with the data scientists can yield dramatically better predictions (see forthcoming blog:  "Data Science: Identifying Variables That Might Be Better Predictors").

The "Thinking Like A Data Scientist" process will uncover a wealth of new data sources that might yield better predictors of performance.  It is then up to the data science team to employ their different data transformation, data enrichment and analytic algorithms to determine which variables and metrics are better predictors of performance.

is already-produced durable goods and assets, or any non-financial asset that is used in production of goods or services.  Capital is one of three factors of production, the others being land and labor.

Adam Smith defined capital as "that part of a man's stock which he expects to afford him revenue".  I like Adam Smith's definition because the ultimate economic goal of data and analytics is to "afford organizations revenue."  And while it may be possible to generate that revenue through the sale of data and analytics, for most organizations data and analytics as capital get converted into revenue in four ways:

  • Driving the on-going optimization of key business processes (e.g., reducing fraud by 3% annually, increasing customer retention 2.5% annually)
  • Reducing exposure to risk through management of security, compliance, regulations, and governance, to avoid security breaches, litigation, fines, theft etc. to build customer trust and loyalty while ensuring business continuity and availability.
  • Uncovering new revenue opportunities through superior customer, product and operational insights that can identify unmet customer, partner and market needs
  • Delivering a more compelling, more prescriptive customer experience that both increases customer satisfaction and advocacy, but also increases the organization's success in recommending new products and services to the highest qualified, highest potential customers and prospects

Probably the most important economic impact on data and analytics is the role of human capital.  Economists regard expenditures on education, training, and medical care as investments in human capital. They are called human capital because people cannot be separated from their knowledge, skills, health, or values in the way they can be separated from their financial and physical assets.  These human investments can raise earnings, improve health, or add to a person's good habits over one's lifetime.  But maybe more importantly, an organization's human capital can be transformed to "think differently" about the application of data and analytics to power the organization's business models.

As my friend Jeff Abbott said after reviewing this blog: "What did I do wrong to have to review this blog?"

While the economic concepts discussed in this blog likely do not apply to your day-to-day jobs, more and more I expect that the big data (data and analytics) conversation will center on basic economic concepts as organizations seek to ascertain the economic value of their data and analytics. Data and analytics exhibit unusual behaviors from an asset and currency perspective, and applying economic concepts to these behaviors may help organizations as they seek to prioritize and optimize their data and analytic investments.

So, sorry for bringing back bad college memories about your economics classes, but hey, no one said that big data was going to be only fun!


[1] http://www.dictionary.com/browse/economics
[2] http://www.investopedia.com/terms/e/economics.asp?lgl=no-infinite

The post Data and Economics 101 appeared first on InFocus Blog | Dell EMC Services.

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”, is responsible for setting strategy and defining the Big Data service offerings for Dell EMC’s Big Data Practice.

As a CTO within Dell EMC’s 2,000+ person consulting organization, he works with organizations to identify where and how to start their big data journeys. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide.

Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata.

Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications.

Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@CloudExpo Stories
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
The IoT Will Grow: In what might be the most obvious prediction of the decade, the IoT will continue to expand next year, with more and more devices coming online every single day. What isn’t so obvious about this prediction: where that growth will occur. The retail, healthcare, and industrial/supply chain industries will likely see the greatest growth. Forrester Research has predicted the IoT will become “the backbone” of customer value as it continues to grow. It is no surprise that retail is ...
Evan Kirstel is an internationally recognized thought leader and social media influencer in IoT (#1 in 2017), Cloud, Data Security (2016), Health Tech (#9 in 2017), Digital Health (#6 in 2016), B2B Marketing (#5 in 2015), AI, Smart Home, Digital (2017), IIoT (#1 in 2017) and Telecom/Wireless/5G. His connections are a "Who's Who" in these technologies, He is in the top 10 most mentioned/re-tweeted by CMOs and CIOs (2016) and have been recently named 5th most influential B2B marketeer in the US. H...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
@DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises - and delivering real results.
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
"We started a Master of Science in business analytics - that's the hot topic. We serve the business community around San Francisco so we educate the working professionals and this is where they all want to be," explained Judy Lee, Associate Professor and Department Chair at Golden Gate University, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
DXWorldEXPO LLC announced today that Dez Blanchfield joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Dez is a strategic leader in business and digital transformation with 25 years of experience in the IT and telecommunications industries developing strategies and implementing business initiatives. He has a breadth of expertise spanning technologies such as cloud computing, big data and analytics, cognitive computing, m...
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
DXWorldEXPO LLC announced today that Kevin Jackson joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Kevin L. Jackson is a globally recognized cloud computing expert and Founder/Author of the award winning "Cloud Musings" blog. Mr. Jackson has also been recognized as a "Top 100 Cybersecurity Influencer and Brand" by Onalytica (2015), a Huffington Post "Top 100 Cloud Computing Experts on Twitter" (2013) and a "Top 50 C...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.