Welcome!

Machine Learning Authors: Progress Blog, Elizabeth White, Jason Bloomberg, Dan Blacharski, Darren Anstee

Related Topics: @DXWorldExpo, @CloudExpo, @ThingsExpo

@DXWorldExpo: Blog Feed Post

Identifying Where and How to Start the Big Data Journey | @BigDataExpo #BigData #DataLake #Analytics

Organizations are eager to realize the business benefits of Big Data that they don’t take the time to do the little things first

Decisions Exercise: Identifying Where and How to Start the Big Data Journey

The recent deluge of rains in Northern California have flooded streets, brought down trees and plugged storm sewers.  As I was trying to make my way around the neighborhood, I thought of a classroom exercise to help my MBA students to identify the use cases upon which they could focus data and analytics.  In this exercise, I’m going to ask my students to pretend that they have been hired by the city to “Optimize Street Maintenance” after these rainstorms. In particular, the students need to address the following questions:

  • Where and how do you start to address this initiative?
  • What data might you need to support this initiative?

These are classic questions that I hear all the time when I meet with clients about their big data journeys.  Let’s walk through how I’ll teach my students to address this challenge.

Step 1:  Identify and Brainstorm the Decisions
“Where and how to start?” is such an open ended question.  How does one even begin to think about that question?  We recommend that organizations start by identifying the decisions that need to be made to support the targeted business initiative, which is “Optimize Street Maintenance” in this exercise.

I will break up the students into small groups (3 to 5 students) and ask them to brainstorm the decisions that need to be made with respect to the “Optimize Street Maintenance” initiative.  Those decisions could include:

  • What streets and intersections need maintenance?
  • What storm sewers are blocked?
  • What is blocking those storm sewers?
  • What sort of maintenance is needed?
  • What is the impact of street cleaning and debris removal on flooding?
  • What streets and intersections should we fix first?
  • How busy are the streets and intersections?
  • What worker skills are needed to fix the street?
  • What equipment and materials are needed to fix the street?
  • What time of the day / day of the week is ideal for doing that maintenance work?
  • How many workers are available?
  • Do I have access to temporary workers?
  • How much overtime can I afford?
  • How do I warn residents that a road is flooded?
  • What options do I give residents when the major arteries are flooded?

This brainstorming is much more effective when you have brought together the different business stakeholders who either impact or are impacted by the “Accelerate Street Maintenance” initiative (see Figure 1).

Figure 1: Brainstorm Decisions Across Different Stakeholders

Some key process points about Step 1:

  • Allow individuals to brainstorm on their own at first. When it is entirely a group exercise, some folks go quiet and we potentially lose some good ideas.
  • Be sure to capture each decision on a separate Post-It note for later usage.
  • Place the decisions/Post-it Notes on a flip chart (or two).
  • You don’t need to group decisions by business function. I just did it here to demonstrate the process.

Finally, “all ideas are worthy of consideration.”  This is the key to any brainstorming session; to create an environment where everyone feels comfortable to contribute without someone passing judgment about his or her thoughts or ideas.

Step 2:  Group Decisions Into Use Cases
Next, we want to group the decisions into common subject areas or use cases (which is much easier to do if each decision is captured on a separate Post-It note).  I will bring all the students together around the decisions on Post-it Notes, and have them look for logical groupings.

Looking over the decisions captured above, we can start to see some natural “Accelerate Street Maintenance” use cases emerging, such as:

Prioritize Streets and Intersections

  • What streets and intersections should we fix first?
  • What streets and intersections are busiest at what times of the day?
  • What are the alternative route options during maintenance?
  • What are the alternative transportation options during maintenance?
  • What business parks or malls will be disrupted by the maintenance work?
  • Which streets and intersections raise safety concerns for bikers and pedestrians?

Estimate Maintenance Effort

  • What streets and intersections need maintenance?
  • What storm sewers need maintenance?
  • How much maintenance is needed?
  • What type of maintenance is needed?
  • What worker maintenance skills are needed?
  • What types of equipment and materials are needed?

Optimize Maintenance Effort

  • What worker skills are needed to fix the street?
  • How many workers with those skills are available?
  • What equipment is available to fix the street?
  • What tools are needed to fix the street?
  • What materials (concrete, asphalt) are needed to fix the street?
  • How effective is street cleaning and debris removal in preventing flooding?

Minimize Traffic Disruptions

  • Which streets are bottlenecks for schools and at what times of the day?
  • Which streets are bottlenecks for shopping malls and at what times of the day?
  • Which streets are bottlenecks for business parks and at what times of the day?
  • What are the alternative route options?
  • What are the public transportation options?

Minimize Maintenance Costs

  • How many workers are available?
  • To what temporary workers do we have access?
  • How much overtime can I afford?
  • How much maintenance budget is available?

Improve Resident Communications

  • What streets need maintenance?
  • What streets and intersections are likely to need maintenance?
  • What are alternative travel routes?
  • What are alternative transportation options?

Increase Resident Satisfaction

  • How many residents did the flooding impact?
  • How long were those residents impacted?
  • What comments or feedback are most important and/or relevant?
  • What phone calls are most important and/or relevant?
  • What social media postings are important and/or relevant?

See Figure 2 for an example of how the end point of Step 2 might look.

A key process point about Step 2:

  • Ideally you will end up with 7 to 12 use cases. If you have fewer than 7, then look for ways to break up some of the groupings.  If you have more than 12, then look for ways to aggregate similar use cases.  Not sure why, but 7 to 12 use cases always seems to work out to the right level of granularity in the use cases.

Step 3:  Prioritize Use Cases
Not all use cases are equal, and some use cases are dependent upon other use cases.  The prioritization matrix takes the different business stakeholders through a facilitated process to prioritize each use case vis-à-vis its business value and implementation feasibility (see Figure 3).

Figure 3: Prioritization Matrix

For more details on the prioritization process, check out these blogs:

Summary
The news really surprised no one:  “MD Anderson Benches IBM Watson In Setback For Artificial Intelligence In Medicine.”  From the press release:

“The partnership between IBM and one of the world’s top cancer research institutions is falling apart. The project is on hold, MD Anderson confirms, and has been since late last year. MD Anderson is actively requesting bids from other contractors who might replace IBM in future efforts.  And a scathing report from auditors at the University of Texas says the project cost MD Anderson more than $62 million and yet did not meet its goals.”

If big data were only about buying and installing technology, then it would be easy.  Unfortunately, companies are learning the hard way that the “big bang” approach for implementing big data is fraught with misguided expectations and outright failures.

Organizations are so eager to realize the business benefits of big data, that they don’t take the time to do the little things first, like identifying and prioritizing those use cases that offer the optimal mix of business value and implementation feasibility. While I applaud all efforts to cure cancer (my mom died from cancer, so I have a vested interest like so many others), sometimes “curing cancer” might not be the best place to start.  Identifying and prioritizing those use cases that move the organization towards that “cure cancer” aspiration is the best way to achieve that goal.

The post Decisions Exercise: Identifying Where and How To Start the Big Data Journey appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business”, is responsible for setting the strategy and defining the Big Data service line offerings and capabilities for the EMC Global Services organization. As part of Bill’s CTO charter, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He’s written several white papers, avid blogger and is a frequent speaker on the use of Big Data and advanced analytics to power organization’s key business initiatives. He also teaches the “Big Data MBA” at the University of San Francisco School of Management.

Bill has nearly three decades of experience in data warehousing, BI and analytics. Bill authored EMC’s Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements, and co-authored with Ralph Kimball a series of articles on analytic applications. Bill has served on The Data Warehouse Institute’s faculty as the head of the analytic applications curriculum.

Previously, Bill was the Vice President of Advertiser Analytics at Yahoo and the Vice President of Analytic Applications at Business Objects.

@CloudExpo Stories
Mobile device usage has increased exponentially during the past several years, as consumers rely on handhelds for everything from news and weather to banking and purchases. What can we expect in the next few years? The way in which we interact with our devices will fundamentally change, as businesses leverage Artificial Intelligence. We already see this taking shape as businesses leverage AI for cost savings and customer responsiveness. This trend will continue, as AI is used for more sophistica...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, discussed some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he covered some of the best practices for structured team migration an...
Most technology leaders, contemporary and from the hardware era, are reshaping their businesses to do software. They hope to capture value from emerging technologies such as IoT, SDN, and AI. Ultimately, irrespective of the vertical, it is about deriving value from independent software applications participating in an ecosystem as one comprehensive solution. In his session at @ThingsExpo, Kausik Sridhar, founder and CTO of Pulzze Systems, discussed how given the magnitude of today's application ...
In his session at 21st Cloud Expo, Raju Shreewastava, founder of Big Data Trunk, provided a fun and simple way to introduce Machine Leaning to anyone and everyone. He solved a machine learning problem and demonstrated an easy way to be able to do machine learning without even coding. Raju Shreewastava is the founder of Big Data Trunk (www.BigDataTrunk.com), a Big Data Training and consulting firm with offices in the United States. He previously led the data warehouse/business intelligence and B...
The “Digital Era” is forcing us to engage with new methods to build, operate and maintain applications. This transformation also implies an evolution to more and more intelligent applications to better engage with the customers, while creating significant market differentiators. In both cases, the cloud has become a key enabler to embrace this digital revolution. So, moving to the cloud is no longer the question; the new questions are HOW and WHEN. To make this equation even more complex, most ...
As you move to the cloud, your network should be efficient, secure, and easy to manage. An enterprise adopting a hybrid or public cloud needs systems and tools that provide: Agility: ability to deliver applications and services faster, even in complex hybrid environments Easier manageability: enable reliable connectivity with complete oversight as the data center network evolves Greater efficiency: eliminate wasted effort while reducing errors and optimize asset utilization Security: imple...
In his Opening Keynote at 21st Cloud Expo, John Considine, General Manager of IBM Cloud Infrastructure, led attendees through the exciting evolution of the cloud. He looked at this major disruption from the perspective of technology, business models, and what this means for enterprises of all sizes. John Considine is General Manager of Cloud Infrastructure Services at IBM. In that role he is responsible for leading IBM’s public cloud infrastructure including strategy, development, and offering m...
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, examined the regulations and provided insight on how it affects technology, challenges the established rules and will usher in new levels of diligence arou...
The past few years have brought a sea change in the way applications are architected, developed, and consumed—increasing both the complexity of testing and the business impact of software failures. How can software testing professionals keep pace with modern application delivery, given the trends that impact both architectures (cloud, microservices, and APIs) and processes (DevOps, agile, and continuous delivery)? This is where continuous testing comes in. D
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve f...
The dynamic nature of the cloud means that change is a constant when it comes to modern cloud-based infrastructure. Delivering modern applications to end users, therefore, is a constantly shifting challenge. Delivery automation helps IT Ops teams ensure that apps are providing an optimal end user experience over hybrid-cloud and multi-cloud environments, no matter what the current state of the infrastructure is. To employ a delivery automation strategy that reflects your business rules, making r...
The 22nd International Cloud Expo | 1st DXWorld Expo has announced that its Call for Papers is open. Cloud Expo | DXWorld Expo, to be held June 5-7, 2018, at the Javits Center in New York, NY, brings together Cloud Computing, Digital Transformation, Big Data, Internet of Things, DevOps, Machine Learning and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding busin...
In a recent survey, Sumo Logic surveyed 1,500 customers who employ cloud services such as Amazon Web Services (AWS), Microsoft Azure, and Google Cloud Platform (GCP). According to the survey, a quarter of the respondents have already deployed Docker containers and nearly as many (23 percent) are employing the AWS Lambda serverless computing framework. It’s clear: serverless is here to stay. The adoption does come with some needed changes, within both application development and operations. Tha...
SYS-CON Events announced today that Synametrics Technologies will exhibit at SYS-CON's 22nd International Cloud Expo®, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Synametrics Technologies is a privately held company based in Plainsboro, New Jersey that has been providing solutions for the developer community since 1997. Based on the success of its initial product offerings such as WinSQL, Xeams, SynaMan and Syncrify, Synametrics continues to create and hone in...
Smart cities have the potential to change our lives at so many levels for citizens: less pollution, reduced parking obstacles, better health, education and more energy savings. Real-time data streaming and the Internet of Things (IoT) possess the power to turn this vision into a reality. However, most organizations today are building their data infrastructure to focus solely on addressing immediate business needs vs. a platform capable of quickly adapting emerging technologies to address future ...
In his general session at 21st Cloud Expo, Greg Dumas, Calligo’s Vice President and G.M. of US operations, discussed the new Global Data Protection Regulation and how Calligo can help business stay compliant in digitally globalized world. Greg Dumas is Calligo's Vice President and G.M. of US operations. Calligo is an established service provider that provides an innovative platform for trusted cloud solutions. Calligo’s customers are typically most concerned about GDPR compliance, application p...
Kubernetes is an open source system for automating deployment, scaling, and management of containerized applications. Kubernetes was originally built by Google, leveraging years of experience with managing container workloads, and is now a Cloud Native Compute Foundation (CNCF) project. Kubernetes has been widely adopted by the community, supported on all major public and private cloud providers, and is gaining rapid adoption in enterprises. However, Kubernetes may seem intimidating and complex ...
In his session at 21st Cloud Expo, Michael Burley, a Senior Business Development Executive in IT Services at NetApp, described how NetApp designed a three-year program of work to migrate 25PB of a major telco's enterprise data to a new STaaS platform, and then secured a long-term contract to manage and operate the platform. This significant program blended the best of NetApp’s solutions and services capabilities to enable this telco’s successful adoption of private cloud storage and launching ...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.