Machine Learning Authors: Pat Romanski, William Schmarzo, Yeshim Deniz, Stackify Blog, Jason Bloomberg

Related Topics: @CloudExpo, Artificial Intelligence, @DXWorldExpo

@CloudExpo: Blog Post

The Human Body and Data Center Automation | @CloudExpo #AI #ML #DataCenter

The nervous system has two components: the central nervous system and the peripheral nervous system

The Human Body and Data Center Automation - Part 2

Disclaimer: I am an IT guy and my knowledge on human body is limited to my daughter's high school biology class book and information obtained from search engines. So, excuse me if any of the information below is not represented accurately !!

Human body is the most complex machine ever created. With a complex network of interconnected organs, millions of cells and the most advanced processor, human body is the most automated system in this planet. In this article, we will draw comparisons between working of a human body to that of a data center. We will draw parallels between human body automation to data center automation and explain different levels of automation we need to drive in data centers. This article is divided into four parts covering each of body main functions and drawing parallels on automation. This is the second article in the human body series. Please click here for the link for first article

The nervous system
The nervous system is a complex collection of nerves and specialized cells known as neurons that transmit signals between different parts of the body. It is through the nervous system that we communicate with the outside world and, at the same time, many mechanisms inside our body are controlled. The nervous system takes in information through our senses, processes the information and triggers reactions, such as making your muscles move or causing you to feel pain. The closest comparison to nervous system to what is in our data center is the network. Much like the network connects everything together in the data center, nervous system essentially is the body's network system.

The nervous system has two components: the central nervous system and the peripheral nervous system. The central nervous system is made up of the brain, spinal cord and nerves. The peripheral nervous system consists of sensory neurons, ganglia (clusters of neurons) and nerves that connect to one another and to the central nervous system. Imagine this as core network (central) and data center network (peripheral). However, what is so fascinating about our nervous system is the way it works. Let's take a deep dive inside our body and learn how can we make our networks more efficient.

Image Source: Livescience.com

The nervous system has two main subdivisions: the somatic, or voluntary, component; and the autonomic, or involuntary, component. The autonomic nervous system regulates certain body processes, such as blood pressure and the rate of breathing, that work without conscious effort. It is constantly active, regulating things such as breathing, heart beat and metabolic processes. It does this by receiving signals from the brain and passing them on to the body. It can also send signals in the other direction - from the body to the brain - providing your brain with information about how full your bladder is or how quickly your heart is beating.

Now can you think what system in our data center comes close to autonomic nervous system? It's our monitoring system. The function of monitoring system in data center is to monitor health of various components(hardware/software) in our data center and alert us when the thresholds are breached or an error has occurred. In most of the modern data centers today there is some tool which does this job. Alerts and error logs are collected at all layers and once an error has occurred or particular KPIs crosses certain threshold, an event is generated and humans are notified to take action. However, where the human body defeats any modern monitoring system is ability to take autonomic actions based on situation. Let's imagine you on a treadmill and running. When you are running and as the heart rates goes up, the brain is not just sending out alerts to you indicating your heart rate is going up but it also taking appropriate actions to ensure the body continues to function. The first action is to breakdown glycogen, a form of glucose to give you extra dose of energy.

The second action is to draw more blood towards your muscles which are under stress and away from non-needed functions like digestion (unless you are eating while excising). Since the body needs more oxygen for your muscles it signals your lungs to intake more oxygen and hence your breathing rate goes up. As the body burns more glucose and your body heats up, your brain sends signals to your sweat glands to release moisture to keep the body cool and hence maintains temperature inside the body. All these actions without you telling your body what to do to keep you healthy. Only if the thresholds crosses beyond certain rate and your body is not able to fix you, it will signal us to take action like resting or slowing down. This is exactly how our monitoring system should work. However, what happens in most of the enterprise is a sorry state of affairs.

Let's consider a very common issue most of the enterprise faces - a performance issue. Consider that the mission critical business application running on your server is experiencing performance issues and the users are complaining. In a typical organization, an application user will do first level analysis and based on his/her analysis he will open an incident ticket with command center. Everyone from systems engineer, storage engineer, network engineer and specialized performance engineers are paged to figure out what's happening. Hours are spent to detect where in the fabric there is contention which is leading to performance issue. Once the issue is detected another few hours are spent to finalize the action plan and finally the fix is put in place. Sounds familiar.

Now imagine we can learn from our human body and can design our data center in such a way that the system should automatically detect something is going wrong in the fabric and find out where in the fabric there is issue. Once the issue is detected it identifies appropriate fix and implements the fix. If the system detects performance issue is because of underlying CPU constraint on one of the VMs, the system should either scale up CPU capacity on the VM or automatically horizontally scale the application by adding another VM or container. If the issue was detected at network level, system should be in a position to move entire VLAN to another healthy leaf switch. If the issue happened at DC level, the system should automatically fail over all the impacted applications to another DC. While some of the modern cloud native applications works in similar fashion, the same level of maturity is not seen in traditional applications.

The somatic system consists of nerves that connect the brain and spinal cord with muscles and sensory receptors in the skin. The voluntary nervous system (somatic nervous system) controls all the things that we are aware of and can consciously influence, such as moving our arms, legs and other parts of the body. The nerves (like the network cables in our DC), starts at the brain and central cord and branches out to every part of our body. Neurons (intelligent code) send signals to other cells though thin fibers called axons, which causes chemical known as neuro transmitter to be released at junctions called synapses. A synapse gives command to the cell and the entire communication takes a fraction of a second. Such is the speed of transmission in our human body that our fastest router in the world cannot come close to this.

Let's take an example. Imagine someone tapping you lightly on your shoulder and your immediate reaction is to turn around and see who is doing that. The sensory neurons (cells) on our shoulder transmit the signals to your brain via the nerves at such a fast pace that you immediately react. Now imagine someone tapping at your shoulder and it takes few seconds to a minute for your body to react to the signal J . The way our body reacts to various form of sense (touch, smell, taste, etc.) and the fact we don't have to manage every action indicates how advance is our body's automation system. The body sensor systems are like the sensors in our data center. The role of sensors is to collect the data and send it for further processing. While we have lot of maturity to collect data what we lack is how fast can we analyze the data to take appropriate action. This is where our Brain checkmates even the fastest of all computers including IBM Watson. Our brain is a combination of Big Data system, e.g., Hadoop, the intelligence of IBM Watson and fastest super compute in the world all combined into one. Let's look at our brain.

Image Source: diseasespictures.com

Brain - Our Brain is the intelligence of our body. It controls all actions in our body. It acts as both CPU and memory for our body and without brains you are almost like walking zombie who has no control of his or her actions. Inside the data center, CPU/Memory inside our servers combined with the software which runs on top of these acts like brain. However, we are still far to match the amount of computing capacity our brain has and more important the learning and intuitive capabilities our brain has.

The fastest supercomputer in the world is China's Sunway Taihulight  and has a maximum processing speed of 93 petaFLOPS. A petaFLOP is a quadrillion (one thousand trillion) floating point calculations per second. Still this does not come close to processing speed of the human brain. It is postulated that the human brain operates at 1 exaFLOP, which is equivalent to a billion billion calculations per second. While the hardware which is, the muscular structure can be compared with chip set we have in our computers, it's the software which makes the difference.

Our brain controls the nervous system, the muscular system and other vital parts of our body. It also has tremendous learning capability. When a child is born, our brain is almost empty but is in a learning mode. It quickly learns how to interact with the outside world and starts to read data from the sense organs. This is how we react to taste, touch and sound. As we grow we learn how to talk, write and communicate. We learn how to walk, run and jump! In the software world, we call it as AI - Artificial intelligence. Humans have been trying for centuries on how to develop brain like self-learning capabilities and while we now have self-driving cars which is pushing the envelope, we are still far away from truly matching our brain's power.

Now the brain cannot work out of isolation. It gets all the data it needs from our sensory organs - eyes, nose, tongue. We interact with the world with the help of our sensory organs. Eyes gives us visual data , nose gives us smell related data while the tongue allows us to taste. Do you know that our tongue alone has millions of sensors which allows to distinguish various tastes from sour to sweet and from hot to cold! Imagine the status of all restaurants if we did not have these sensors. On the other hand, our nose has sensors to not only detect various smell but also acts as a self-defense organ.

In our data centers, we need similar capabilities. Inside the compute, we have sensors which tells us that the filesystem is getting full or inside the router we can tell if we have packet drops happening. We name them as alerts and in a given day millions of alerts are generated by all the systems running in an enterprise. The difference here is what do we do the alerts? If every alert is dependent on human to take manual intervention it will be as good as our tongue telling you that the coffee you are drinking is very hot and waiting for an action to be decided by you on whether you should stop drinking. Your tongue sends alert to your brain, your brain processes information and decides it's too dangerous and immediately takes action to control your actions. Now you may still drink it cause harm but the body takes immediate action to prevent the harm.

Similarly, with the alerts coming from our systems, we need to develop systems which can take immediate actions (self-heal) and not wait for human intervention all the time. If the filesystem is full, take immediate action to detect and fix what is causing it to be full. If the security intrusion detection system has detected malicious emails, block the emails immediately. If network port is dropping packets, isolate the port and move traffic to alternate port. The more autonomic actions we can take, the better we will be in managing our data center.

To summarize here's what we need in our data center: L-C-C-A

  • Lightning fast network of intelligent sensors across the data center stack
  • Central monitoring system which can monitor alerts/error logs at all layers from application down to the server
  • Co-relation engine which can correlate various alerts and error logs and pin points where in the data center there is issue
  • Artificial intelligence (AI) capable run-book automation engine which can trigger autonomous action (self-heal) based on the issue identified and implements the fix

In our next article on human body and data center automation we will focus on our circulator system which is responsible for flow of blood, oxygen and nutrients in our body and we will learn how our data center should learn from same. Until next time.

More Stories By Ashish Nanjiani

Ashish Nanjiani is a Senior IT Manager within Cisco IT managing Cisco worldwide IT data centers as an operations manager. With 20 years of IT experience, he is an expert in data center operations and automation. He has spoken in many inter-company events on data center automation and helps IT professionals digitize their IT operations. He is also an entrepreneur and has been successfully running a website business for 10+ years.

Ashish holds a Bachelor of Science degree in Electrical and Electronics and a Masters in Business Administration. He is a certified PMP, Scrum master. He is married and has two lovely daughters. He enjoys playing with technology during his free time. [email protected]

@CloudExpo Stories
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
DXWorldEXPO LLC announced today that Kevin Jackson joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Kevin L. Jackson is a globally recognized cloud computing expert and Founder/Author of the award winning "Cloud Musings" blog. Mr. Jackson has also been recognized as a "Top 100 Cybersecurity Influencer and Brand" by Onalytica (2015), a Huffington Post "Top 100 Cloud Computing Experts on Twitter" (2013) and a "Top 50 C...
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
"NetApp is known as a data management leader but we do a lot more than just data management on-prem with the data centers of our customers. We're also big in the hybrid cloud," explained Wes Talbert, Principal Architect at NetApp, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Since we launched LinuxONE we learned a lot from our customers. More than anything what they responded to were some very unique security capabilities that we have," explained Mark Figley, Director of LinuxONE Offerings at IBM, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...
Evan Kirstel is an internationally recognized thought leader and social media influencer in IoT (#1 in 2017), Cloud, Data Security (2016), Health Tech (#9 in 2017), Digital Health (#6 in 2016), B2B Marketing (#5 in 2015), AI, Smart Home, Digital (2017), IIoT (#1 in 2017) and Telecom/Wireless/5G. His connections are a "Who's Who" in these technologies, He is in the top 10 most mentioned/re-tweeted by CMOs and CIOs (2016) and have been recently named 5th most influential B2B marketeer in the US. H...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
As you move to the cloud, your network should be efficient, secure, and easy to manage. An enterprise adopting a hybrid or public cloud needs systems and tools that provide: Agility: ability to deliver applications and services faster, even in complex hybrid environments Easier manageability: enable reliable connectivity with complete oversight as the data center network evolves Greater efficiency: eliminate wasted effort while reducing errors and optimize asset utilization Security: implemen...