Welcome!

Machine Learning Authors: Liz McMillan, Pat Romanski, Yeshim Deniz, Elizabeth White, Corey Roth

Related Topics: Microservices Expo, Java IoT, Industrial IoT, Microsoft Cloud, Containers Expo Blog, @CloudExpo

Microservices Expo: Blog Feed Post

Re-Distributed Computing

So what have we developers been doing over the last decade?

This morning, Chaucer, our relatively new Sheltie puppy, took off with my slippers. I found one lying in his favorite spot almost immediately, but the other had gone missing. I wandered about the house with one slipper in hand while he hid in his kennel, knowing I was angry but not quite understanding why. It made me ponder the state of computing today, and where we’re headed, because it made me ponder years ago with our last dog, doing exactly the same thing. One was a Shih Tzu, the other is a Sheltie, but puppies chew on slippers with rawhide ties, doesn’t matter the breed or how many years in between.

Chaucer.blogInteresting thing about the state of the computing market, puppies – all puppies – do chew on slippers, and that rarely changes, even as we see change all around us in the high-tech world. The corollary? I sat down to learn Android development at a level most people aren’t interested in learning months ago, and guess what? After a decade of progress and hype about new and different, I wrote in Java and C++, used some of the same libraries I used when writing for the Blackberry several years ago, and made calls to most of the familiar parts of Java and quite a few unfamiliar that haven’t significantly changed. The same is largely true of Objective-C. I used it a very long time ago, and while there have been changes, it’s still Objective-C.

The same is largely true of .NET development. There have been changes over the years, but for the last decade or so, they’ve changed .NET less than they’ve changed the command line (if you count PowerShell). Alternative languages like Ruby have come along, and those of us who geek out on this stuff have tried them, but to-the-hardware development is still done largely in C/C++, and high-level software development is still done largely in Java and .NET with a healthy dose of PHP. The databases organizations ask for have been stable for just about as long. No, I’m not ignoring the Hadoop and derivatives craze, regular app developers are rarely asked for that skill set as a primary skill – so far.

So what have we developers been doing over the last decade? Learning new platforms, of course. Learning new ways to integrate, of course, but largely, not stretching enough. There are day-to-day problems we’re dealing with, and every dev has to learn new things just to do their job, but they’re largely mundane or vertical things.

To some extent, the fragmentation of dev combined with the growth of software as the engine of business and a projected reduction in development jobs that never seems to have occurred all contribute to this scenario. And of course, the difficulty in displacing languages with millions or billions of lines of code impact it.

So does a slowdown in what is revolutionary, I think. after SOA, what next? Well, there have been a lot of developments, from Git to AWS, but in the end, development is much the same. PaaS changed that very little, though it was the most likely of the cloud technologies to do so. We also filter a lot, I think. Do you write multi-core code? Seriously? Most devs in the enterprise don’t, even though there are documented benefits. That’s “beneath the hood” so-to-speak.

So what has me excited? There are signs of significant change. SDN promises not just a change in platform, but hooks you can manipulate to make your code more reliable. It’s not a Brave New World or anything, but it is food for improving App Dev without a seismic shift in development environments or methodology. The future of mobile device development promises more changes too, as more and more devices suck up more and more bandwidth. An interesting analyst note was that 4G wasn’t helping because devices were being added to the network faster than the network speed was improving. That means optimized communications either in the app or in a device between the app and users, is going to continue to be important.

Things like Git fall firmly into the re-distributed computing category. It’s a server. Always. You may not think of it as one, but if I have permissions, I can ask to clone the code in your repository. That’s a server. With the added resiliency that so is every other dev machine. Which means the loss of a “server” is not likely to be catastrophic as long as best practices for SVN have been followed. Someone will have a new enough copy that only the most recent work will be lost. And of course, if you’re replicating to GitHub, the likelihood of a catastrophic loss is even smaller. Not a huge change (it’s still version control), but a change that stabilizes source issues in the loss of a single machine.

This whole micro-server concept will creep in elsewhere, I think. Making a single machine or VM the repository of knowledge critical to your business has never been a great idea, and our outrageous backup plans show we know that at some level. If we’re replicating by virtue of daily business, it will increase network traffic in exchange for less single points of failure. Which means it will happen, because network bandwidth always increases, single points of failure are always a weak point.

As to languages, the death of Java has been predicted a lot, but I just don’t see it happening any time soon. Java and .NET are both general purpose environments suited to the current state of enterprise computing. Mobile may produce something that truly changes things, but at this point it doesn’t look like it. Low-level systems and those that need greater performance will likely continue with C/C++, though the number of environments that entails will continue to decrease. RoR and PHP will continue to eat a lot of web UI space because they’re particularly suited to it, and we’ll continue on our way.  Command line scripting languages are almost never impacted by even seismic change, so nothing to see there.

In short, the places to innovate are the connections we can make to other parts of the network – applications and increasingly infrastructure. REST and SOA will continue to rule that space.

So we’re re-redistributing. Don’t get complacent. In high tech, when you cannot see the massive changes, that means they’re happening incrementally. Continue to grow, stretch your boundaries. Try new things. Bring more to the table, because it is the external environment that is currently changing, and that needs to be accounted for in application development.

And if you haven’t tried out Git, go check it out (pun intended), you’ll find it intuitive and well documented.

Read the original blog entry...

More Stories By Don MacVittie

Don MacVittie is founder of Ingrained Technology, A technical advocacy and software development consultancy. He has experience in application development, architecture, infrastructure, technical writing,DevOps, and IT management. MacVittie holds a B.S. in Computer Science from Northern Michigan University, and an M.S. in Computer Science from Nova Southeastern University.

@CloudExpo Stories
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"Venafi has a platform that allows you to manage, centralize and automate the complete life cycle of keys and certificates within the organization," explained Gina Osmond, Sr. Field Marketing Manager at Venafi, in this SYS-CON.tv interview at DevOps at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Creating replica copies to tolerate a certain number of failures is easy, but very expensive at cloud-scale. Conventional RAID has lower overhead, but it is limited in the number of failures it can tolerate. And the management is like herding cats (overseeing capacity, rebuilds, migrations, and degraded performance). In his general session at 18th Cloud Expo, Scott Cleland, Senior Director of Product Marketing for the HGST Cloud Infrastructure Business Unit, discussed how a new approach is neces...
"This week we're really focusing on scalability, asset preservation and how do you back up to the cloud and in the cloud with object storage, which is really a new way of attacking dealing with your file, your blocked data, where you put it and how you access it," stated Jeff Greenwald, Senior Director of Market Development at HGST, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
Michael Maximilien, better known as max or Dr. Max, is a computer scientist with IBM. At IBM Research Triangle Park, he was a principal engineer for the worldwide industry point-of-sale standard: JavaPOS. At IBM Research, some highlights include pioneering research on semantic Web services, mashups, and cloud computing, and platform-as-a-service. He joined the IBM Cloud Labs in 2014 and works closely with Pivotal Inc., to help make the Cloud Found the best PaaS.
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
"Evatronix provides design services to companies that need to integrate the IoT technology in their products but they don't necessarily have the expertise, knowledge and design team to do so," explained Adam Morawiec, VP of Business Development at Evatronix, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
The Founder of NostaLab and a member of the Google Health Advisory Board, John is a unique combination of strategic thinker, marketer and entrepreneur. His career was built on the "science of advertising" combining strategy, creativity and marketing for industry-leading results. Combined with his ability to communicate complicated scientific concepts in a way that consumers and scientists alike can appreciate, John is a sought-after speaker for conferences on the forefront of healthcare science,...
"We work around really protecting the confidentiality of information, and by doing so we've developed implementations of encryption through a patented process that is known as superencipherment," explained Richard Blech, CEO of Secure Channels Inc., in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"I focus on what we are calling CAST Highlight, which is our SaaS application portfolio analysis tool. It is an extremely lightweight tool that can integrate with pretty much any build process right now," explained Andrew Siegmund, Application Migration Specialist for CAST, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Software-defined storage is a big problem in this industry because so many people have different definitions as they see fit to use it," stated Peter McCallum, VP of Datacenter Solutions at FalconStor Software, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
"Our strategy is to focus on the hyperscale providers - AWS, Azure, and Google. Over the last year we saw that a lot of developers need to learn how to do their job in the cloud and we see this DevOps movement that we are catering to with our content," stated Alessandro Fasan, Head of Global Sales at Cloud Academy, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at Cloud Expo, Ed Featherston, a director and senior enterprise architect at Collaborative Consulting, discussed the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
"We're focused on how to get some of the attributes that you would expect from an Amazon, Azure, Google, and doing that on-prem. We believe today that you can actually get those types of things done with certain architectures available in the market today," explained Steve Conner, VP of Sales at Cloudistics, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
As organizations shift towards IT-as-a-service models, the need for managing and protecting data residing across physical, virtual, and now cloud environments grows with it. Commvault can ensure protection, access and E-Discovery of your data – whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise. In his general session at 18th Cloud Expo, Randy De Meno, Chief Technologist - Windows Products and Microsoft Part...
Andi Mann, Chief Technology Advocate at Splunk, is an accomplished digital business executive with extensive global expertise as a strategist, technologist, innovator, marketer, and communicator. For over 30 years across five continents, he has built success with Fortune 500 corporations, vendors, governments, and as a leading research analyst and consultant.
Explosive growth in connected devices. Enormous amounts of data for collection and analysis. Critical use of data for split-second decision making and actionable information. All three are factors in making the Internet of Things a reality. Yet, any one factor would have an IT organization pondering its infrastructure strategy. How should your organization enhance its IT framework to enable an Internet of Things implementation? In his session at @ThingsExpo, James Kirkland, Red Hat's Chief Archi...
"We're here to tell the world about our cloud-scale infrastructure that we have at Juniper combined with the world-class security that we put into the cloud," explained Lisa Guess, VP of Systems Engineering at Juniper Networks, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Hardware virtualization and cloud computing allowed us to increase resource utilization and increase our flexibility to respond to business demand. Docker Containers are the next quantum leap - Are they?! Databases always represented an additional set of challenges unique to running workloads requiring a maximum of I/O, network, CPU resources combined with data locality.