Welcome!

IoT User Interface Authors: Stefan Dietrich, Pat Romanski, Liz McMillan, Elizabeth White, AppDynamics Blog

Related Topics: IoT User Interface, Agile Computing

IoT User Interface: Article

Smart Browser, Where Art Thou?

In 1998, I got my hands on Mitchell Waldrop's book called 'Complexity'. Ever since, I've been on an amazing journey...

In 1998, I got my hands on Mitchell Waldrop's book called 'Complexity'. Ever since, I've been on an amazing journey discovering one of the most profound developments in modern science. Complexity, or more formally, the study of complex systems, is about unifying themes that run through all modern scientific disciplines including physics, biology, economics, ecology, linguistics, and sociology.

John Holland, one of the fathers of complexity science, coined the term Complex Adaptive Systems to characterize ant colonies, societies, cells and ecosystems. He pointed out that the agents in these systems are adapting to the surrounding environment by building models and by learning. And as Jeff Hawkins summarized in his book 'On Intelligence', the human evolution has been about the progressive invention of various forms of memory. Genes, brains, language and books are all examples of this.

It is obvious that memory plays a critical role in human intellect and human interactions. Yet today our  interactions with computers, and the web in particular, are disappointingly stateless. We keep going back to the Google search box and re-entering the same stuff over and over again. The computer simply has no idea what we are looking for and how to help us find it. Ah, you'd say, but how can it? Don't we need artificial intelligence for that? My claim in this article is that no, we do not. Instead, we need to get inspiration from complexity science and focus on usability and productivity.

Bookmarks are flat, the world is not
Let’s start by looking at the way we currently remember things on the web. When we find something interesting we create a bookmark. If we are web 2.0 savvy we tag it and send it to del.icio.us. Sounds good, right? Not really. Say we find an interesting book on Amazon, a wine to buy for a friend's birthday, or a restaurant that we’d like to visit next Valentines day. The moment we bookmark the site, the rich concept like a book,  a wine or a restaurant instantly disappears. Instead what we have left is the link: a piece of text that will not be meaningful a week from now. Why not? Because we do not think in terms of links. We think in terms of concepts like books, wines and restaurants.

The links that we store as the clues to deal with the massive amount of information out there, are just not enough. We need to capture and store the semantics of a thing that we find interesting. If it is a book, then we need to remember that it is about globalization and that was written by Thomas Friedman. If it is a wine, we need to capture that it was a mix of Petite Syrah and Zinfandel and that it came from Boggle winery in California. If it is a restaurant we need to remember that it is Asian fusion cuisine near Times Square in New York.

There is a minimum set of attributes that actually defines a thing in our brains. Without these attributes, the objects carry no meaning and we can not remember then. By now, as a society, we have accumulated countless of bookmarks that we will never revisit. We also lack the tools to help us clean them out. So we are trapped with collections of information that we can not re-use.

Tagging all the way
It is important to capture the right amount information to create meaning. It is also important to facilitate meaning via a taxonomy. This is a fancy word, but frankly, Yahoo! got it right since its early days. Things and concepts need to be organized, because people thrive on structured information. The problem, however, is that the web directories are static, but our personal taxonomies aren't. Like any complex system, our understanding of the world and our semantics constantly changes.

The recent invention of tagging has the potential to solve the personal taxonomy issue correctly. For managing this evolution tags are much more flexible than folders. For example, if something was  called OLE, we can retag it as ActiveX, but fundamentally it remains the same piece of information. Moving stuff from one folder to another is incredibly painful, but renaming a tag is easy.

To be successful, tagging needs to become pervasive and it needs to be built into the browser.

There is huge productivity gain in that. When we need to find something, we can just think of a tag or concept and instantly narrow our search space from thousands of things down to a handful. And no, it is not the same as folders and bookmarks. With folders, we always focused on the hierarchy and must decide into which folder or sub-folder to save the link.

The truth is that it was always a losing game, because James Gosling's blog could go into either a Java folder, a Blog folder or a Movers and Shakers folder. With tagging, we can quickly find a link to  Gosling's blog just by thinking about any one of these concepts. This is natural, because this how our brain organizes information and it is so fast that we cringe at the thought of expanding yet another folder.

Got memories? Use them wisely.
Suppose now that the browser can capture the information, preserve semantics and offer rich support for tagging. Assume also that the browser lets us painlessly find things that we once liked. What else do we need to have in place to have a more productive online experience? We'd like the browser to use the information that we’ve already stored, to help us find relevant new information.

For example, say we bookmarked the movie 'Memento' on the Internet Movie Database site. Our smart browser created a movie bookmark, stored the director, the names of the stars, the year and the title of the movie. It also helped us tag this movie with 'Crime', 'Drama', 'Mystery' and 'Thriller' tags.

The next day, when we are perusing our movie collection, we decide to rent this movie on Netflix. Instead of going to netflix.com, typing the title of the movie and then selecting it from the list of matches, we just want to be able to right-click on the movie in our organized collection and select 'Rent on Netflix'. Or, when we want to find more movies by the same director, Christopher Nolan, we click and select 'Find more movies by Christopher Nolan'. If we wanted to see a video about the star Carrie-Ann Moss, we should be able to right-click and select 'Show videos with Carrie-Ann Moss on YouTube'.

All of this is possible, because the browser has the concept of a movie and its attributes built right in. This is not artificial intelligence, it is simply hard-coding. But it is the kind of hard-coding that is not wrong, because it leads to a huge productivity boost. In addition to handling the everyday concepts, the  browser also helps the users tag every piece of interesting content, to make our browsing world wonderfully connected.

Because we tagged the movie 'Memento' we can now instantly search for 'Thriller' in books on amazon, find podcasts about 'Crime' on Odeo or find what people recently tagged as 'Drama' on del.icio.us. If we are looking at Madonna's music, we can instantly find her latest album, along with latest pop and dance music. If we are looking at an iPod, we can instantly find other products by Apple, other iPod models and pictures of iPods on Flickr. This is not AI, this is common sense.

Microformats and the long wait for semantic web
We have been talking about this functionality for years. Sir Tim-Berners Lee has been pushing hard for a Semantic Web since the early days of the web. We need semantics on the web, HTML just does not cut it. The loss of structure and semantics caused by HTML leads to a loss of productivity, and, frankly, a waste of our time. How and when do we get to the Semantic Web?

The answers are not so clear. The reality is that we have billions of HTML pages out there. Our best bet right now are microformats, which insert XML-like semantical information into HTML. Microformats are actually the right approach, because they offer us hope and a road to the Semantic Web. It is not a straight road, however. We need more tools that help us extract semantics and annotate existing web content with microformats notation and we need to invent microformats for everyday things like books, movies and wine.

While the industry is struggling to standardize, the end users continue struggling to find and organize their information. The browser needs to step in, in the meantime, and help the users. Building semantics into the browser is a good thing and it is the right thing because every one already uses a browser. We do not need to have a centralized uber-intellect trying to answer all of our questions. Instead we need a personalized browser on every desktop, in every cell phone and pda, focused on saving time for an individual user. This distributed model works well in computers and complex systems.

But we are going to get there, right?
So who is working on making the browser smart? Surprisingly, the heavyweights seem to be on the sidelines. Perhaps the bloody battles of the Netscape vs. Microsoft browser war still bring bitter memories or perhaps something is being build in complete secrecy. Who knows? But we do know that there are people working on the problem in the open. Here are some examples.

First, notably, there is Flock (http://www.flock.com) – the browser for you and your friends. Flock is on a mission to integrate with the best web services to help people better collaborate online. Flock helps us manage our del.icio.us and Shadows bookmarks, work with photos on Flickr and post to various blogs.

Flock's strategy for integrating Web Services involves a so-called topbar, which you can see in Figure 5 above. The topbar changes depending on which service the user is interacting with. For example, the topbar can display Flick photos,Yahoo! maps or News. The jury on the usability of this is still out, but the guys at Flock definitely get the productivity vibe. They work hard to make things simple - that’s for sure.

Another example of building smarts into the browser is the Attention Recorder from Attention Trust (http://www.attentiontrust.org). This non-profit has a lot of prominent web 2.0 people as its members, including Michael Arrington and Stowe Boyd. The organization produced an Attention Recorder extension for Firefox, which simply records each URL that you visit, stamps it with a timestamp and stores it in one of the approved services. The premise and the promise of the Attention Trust organization is to deliver personalization based on the user's attention. Here is the quote from their Principles:

When you pay attention to something (and when you ignore something), data is created. This "attention data" is a valuable resource that reflects your interests, your activities and your values, and it serves as a proxy for your attention.

Right now, this is still in the beta/data collection phase, but it is obviously heading in a very interesting direction.

The last example is a brand new startup called adaptiveblue, of which I am the CEO. The vision of adaptiveblue is to develop new browser technologies that deliver a personalized web experience, enhance productivity and save time. Our first product, the blueorganizer Firefox extension, is now in private beta. The blueorganizer addresses most of the issues discussed in this article. You can learn more about it and try it, by visiting http://www.adaptiveblue.com.

The smart browser circa 2010
We do not know who is going to get there first. It does not matter. What matters is that we can get done what we need to get done, despite the accelerating pace of our society. Increasingly, we spend more time working on the web. Sooner or later, everything will become the web. So it is important, that the one tool that we use to interact with the web, the browser, raises the bar and helps us out.

What we need is for the browser to 'understand' what we are doing and to save us time. To do that, it will have to know about what we have looked for in the past and what we are looking for now. It will need semantics. To achieve these ambitious goals, the next generation of the browsers will need to: 

         Embed the basic everyday life-concepts like books, movies and electronics

         Not lose important information and preserve semantics

         Encourage and simplify tagging of the content

         Continuously build and update the set of user experiences

         Focus on usability and help the user do things faster

         Embrace the design for productivity model

How can we get this smart browser now? We need to ignite another browser war. The smart browser will be born in the battle of web giants and startups. It will be a product of imagination, struggle for standards and long sleepless nights. But at the end of the day, like all great inventions it will be worth it because it will make our life easier.

More Stories By Alex Iskold

Alex Iskold is the Founder and CEO of adaptiveblue (http://www.adaptiveblue.com), where he is developing browser personalization technology. His previous startup, Information Laboratory, created innovative software analysis and visualization tool called Small Worlds. After Information Laboratory was acquired by IBM, Alex worked as the architect of IBM Rational Software Analysis tools. Before starting adaptiveblue, Alex was the Chief Architect at DataSynapse, where he developed GridServer and FabricServer virtualization platforms. He holds M.S. in Computer Science from New York University, where he taught an award-winning software engineering class for undergraduate students. He can be reached at [email protected]

Comments (6) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
Alex Iskold 05/27/06 12:00:11 PM EDT

Will,

I've been following Flock pretty closely for the past 6 months - you've been doing interesting and important work. Usability is certainly critical and something that can make or break a product like this. I will keep checking it out and and will send you my feedback.

Alex

Alex Iskold 05/27/06 11:56:43 AM EDT

Tony,

Thanks for your comment. It is difficult to cover everything in one article, but I think that google labels are great example of tagging. With respect to where things are stored, I also agree. The profile needs to be stored on the server. The browser needs to fetch this profile from the server and create personalized web experience on the client side.

Alex

Will Pate 05/26/06 03:24:30 AM EDT

Hey Alex,

Thanks for mentioning Flock. Our first beta, Cardinal, will be coming out soon. Our new director of User Experience, Will Tschumy, has been spearheading some major usability improvements that you should see in the release. We're continuing to try and make things simple, as you said. If you check out the beta, we'd love to know what you think.

Cheers,

Will Pate
Community Ambassador, Flock

TonyL 05/25/06 09:52:54 PM EDT

Thanks for the good article on the future of browsers. I was wondering how come you make no mention of gmail's great 'labels' feature which is essentially email tags. Secondly, the gmail tags are stored on the server and not in your browser... is that where we finally want the web (X.0) to go where all the sites we use store the tagging information so we don't have to move our browser profile around from machine to machine we use?

AJAX News Desk 05/25/06 06:19:53 PM EDT

In 1998, I got my hands on Mitchell Waldrop's book called 'Complexity'. Ever since, I've been on an amazing journey discovering one of the most profound developments in modern science. Complexity, or more formally, the study of complex systems, is about unifying themes that run through all modern scientific disciplines including physics, biology, economics, ecology, linguistics, and sociology.

AJAX News Desk 05/25/06 06:11:04 PM EDT

In 1998, I got my hands on Mitchell Waldrop's book called 'Complexity'. Ever since, I've been on an amazing journey discovering one of the most profound developments in modern science. Complexity, or more formally, the study of complex systems, is about unifying themes that run through all modern scientific disciplines including physics, biology, economics, ecology, linguistics, and sociology.

@CloudExpo Stories
In the world of DevOps there are ‘known good practices’ – aka ‘patterns’ – and ‘known bad practices’ – aka ‘anti-patterns.' Many of these patterns and anti-patterns have been developed from real world experience, especially by the early adopters of DevOps theory; but many are more feasible in theory than in practice, especially for more recent entrants to the DevOps scene. In this power panel at @DevOpsSummit at 18th Cloud Expo, moderated by DevOps Conference Chair Andi Mann, panelists will dis...
trust and privacy in their ecosystem. Assurance and protection of device identity, secure data encryption and authentication are the key security challenges organizations are trying to address when integrating IoT devices. This holds true for IoT applications in a wide range of industries, for example, healthcare, consumer devices, and manufacturing. In his session at @ThingsExpo, Lancen LaChance, vice president of product management, IoT solutions at GlobalSign, will teach IoT developers how t...
See storage differently! Storage performance problems have only gotten worse and harder to solve as applications have become largely virtualized and moved to a cloud-based infrastructure. Storage performance in a virtualized environment is not just about IOPS, it is about how well that potential performance is guaranteed to individual VMs for these apps as the number of VMs keep going up real time. In his session at 18th Cloud Expo, Dhiraj Sehgal, in product and marketing at Tintri, will discu...
The IoTs will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm and share the must-have mindsets for removing complexity from the development proc...
So, you bought into the current machine learning craze and went on to collect millions/billions of records from this promising new data source. Now, what do you do with them? Too often, the abundance of data quickly turns into an abundance of problems. How do you extract that "magic essence" from your data without falling into the common pitfalls? In her session at @ThingsExpo, Natalia Ponomareva, Software Engineer at Google, will provide tips on how to be successful in large scale machine lear...
Increasing IoT connectivity is forcing enterprises to find elegant solutions to organize and visualize all incoming data from these connected devices with re-configurable dashboard widgets to effectively allow rapid decision-making for everything from immediate actions in tactical situations to strategic analysis and reporting. In his session at 18th Cloud Expo, Shikhir Singh, Senior Developer Relations Manager at Sencha, will discuss how to create HTML5 dashboards that interact with IoT devic...
Artificial Intelligence has the potential to massively disrupt IoT. In his session at 18th Cloud Expo, AJ Abdallat, CEO of Beyond AI, will discuss what the five main drivers are in Artificial Intelligence that could shape the future of the Internet of Things. AJ Abdallat is CEO of Beyond AI. He has over 20 years of management experience in the fields of artificial intelligence, sensors, instruments, devices and software for telecommunications, life sciences, environmental monitoring, process...
Much of the value of DevOps comes from a (renewed) focus on measurement, sharing, and continuous feedback loops. In increasingly complex DevOps workflows and environments, and especially in larger, regulated, or more crystallized organizations, these core concepts become even more critical. In his session at @DevOpsSummit at 18th Cloud Expo, Andi Mann, Chief Technology Advocate at Splunk, will show how, by focusing on 'metrics that matter,' you can provide objective, transparent, and meaningfu...
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
SYS-CON Events announced today that Ericsson has been named “Gold Sponsor” of SYS-CON's @ThingsExpo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. Ericsson is a world leader in the rapidly changing environment of communications technology – providing equipment, software and services to enable transformation through mobility. Some 40 percent of global mobile traffic runs through networks we have supplied. More than 1 billion subscribers around the world re...
In his session at 18th Cloud Expo, Sagi Brody, Chief Technology Officer at Webair Internet Development Inc., will focus on real world deployments of DDoS mitigation strategies in every layer of the network. He will give an overview of methods to prevent these attacks and best practices on how to provide protection in complex cloud platforms. He will also outline what we have found in our experience managing and running thousands of Linux and Unix managed service platforms and what specifically c...
Redis is not only the fastest database, but it has become the most popular among the new wave of applications running in containers. Redis speeds up just about every data interaction between your users or operational systems. In his session at 18th Cloud Expo, Dave Nielsen, Developer Relations at Redis Labs, will shares the functions and data structures used to solve everyday use cases that are driving Redis' popularity.
Many private cloud projects were built to deliver self-service access to development and test resources. While those clouds delivered faster access to resources, they lacked visibility, control and security needed for production deployments. In their session at 18th Cloud Expo, Steve Anderson, Product Manager at BMC Software, and Rick Lefort, Principal Technical Marketing Consultant at BMC Software, will discuss how a cloud designed for production operations not only helps accelerate developer...
The increasing popularity of the Internet of Things necessitates that our physical and cognitive relationship with wearable technology will change rapidly in the near future. This advent means logging has become a thing of the past. Before, it was on us to track our own data, but now that data is automatically available. What does this mean for mHealth and the "connected" body? In her session at @ThingsExpo, Lisa Calkins, CEO and co-founder of Amadeus Consulting, will discuss the impact of wea...
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...
Struggling to keep up with increasing application demand? Learn how Platform as a Service (PaaS) can streamline application development processes and make resource management easy.
Up until last year, enterprises that were looking into cloud services usually undertook a long-term pilot with one of the large cloud providers, running test and dev workloads in the cloud. With cloud’s transition to mainstream adoption in 2015, and with enterprises migrating more and more workloads into the cloud and in between public and private environments, the single-provider approach must be revisited. In his session at 18th Cloud Expo, Yoav Mor, multi-cloud solution evangelist at Cloudy...
The demand for organizations to expand their infrastructure to multiple IT environments like the cloud, on-premise, mobile, bring your own device (BYOD) and the Internet of Things (IoT) continues to grow. As this hybrid infrastructure increases, the challenge to monitor the security of these systems increases in volume and complexity. In his session at 18th Cloud Expo, Stephen Coty, Chief Security Evangelist at Alert Logic, will show how properly configured and managed security architecture can...
SYS-CON Events announced today that Enzu, a leading provider of cloud hosting solutions, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to foc...
SYS-CON Events announced today that Peak 10, Inc., a national IT infrastructure and cloud services provider, will exhibit at SYS-CON's 18th International Cloud Expo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. Peak 10 provides reliable, tailored data center and network services, cloud and managed services. Its solutions are designed to scale and adapt to customers’ changing business needs, enabling them to lower costs, improve performance and focus inter...