The State of the Modern Smartphone User Interface
In the last few years, user interfaces on smart phones have undergone a sort of renaissance. What was once a stylus driven experience reminiscent of a desktop PC, has now become a finger friendly endeavor that offers new design paradigms. The iPhone is largely responsible for driving this change by showing people a phone can be easy to use with a capacitive touchsceen. The big players in the space area all working to provide the best user interface in their own way. Now that we've seen Android 2.2, iPhone OS 4.0, and even some early builds of Windows Phone 7, it's possible to see where user interface is going. 

Let's go over some of the bigger milestones in phone UI design and see what they mean for the future of phones.
 

Know your roots

Not that long ago, most smartphones felt like using small, sluggish PCs. Sure, at the time we thought we were pretty cool toting around our Windows Mobile phones, oblivious that there might be a better way to use a phone. Most methods of interaction in this era relied on having a stylus. UI elements were often small and tucked in corners of the screen. There were also scrollbars aplenty. A stylus is actually a very precise method of interaction when paired with a resistive screen. 

One thing these earlier smartphones understood is the idea of having information easily accessible. Windows Mobile provided a way to run rudimentary widgets (of course we didn't call them that) on the home screen. It was simple to check out weather or your upcoming appointments without actually launching an application.  

RIM was also a player in the early days of the smartphone and brought some useful user interface conventions. The Blackberry has not traditionally relied on any sort of touchscreen display, but rather on a trackball. The Blackberry was aimed almost exclusively at business users at first, so speed was of the essence. The user interface did a good job of making things easily accessible. With just the trackball, functions were no more than a few clicks away. Unfortunately, the Balckberry UI hasn't evolved much since then, and the straight porting of the Blackberry OS to touch devices like the Storm felt ham-handed.
 

The iPhone changes the tone

Until now, touchscreen have been useful in some situations, but no one really wanted to use them as the sole means of controlling a phone if they could avoid it. People wanted buttons and physical keyboards. It would take a man that hates buttons to move smartphone interfaces ahead. When Apple introduced the iPhone, with just a single button that had any effect on the UI, people were skeptical. But little by little the benefits of using a finger on a capacitive touchscreen to control the phone became more apparent. 

Overall, the precision of a capacitive touch screen is not as high as that of a resistive screen. So the idea of cramming lots of controls and menus on the screen was a no-go. Everything need to get a little bigger, and move further apart. This is the basic premise of being "finger-friendly". The iPhone strives to remain as easy to use as possible. This is due in part to the home screen interface. nearly the whole interface is an app launcher. Most of the phone's functions are accessible right there. The home button can be used to bring up a few additional controls (I.e. the iPod or the quick launch bar in OS4), but most of the action happens on the screen.  

The use of capacitive touch also allowed for the use of interface elements like multitouch. Apple may not have invented the idea, but they were the first to make it useful on a mobile phone. We feel like predicating a user interface on having a capacitive touchscreen makes sense. And Google apparently agrees with us.
 

Android borrows some, invents more

Android, which was launched about a year after the iPhone, takes that idea an runs with it. Phone running Google's mobile OS also rely on capacitive touchscreen, but the interface is a more free experience. If a user so chooses, an Android home screen can be utilized just like an iPhone with row upon row of app shortcuts. Though, a pull up menu has the full list of apps. When you tap on one of these shortcuts to launch it, the app fills the screen with a slick animation. 

Returning to the home screen is accomplished with the Home button. This is fairly common in phone user interfaces these days, but Android has something else to bring to the table. Android also uses the idea of the long-press as a substitute for a right-click on a PC. This means fewer UI elements need to be displayed on the screen as they are accessible via long-press only when needed. Long-pressing the home button offers up a list of recent applications as well. We've always been taken with the way the Android UI handles notifications. Unlike the iPhone where they interrupt your use of the phone, Android tucks them away in the status bar. Sliding it down displays your notifications in a really slick way.
 
Android includes a full featured widget framework to extend the user interface. This allows users to have access to information without opening up a new application. This may come at the expense of simplicity, but many enjoy the benefits of widgets. The widget is just a graphical front end that accesses data and can display it to the user as part of the larger interface. This is contrary to the iPhone model that requires an app to be lunched to obtain any information.
 

The Palm strategy

Palm's WebOS was a sort of gambit to combine the usefulness of the Android multitasking ability, with the simplicity of the iPhone. For the most part, it turned out to be successful in doing so. The home screen interface on WebOS is a playground for the so-called "cards" that represent each program. When running an app, users can easily jump back to the home screen. But unlike on a computer, the program doesn't hide itself anywhere. Instead it exists as a card that can be brought back up or closed. Multiple cards can line up horizontally to be selected from. 

Palms first year of WebOS was a rough one that ended with the company being sold to HP. Part of the issue may have been some sluggishness exhibited by WebOS, which was commented on in most reviews. Palm tried a clever user interface trick to alleviate some user frustration. Now when opening an app, instead of the phone only displaying content when it's done loading, it will show an empty card and a glowing icon. It's just a subconscious trick that makes the phone feel faster. Behold the power of clever UI design.

The future

We thought we'd see everything smartphone user interface design had to offer, but when Microsoft showed off Windows Phone 7, we found out we were wrong. It shouldn't come as a surprise, it's not like we saw the iPhone coming either. Windows Phone 7 drops the traditional home screen UI completely. It works on a system of "Hubs" for common functions. The Hubs act as both shortcuts and as a widget of sort that can display pictures or data from within the Hub. Users can scroll vertically to see all their hubs and they can be reordered. 

Content within the Hubs is ordered in a fashion that has the user scrolling horizontally to see all of it. if you've used a Zune HD, you're familiar with the idea. For example, when selecting the People Hub, users are first presented with recent contacts, scrolling to the side will offer the entire contact list.
 
The new iPhone OS has been previewed and is also looking to shake things up. Most of the interface looks the same, but they've added a new user interface for limited multitasking. Double clicking the home button will bring up a list of recent apps. This is similar to the Android launcher, which is accessed from a long-press of the home button. Adding this to the iPhone means less bouncing back to the home screen. App states are saved, but they don't actually run in the background. We feel it will make for a more streamlined user interface. There's also support for folders to help clean up that app list. 
 
Android's moves right now are all about polish. Froyo (2.2) isn't a dramatic departure from 2.1, but it does a lot to make the interface more usable. How? Well, by making it faster to navigate. The Android interface sometimes feels a little inconsistent, and getting around can take too long. One solution is the addition of phone and browser shortcuts that sit at the bottom of the home screen with the launcher. This means no more bouncing back to the home screen to start the browser, or place a call. But having the system respond more quickly (which Froyo does) goes a long way to improving the user experience as well. Google is also looking to get your information more integrated. Contacts have Facebook and Twitter data connected to them, and the photos you see in various apps are linked to all the data you have on that contact. This is a design paradigm we find useful, and it's nice to see Google expanding it.

User interfaces will continue to change as more capable hardware and aster data networks become available. We have no way of knowing what the next iPhone-like UI advancement will be, but we probably won't see it coming. In the coming years, we believe the big challenge will be keeping the mobile UI innovative, without becoming overly complex. Even now, there are times that Android can end up a little too smart for its own good. The use of multitasking is also becoming more pervasive, and we'd like to see a better system for doing it. Palm's method is attractive and easy, but limited. Ideally, a hybrid of Android's background processes and Palm's intuitive interface should happen. Wherever things go, we'll enjoy the ride. Let us know what you consider to be the most important user interface design paradigms in mobile.    
16 Comments
Brenderous online on May 27, 2010
I would enjoy a right-click on my iPhone, I'm just not sure what it would do.
litrock on May 27, 2010
I really hate the rows of apps that the iPhone interface is based around. It feels very mid-90s, when my Windows 95 was a cluster of icons because using shortcuts and pinned taskbars wasn't a thing, and making a good-looking UI was ... well, it was early still. In 2010, it looks atrocious, and while folders will help, it's still not what I'd call a good-looking interface.
Organicalistic_ on May 27, 2010
i would love a windows 7 phone, looks like it navigates like a zune
norman on May 27, 2010
how would you guys change the current smartphone UI paradigm of apps on a home page?
Brenderous online on May 27, 2010
I suppose the way it is now is functional. All the ideas I can think of are merely cosmetic changes. Perhaps I'm too ingrained in the "home page with icons" system.
viderian online on May 27, 2010
@litrock: I agree. I really don't like the icons look.  It looks like an old-school-messy desktop.  Yuck!  I like the "Hub" or "Card" system better but I would have to mess around with it so see if it is actually useful.
will on May 27, 2010
I feel like using the home screen for rows of app icons is a huge missed opportunity on the iPhone. I'd much rather have the info that I need--short-term weather forecast, traffic for my commute, whatever is relevant at the moment I'm using the phone--instead.
lane on May 27, 2010
@norman: 
 
Folders. I've been jailbreaking my iPhone since I got it to use Categories, and I'm glad they're finally building it into the OS. I don't need every single app at my fingertips at all times.
intoblivion on May 27, 2010
@norman: the ability to drag them around anywhere on the screen.
Jadeskye on May 27, 2010
i just want something that won't BBQ my pocket and won't lock up.
Fripplebubby on May 27, 2010
I just want a search bar, with no visual representation of the apps at all. That's why  I don't use icons on my desktop... 
greks224 on May 27, 2010
I just got my Incredible, and while it does take a bit more fidgeting to get things how you want it, the fact that the Android OS can really be made to "how you want it" in the first place is pretty nice. It really feels like "my OS"  when I use it, especially when I compare it to how people have theirs configured.  The level of customization is great, and the ease at which I can use the customization tools is great. Android, for me, is a great best of both worlds only because you can make your OS for how you use it.
eolith on May 29, 2010
Whatever happened to "profiles"? You used to be able to set your phone in "Night" mode, "Car" mode, "quiet" mode, etc. Just one quick switch sets the screen brightness, audio volume, alert settings, power settings, etc.
bored_and_agitated on May 29, 2010
@eolith: I think Nokia might have that copyrighted... 
 
I use a Nokia E71 and the UI serves me well. It does have a bit of a learning curve, but the homescreen has shortcuts to apps (user customizable) and displays whatever information I want/need.
eolith on May 29, 2010
@bored_and_agitated: that hasn't stopped companies before: multi-touch and touchscreens are copyrighted and such. Besides, copyrights only last so long. Agreements could be worked out.
 
I personally plan on hitting the EVO 4G as soon as I get an income (been a stay-at-home dad for 3.5 yrs now) and rocking that Android customizability.
SoulofaRobot on May 30, 2010
I still find it ridiculous that the iPhone OS lock screen is so useless; put something in there... recent email subjects, short term weather forecast, upcoming appointments, notes anything besides just the date. 
  • Type the words above including the space. Get new words?
Errors will go here
Post Reply
Processing....
Popular News
How To Rip DVDs to Play on Any Device—For Free!

Our ultimate DVD copying guide shows you how to use Handbrake to rip discs for playback on your laptop, Xbox, PS3, iPhone, Zune, netbook, iPad, PSP, iPod, and pretty much anything else

Video: How To Build the Best $1500 Gaming PC, Step-by-Step

Do you like saving money? What about playing PC games? Have you ever considered building your own PC? We show you exactly what you need to know to build an awesome $1500 gaming PC.

How To Build an Awesome $500 Windows Home Server

We pick the best parts to build a lean media backup and streaming machine.

Apple iPad Wi-Fi Review

Apple's device isn't magical, but it is going to make the tablet a real category--for better or for worse

Nexus One vs HTC Desire vs HTC Incredible: What's the Difference?

HTC is releasing more Android phones all the time, but is there a difference?

How To Steal Mac OS's Best Features for Windows

Windows 7's Aero is a fine UI, but there are just a few things it's missing. Here's how to steal some of Mac OS's features.

How To Rip a Blu-Ray Movie with Just One Click

The MakeMKV utility decrypts and rips a Blu-Ray disc with just one click, preserving the original video quality of the source file.

How To Stream All of Your Video Files to iPhone and iPad

Get your DVD rips off your computer and play them on a mobile device, without having to convert them beforehand.

Apple Fall Event 2010 Discussion Thread: iPods and AppleTV

Discuss Apple's Fall Event announcements here!

What Are You Playing This Weekend?

The weekend's upon us, and like any good nerds, we're spending the last days of summer holed up in our houses playing board and video games. What are you playing this weekend?

iPod Nano 6G vs 5G: Everything You Need to Know

The iPod nano is ready to go running. Are you?

Your Shiny New Xbox 360 Controller is Already Outdated

Transforming d-pad makes it more than just a cosmetic update.

Everything You Should Know about Apple's New iPod Touch

All views expressed in this deck are the sole property of the internet rumor machine.

Why the Obama Administration's Stance on Piracy Sidesteps Complicated Issues

Addressing an audience of workers in the music industry, Commerce Secretary Gary Locke reaffirmed the Obama administration's commitment to cracking down on media piracy on the Internet.

Living with Technology: Two Mice for One Desktop PC

What would drive a man to use two mice for one computer?

Android Market Roundup: 5 Apps to Put a Smile on Your Phone

It's the weekly Android Market Roundup.

Apple Fall Event 2010 Discussion Thread: iPods and AppleTV

Discuss Apple's Fall Event announcements here!

What Are You Playing This Weekend?

The weekend's upon us, and like any good nerds, we're spending the last days of summer holed up in our houses playing board and video games. What are you playing this weekend?

Your Shiny New Xbox 360 Controller is Already Outdated

Transforming d-pad makes it more than just a cosmetic update.

Never Give Up: Microsoft May Be Working on One More Zune

Just in time for Apple's new iPod Touch announcement, a rumor is brewing indicating that Microsoft is going to give the Zune another go.

Why the Obama Administration's Stance on Piracy Sidesteps Complicated Issues

Addressing an audience of workers in the music industry, Commerce Secretary Gary Locke reaffirmed the Obama administration's commitment to cracking down on media piracy on the Internet.

The New AppleTV: $99, No Apps, All About Streaming

The original AppleTV was a device with an identity crisis. The latest update aims to fix that, and a whole lot more.

Living with Technology: Two Mice for One Desktop PC

What would drive a man to use two mice for one computer?

Everything You Should Know about Apple's New iPod Touch

All views expressed in this deck are the sole property of the internet rumor machine.