Tested News

The State of the Modern Smartphone User Interface

Smartphones have changed dramatically in recent years. Lets examine how its UI has evolved.

In the last few years, user interfaces on smart phones have undergone a sort of renaissance. What was once a stylus driven experience reminiscent of a desktop PC, has now become a finger friendly endeavor that offers new design paradigms. The iPhone is largely responsible for driving this change by showing people a phone can be easy to use with a capacitive touchsceen. The big players in the space area all working to provide the best user interface in their own way. Now that we've seen Android 2.2, iPhone OS 4.0, and even some early builds of Windows Phone 7, it's possible to see where user interface is going. 

Let's go over some of the bigger milestones in phone UI design and see what they mean for the future of phones.
 

Know your roots

Not that long ago, most smartphones felt like using small, sluggish PCs. Sure, at the time we thought we were pretty cool toting around our Windows Mobile phones, oblivious that there might be a better way to use a phone. Most methods of interaction in this era relied on having a stylus. UI elements were often small and tucked in corners of the screen. There were also scrollbars aplenty. A stylus is actually a very precise method of interaction when paired with a resistive screen. 

One thing these earlier smartphones understood is the idea of having information easily accessible. Windows Mobile provided a way to run rudimentary widgets (of course we didn't call them that) on the home screen. It was simple to check out weather or your upcoming appointments without actually launching an application.  

RIM was also a player in the early days of the smartphone and brought some useful user interface conventions. The Blackberry has not traditionally relied on any sort of touchscreen display, but rather on a trackball. The Blackberry was aimed almost exclusively at business users at first, so speed was of the essence. The user interface did a good job of making things easily accessible. With just the trackball, functions were no more than a few clicks away. Unfortunately, the Balckberry UI hasn't evolved much since then, and the straight porting of the Blackberry OS to touch devices like the Storm felt ham-handed.
 

The iPhone changes the tone

Until now, touchscreen have been useful in some situations, but no one really wanted to use them as the sole means of controlling a phone if they could avoid it. People wanted buttons and physical keyboards. It would take a man that hates buttons to move smartphone interfaces ahead. When Apple introduced the iPhone, with just a single button that had any effect on the UI, people were skeptical. But little by little the benefits of using a finger on a capacitive touchscreen to control the phone became more apparent. 

Overall, the precision of a capacitive touch screen is not as high as that of a resistive screen. So the idea of cramming lots of controls and menus on the screen was a no-go. Everything need to get a little bigger, and move further apart. This is the basic premise of being "finger-friendly". The iPhone strives to remain as easy to use as possible. This is due in part to the home screen interface. nearly the whole interface is an app launcher. Most of the phone's functions are accessible right there. The home button can be used to bring up a few additional controls (I.e. the iPod or the quick launch bar in OS4), but most of the action happens on the screen.  

The use of capacitive touch also allowed for the use of interface elements like multitouch. Apple may not have invented the idea, but they were the first to make it useful on a mobile phone. We feel like predicating a user interface on having a capacitive touchscreen makes sense. And Google apparently agrees with us.
 

Android borrows some, invents more

Android, which was launched about a year after the iPhone, takes that idea an runs with it. Phone running Google's mobile OS also rely on capacitive touchscreen, but the interface is a more free experience. If a user so chooses, an Android home screen can be utilized just like an iPhone with row upon row of app shortcuts. Though, a pull up menu has the full list of apps. When you tap on one of these shortcuts to launch it, the app fills the screen with a slick animation. 

Returning to the home screen is accomplished with the Home button. This is fairly common in phone user interfaces these days, but Android has something else to bring to the table. Android also uses the idea of the long-press as a substitute for a right-click on a PC. This means fewer UI elements need to be displayed on the screen as they are accessible via long-press only when needed. Long-pressing the home button offers up a list of recent applications as well. We've always been taken with the way the Android UI handles notifications. Unlike the iPhone where they interrupt your use of the phone, Android tucks them away in the status bar. Sliding it down displays your notifications in a really slick way.
 
Android includes a full featured widget framework to extend the user interface. This allows users to have access to information without opening up a new application. This may come at the expense of simplicity, but many enjoy the benefits of widgets. The widget is just a graphical front end that accesses data and can display it to the user as part of the larger interface. This is contrary to the iPhone model that requires an app to be lunched to obtain any information.
 

The Palm strategy

Palm's WebOS was a sort of gambit to combine the usefulness of the Android multitasking ability, with the simplicity of the iPhone. For the most part, it turned out to be successful in doing so. The home screen interface on WebOS is a playground for the so-called "cards" that represent each program. When running an app, users can easily jump back to the home screen. But unlike on a computer, the program doesn't hide itself anywhere. Instead it exists as a card that can be brought back up or closed. Multiple cards can line up horizontally to be selected from. 

Palms first year of WebOS was a rough one that ended with the company being sold to HP. Part of the issue may have been some sluggishness exhibited by WebOS, which was commented on in most reviews. Palm tried a clever user interface trick to alleviate some user frustration. Now when opening an app, instead of the phone only displaying content when it's done loading, it will show an empty card and a glowing icon. It's just a subconscious trick that makes the phone feel faster. Behold the power of clever UI design.

The future

We thought we'd see everything smartphone user interface design had to offer, but when Microsoft showed off Windows Phone 7, we found out we were wrong. It shouldn't come as a surprise, it's not like we saw the iPhone coming either. Windows Phone 7 drops the traditional home screen UI completely. It works on a system of "Hubs" for common functions. The Hubs act as both shortcuts and as a widget of sort that can display pictures or data from within the Hub. Users can scroll vertically to see all their hubs and they can be reordered. 

Content within the Hubs is ordered in a fashion that has the user scrolling horizontally to see all of it. if you've used a Zune HD, you're familiar with the idea. For example, when selecting the People Hub, users are first presented with recent contacts, scrolling to the side will offer the entire contact list.
 
The new iPhone OS has been previewed and is also looking to shake things up. Most of the interface looks the same, but they've added a new user interface for limited multitasking. Double clicking the home button will bring up a list of recent apps. This is similar to the Android launcher, which is accessed from a long-press of the home button. Adding this to the iPhone means less bouncing back to the home screen. App states are saved, but they don't actually run in the background. We feel it will make for a more streamlined user interface. There's also support for folders to help clean up that app list. 
 
Android's moves right now are all about polish. Froyo (2.2) isn't a dramatic departure from 2.1, but it does a lot to make the interface more usable. How? Well, by making it faster to navigate. The Android interface sometimes feels a little inconsistent, and getting around can take too long. One solution is the addition of phone and browser shortcuts that sit at the bottom of the home screen with the launcher. This means no more bouncing back to the home screen to start the browser, or place a call. But having the system respond more quickly (which Froyo does) goes a long way to improving the user experience as well. Google is also looking to get your information more integrated. Contacts have Facebook and Twitter data connected to them, and the photos you see in various apps are linked to all the data you have on that contact. This is a design paradigm we find useful, and it's nice to see Google expanding it.

User interfaces will continue to change as more capable hardware and aster data networks become available. We have no way of knowing what the next iPhone-like UI advancement will be, but we probably won't see it coming. In the coming years, we believe the big challenge will be keeping the mobile UI innovative, without becoming overly complex. Even now, there are times that Android can end up a little too smart for its own good. The use of multitasking is also becoming more pervasive, and we'd like to see a better system for doing it. Palm's method is attractive and easy, but limited. Ideally, a hybrid of Android's background processes and Palm's intuitive interface should happen. Wherever things go, we'll enjoy the ride. Let us know what you consider to be the most important user interface design paradigms in mobile.    
Brenderouson May 27, 2010 at 8:22 a.m.
I would enjoy a right-click on my iPhone, I'm just not sure what it would do.
litrockon May 27, 2010 at 8:48 a.m.
I really hate the rows of apps that the iPhone interface is based around. It feels very mid-90s, when my Windows 95 was a cluster of icons because using shortcuts and pinned taskbars wasn't a thing, and making a good-looking UI was ... well, it was early still. In 2010, it looks atrocious, and while folders will help, it's still not what I'd call a good-looking interface.
Organicalistic_on May 27, 2010 at 9:07 a.m.
i would love a windows 7 phone, looks like it navigates like a zune
norman staff on May 27, 2010 at 9:16 a.m.
how would you guys change the current smartphone UI paradigm of apps on a home page?
Brenderouson May 27, 2010 at 9:43 a.m.
I suppose the way it is now is functional. All the ideas I can think of are merely cosmetic changes. Perhaps I'm too ingrained in the "home page with icons" system.
Viderianon May 27, 2010 at 9:46 a.m.
@litrock: I agree. I really don't like the icons look.  It looks like an old-school-messy desktop.  Yuck!  I like the "Hub" or "Card" system better but I would have to mess around with it so see if it is actually useful.
will staff on May 27, 2010 at 11:33 a.m.
I feel like using the home screen for rows of app icons is a huge missed opportunity on the iPhone. I'd much rather have the info that I need--short-term weather forecast, traffic for my commute, whatever is relevant at the moment I'm using the phone--instead.
lane moderator on May 27, 2010 at 11:36 a.m.
@norman: 
 
Folders. I've been jailbreaking my iPhone since I got it to use Categories, and I'm glad they're finally building it into the OS. I don't need every single app at my fingertips at all times.
intoblivionon May 27, 2010 at 12:30 p.m.
@norman: the ability to drag them around anywhere on the screen.
Jadeskyeon May 27, 2010 at 3:29 p.m.
i just want something that won't BBQ my pocket and won't lock up.
Fripplebubbyon May 27, 2010 at 3:57 p.m.
I just want a search bar, with no visual representation of the apps at all. That's why  I don't use icons on my desktop... 
greks224on May 27, 2010 at 6:10 p.m.
I just got my Incredible, and while it does take a bit more fidgeting to get things how you want it, the fact that the Android OS can really be made to "how you want it" in the first place is pretty nice. It really feels like "my OS"  when I use it, especially when I compare it to how people have theirs configured.  The level of customization is great, and the ease at which I can use the customization tools is great. Android, for me, is a great best of both worlds only because you can make your OS for how you use it.
eolithon May 29, 2010 at 7:36 p.m.
Whatever happened to "profiles"? You used to be able to set your phone in "Night" mode, "Car" mode, "quiet" mode, etc. Just one quick switch sets the screen brightness, audio volume, alert settings, power settings, etc.
bored_and_agitatedon May 29, 2010 at 9:16 p.m.
@eolith: I think Nokia might have that copyrighted... 
 
I use a Nokia E71 and the UI serves me well. It does have a bit of a learning curve, but the homescreen has shortcuts to apps (user customizable) and displays whatever information I want/need.
eolithon May 29, 2010 at 9:21 p.m.
@bored_and_agitated: that hasn't stopped companies before: multi-touch and touchscreens are copyrighted and such. Besides, copyrights only last so long. Agreements could be worked out.
 
I personally plan on hitting the EVO 4G as soon as I get an income (been a stay-at-home dad for 3.5 yrs now) and rocking that Android customizability.
SoulofaRoboton May 30, 2010 at 3:10 p.m.
I still find it ridiculous that the iPhone OS lock screen is so useless; put something in there... recent email subjects, short term weather forecast, upcoming appointments, notes anything besides just the date. 
How To Rip DVDs to Play on Any Device—For Free!

Our ultimate DVD copying guide shows you how to use Handbrake to rip discs for playback on your laptop, Xbox, PS3, iPhone, Zune, netbook, iPad, PSP, iPod, and pretty much anything else

Tested: Apple Mac OS X Lion

The $30 upgrade from Snow Leopard seems like a no-brainer, but that's not the full story. Read the official Tested review.

Apple iPad 2 Review

Our definitive review of the iPad 2.

Tested: Nvidia GeForce GTX 580 Video Card

The green machine comes back swinging.

Apple iPad Wi-Fi Review

Apple's device isn't magical, but it is going to make the tablet a real category--for better or for worse

Video: How To Build the Best $1500 Gaming PC, Step-by-Step

Do you like saving money? What about playing PC games? Have you ever considered building your own PC? We show you exactly what you need to know to build an awesome $1500 gaming PC.

How To Build an Awesome $500 Windows Home Server

We pick the best parts to build a lean media backup and streaming machine.

The Best Android Phone for Your Network (February 2011)

Don't get locked in with the wrong phone.

Living with Technology: Building My Annual Production PC

Is in January yet? Then it’s time for a new production system. Here's what Loyd put in his daily work and gaming rig.

Report: 2GHz Samsung Tablet with 2560x1600 Display at MWC This Month

In one month, the first ARM Cortex-A15 device could be unveiled. Sounds like Samsung will be going all out.

The Best Android Smartphone for Your Network (January 2012)

Can you wait for the next big thing, or is it time to settle?

How Android OEMs Miss the Mark with TV Commercials

A one minute Super Bowl commercial is wasted if the ad doesn't win any converts.

Will These Be the Major Technology Trends of 2012?

A design firm predicts the course of technology for 2012. These are big-picture ideas, not products: you won't find smart fridges or smartphones on the list.

AMD Radeon 7950 Benchmarks Measure Up to GTX 580 Performance

The second-tier 7000 series card offers cooler, quieter performance than the GTX 580 of 2011, but performance between the two is competitive, depending on the game.

How Security Cameras Can Provide Anonymous Shopper Statistics

A video processing company takes security camera footage and turns it into useful data for retailers.

Intel Updates Sandy Bridge Family with 7 New Desktop CPUs

Sandy Bridge gets seven new processors, including a trio of i5 CPUs without built-in HD graphics.

Living with Technology: Building My Annual Production PC

Is in January yet? Then it’s time for a new production system. Here's what Loyd put in his daily work and gaming rig.

Kinect for Windows Launches, Here's How it Differs from Xbox

Kinect for Windows leaves beta, gets an official retail release and a new and improved SDK.

Windows Phone 8 "Apollo" Features Revealed in Insider Video

Pocketnew spills some juicy secrets on the Apollo Windows Phone 7 update, due out late this year. Windows Phone 7 becomes Windows Phone 8.

How Many In-Store Shoppers Actually Check Prices Using Their Phones?

A new study looks at how the ability to compare in-store and online prices affects purchasing decisions.

Neil Young Worked with Steve Jobs on 24-Bit Audio Standard

A famous CEO and a famous musician talked about music, compression and a potential 24-bit iPod.

Report: 2GHz Samsung Tablet with 2560x1600 Display at MWC This Month

In one month, the first ARM Cortex-A15 device could be unveiled. Sounds like Samsung will be going all out.

Here's What's New in Mozilla's Just-Released Firefox 10

Firefox 10 has moved out of beta and into full release. Here's what's different that you should care about.

Microsoft Tweaks Windows 8 File Management Due to User Feedback

In the first of a series of posts based on customer feedback, Microsoft lists some tweaks made to Explorer, the Ribbon, and copying files.