World's Largest Software Testing Marketplace

Software Testing Journal

Subscribe to Software Testing Journal: eMailAlertsEmail Alerts newslettersWeekly Newsletters
Get Software Testing Journal: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn

softwaretesting Authors: XebiaLabs Blog, Jonathan Fries, Anders Wallgren, Pavan Kumar, SmartBear Blog

Related Topics: iPhone Developer, Wireless Technology Magazine, Software Testing Journal

Blog Feed Post

The Trouble With Testing Mobile

Compared to mobile, the worlds of web and desktop apps are mature and stable

We hear it from over and over from countless customers, QA managers and testers:  getting mobile apps tested is tough.

Compared to mobile, the worlds of web and desktop apps are mature and stable:  standards have emerged, the OS and browser universe is more mature, testing tools and best practices have been established (even though they’re always evolving).  Mobile, on the other hand, is still early in its overall lifecycle, so development and testing aren’t yet fully baked.

With that in mind, I came across an article from CNET yesterday titled, Testing the iPhone 3Gs (or why the phone gods hate product testers.  This piece underscores the difficulties that confront companies (even the well-equipped experts at the CNET labs) when trying to test mobile devices and apps.

Eric Franklin, a senior tech editor at CNET, was trying to test the talk time on the new 3Gs… sounds simple enough,  right?  Well, in Eric’s own words, he encountered a number of “roadblocks” and was “slapped back to reality” on more than one occasion.

As mobile matures, more development tools and standards will emerge.  And in time, testing tools and bulletproof practices will evolve.  Until then, building and testing mobile apps for the iPhone, Blackberry, Android and Palm Pre will continue to feel a bit like the wild west.  Take a look at the below pic from CNET’s labs… eerily similar to the ad hoc way many companies developed/testedwebsites and apps in the late 90’s.

The iPhone 3GS during a talk time test. The "Watchmen" DVD is merely there to simulate a user holding the phone to their ear, thereby shutting off the screen. Music from the Zune is being played through both phone mics. (Credit: Eric Franklin/CNET)

What say you?  How do you or your company managed the ever-changing world of mobile without launching something shoddy and disappointing (read as: losing) your customers?

Read the original blog entry...

More Stories By Jennifer Moebius

Jennifer Moebius, Public Relations Manager at uTest, champions media efforts, analyst relations and speaking/awards programs. A media maven and creative writer, Jennifer’s accomplishments include feature articles in BusinessWeek, Fortune, Dow Jones, The New York Times and Investor’s Business Daily. Prior to uTest, Jennifer was Senior Account Executive at boutique PR firm Emerge Public Relations where she managed PR programs for a variety of tech clients including Burton Group, Information Builders, Action Engine, Tizor Systems, good2gether and Harvard Business Publishing.