TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Application Performance Tests

In many cases, applications today, perform so well and so fast, even under virtualized environments, that anyone would be pleased for small documents and activities. We focused our efforts on larger tasks that were not only large enough to measure, but will also stress the systems to some extent.

For Microsoft Word, we took a very large document and did a global search and replace of about 95,000 items. For Microsoft Excel, we ran a macro that generated a large quantity of random numbers, and filled cells with them. And, for PowerPoint, we had the application render slides with transitions as quickly as possible (all the other PowerPoint tests worked too fast to measure).

  • Word Global Find & Replace

    • XP: Parallels Desktop 4% faster (range: 0.5 seconds slower to 6.5 seconds faster, fastest: 34 seconds)

    • Vista: Parallels Desktop 9% faster (range: 14 seconds slower to 21 seconds faster, fastest: 42 seconds)

  • Excel Macro Test

    • XP: Parallels Desktop 14% faster (range: 0.5-1.6 seconds faster, fastest: 5.5 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.3-1.3 seconds faster, fastest: 4.5 seconds)

  • PowerPoint View slide transitions

    • XP: VMware Fusion 2% faster (range: 0.2 seconds slower to 0.2 seconds faster, fastest: 5.5 seconds)

    • Vista: Both performed almost the same (range: 4.7-5.6 seconds)


    Figure 6: Windows Application Performance

    Many web pages are simple enough that they load very quickly. So, to test the speed of Internet Explorer, we created a large, complex page in HTML loaded from a local LAN server. The page was very long, but used only common HTML elements, (no JavaScript, etc.). But, for whatever reason, VMware Fusion took significantly longer ... sometimes, an order of magnitude longer--across the board. As a result, we removed this test from the overall analysis (the average of averages ... or more technically, the geomean of geomeans) so that it wouldn't skew the overall results.

    The tests performed used the same web page ... with and without SSL.

    • Internet Explorer Load complex web page

      • XP: Parallels Desktop 82% faster (range: 40-60 seconds faster, fastest: 9 seconds)

      • Vista: Parallels Desktop 91% faster (range: 79-126 seconds faster, fastest: 9 seconds)

    • Internet Explorer Load complex web page (SSL)

      • XP: Parallels Desktop 80% faster (range: 40-60 seconds faster, fastest: 11 seconds)

      • Vista: Parallels Desktop 84% faster (range: 54-80 seconds faster, fastest: 10 seconds)


    Figure 7: Internet Explorer Application Performance

    Footprint Tests

    One of the most interesting things in the virtualization market is how little overhead virtualization takes today compared to what it used to. To assess this, we measured in a variety of ways. Specifically, we focused on CPU usage (overall for the Mac), real memory usage (overall for the Mac), and how long the battery would last. CPU and memory usage were measured using "top" (a command line tool that's part of UNIX with a minimum of 50 continuous samples averaged for the result).

    We ran three CPU usage tests. The first test was to boot Windows and let it sit for a few minutes to finish up its startup activities. Once done, CPU use was measured while both the Mac OS X and Windows were sitting idle. The next test studied the same thing except both Microsoft Word and Microsoft Outlook were launched and left sitting idle. The last test explored CPU usage while playing a DVD.

    (Note: For testing the playing of a DVD, we had a bit of a challenge. Parallels Desktop supports the default application for playing DVDs that comes with Windows (Windows Media Player), but we had problems with WMP under VMware Fusion. Their web site also talks about these issues. As a workaround, VMware suggests the open source VLC Player, but we had trouble getting VLC Player to work in Parallels Desktop. It was important for both virtualization environments to use the same application, so we used Media Player Classic for the tests.)

    For the two idle tests, both virtualized environments did very, very well with only 2-5% of the CPU being used. So, while one may be 1/3 or more faster, it's not a significant difference to the user in real terms.

    • CPU use for sitting idle (in %)

      • XP: Parallels Desktop used 1/3rd less CPU (range: 1-8% CPU use)

        Vista: Parallels Desktop used 1/3rd less CPU (range: 1-9% CPU use)

    • CPU use for VM sitting idle with both Word/Outlook (in %)

      • XP: Parallels Desktop used 1/5th less CPU (range: 1-8% CPU use)

      • Vista: Parallels Desktop used 1/7th less CPU (range: 1-10% CPU use)

    • CPU use for play DVD (in %)

      • XP: About the same (range: 3-33% CPU use)

      • Vista: Parallels Desktop used 1/25th less CPU (range: 3-36% CPU use)


    Figure 8: Virtual Machine CPU Usage

    The memory footprint was done for two idle tests, similar to the CPU usage tests above. Here, however, the differences were more meaningful, and would be noticeable to the user. Take note, we're looking at both 1GB and 2GB virtual machines here.

    • Real Memory use for sitting idle (in MB)

      • XP: Parallels Desktop used 48% less RAM (range: 716-1748 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 274-1125 MB less)

    • Real Memory use for VM sitting idle with both Word/Outlook (in MB)

      • XP: Parallels Desktop used 39% less RAM (range: 527-1567 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 257-1109 MB less)


    Figure 9: Virtual Machine Memory Usage

    Take note, Parallels is doing something interesting here with memory allocation: Parallels Desktop only takes memory from Mac OS X when Windows needs it. In other words, if you have a 2GB virtual machine, it will initially take less than 2GB of memory from the Mac, until you've opened enough application or documents that Windows needs the RAM. By contrast, VMware Fusion appears to allocate all the memory for the virtual machine at launch.

    For the exhaust battery test, we ran an "endless loop" macro in Excel that generated random numbers. When approaching the end of battery, Parallels Desktop will pause the virtual machine, and ultimately, the Mac will go into a hibernate mode saving off where things are at. VMware Fusion will suspend the virtual machine before sleeping.

    • Exhaust Battery: Endless Macro in Excel

      • XP: Parallels Desktop battery usage lasted 8% longer (9 minutes longer for 99 min total)

      • Vista: Parallels Desktop battery usage lasted 9% longer (9 minutes longer for 92 min total)


    Figure 10: Virtualized Machine Battery Performance

    File and Network IO Tests

    Originally, we ran file copy tests on all the environments. In analyzing the results, we realized that there was a huge problem. Mac OS X and Windows were interfering, in a good way for typical users, with the results. Both Mac OS X and Windows have some pretty sophisticated caching schemes, but they also made File and Network IO tests unpredictable. As just one example, sometimes a MacBook was faster than a Mac Pro, and other times it was not. In the end, we tossed out the several hundred test times, and re-tested.

    Due to time constraints, the retests focused solely on the MacBook Pro. To avoid the interaction problems with Mac OS X and Windows, we tested using data set sizes that were about the same size as the physical memory, or larger. This prevented the Mac and Windows from any type of caching. The data sets we copied from one location to another were 3.7GB total (two 1.85GB files because we needed to stay below the 2GB file limit).

    The same set of files was used for all the copies so that you can see the differences between the different methods of copying. (Most of which were in the same relative time frame, except for copying to a USB Flash Drive. See the chart.)

    Networking was done via the default NAT setup in both virtualized environments, and the defaults for disk setup for each application were used as well.

    Here were the results:

    • File copy - duplicate on local virtual hard drive

      • XP: Parallels Desktop 31% faster (75 seconds faster, fastest: 165 seconds)

      • Vista: Parallels Desktop 43% faster (137 seconds faster, fastest: 181 seconds)

    • File copy - to local Mac hard drive

      • XP: Parallels Desktop 11% faster (18 seconds faster, fastest: 149 seconds)

      • Vista: VMware Fusion 8% faster (14 seconds faster, fastest: 181 seconds)

    • File copy - from local Mac hard drive

      • XP: Parallels Desktop 36% faster (94 seconds faster, fastest: 167 seconds)

      • Vista: Parallels Desktop 42% faster (134 seconds faster, fastest: 182 seconds)

    • File copy - to LAN Server

      • XP: Parallels Desktop 35% faster (113 seconds faster, fastest: 213 seconds)

      • Vista: Parallels Desktop 16% faster (36 seconds faster, fastest: 186 seconds)

    • File copy - from LAN Server

      • XP: Parallels Desktop 28% faster (70 seconds faster, fastest: 176 seconds)

      • Vista: Parallels Desktop 14% faster (27 seconds faster, fastest: 168 seconds)

    • File copy - to USB Flash Drive

      • XP: Parallels Desktop 6% faster (53 seconds faster, fastest: 774 seconds)

      • Vista: Parallels Desktop 4% faster (37 seconds faster, fastest: 859 seconds)

    • File copy - from USB Flash Drive

      • XP: Parallels Desktop 15% faster (52 seconds faster, fastest: 300 seconds)

      • Vista: VMware Fusion 8% faster (22 seconds faster, fastest: 283 seconds)

    Or, said much better on a graph, it looks like this:


    Figure 11: Virtual Machine File and Network I/O Performance



    Start | 1 | 2 | 3 | 4
  •  

    Community Search:
    MacTech Search:

    Software Updates via MacUpdate

    Cyberduck 4.7.1 - FTP and SFTP browser....
    Cyberduck is a robust FTP/FTP-TLS/SFTP browser for the Mac whose lack of visual clutter and cleverly intuitive features make it easy to use. Support for external editors and system technologies such... Read more
    PDFpen 7.2 - Edit and annotate PDFs with...
    We're also offering PDFpenPro for 30% off! PDFpen allows users to easily edit PDF's. Add text, images and signatures. Fill out PDF forms. Merge or split PDF documents. Reorder and delete pages. Even... Read more
    Skype 7.9.746 - Voice-over-internet phon...
    Skype allows you to talk to friends, family and co-workers across the Internet without the inconvenience of long distance telephone charges. Using peer-to-peer data transmission technology, Skype... Read more
    Apple GarageBand 10.1 - Complete recordi...
    The new GarageBand is a whole music creation studio right inside your Mac -- complete with keyboard, synths, orchestral and percussion instruments, presets for guitar and voice, an entirely... Read more
    Duplicate Annihilator 5.7.7 - Find and d...
    Duplicate Annihilator takes on the time-consuming task of comparing the images in your iPhoto library using effective algorithms to make sure that no duplicate escapes. Duplicate Annihilator... Read more
    OS X Server 4.1.3 - For OS X 10.10 Yosem...
    Designed for OS X and iOS devices, OS X Server makes it easy to share files, schedule meetings, synchronize contacts, develop software, host your own website, publish wikis, configure Mac, iPhone,... Read more
    Firefox 39.0 - Fast, safe Web browser. (...
    Firefox offers a fast, safe Web browsing experience. Browse quickly, securely, and effortlessly. With its industry-leading features, Firefox is the choice of Web development professionals and casual... Read more
    pwSafe 4.1 - Secure password management...
    pwSafe provides simple and secure password management across devices and computers. pwSafe uses iCloud to keep your password databases backed-up and synced between Macs and iOS devices. It is... Read more
    Kodi 15.0.rc1 - Powerful media center to...
    Kodi (was XBMC) is an award-winning free and open-source (GPL) software media player and entertainment hub that can be installed on Linux, OS X, Windows, iOS, and Android, featuring a 10-foot user... Read more
    Coda 2.5.11 - One-window Web development...
    Coda is a powerful Web editor that puts everything in one place. An editor. Terminal. CSS. Files. With Coda 2, we went beyond expectations. With loads of new, much-requested features, a few surprises... Read more

    This Week at 148Apps: June 29-July 3, 20...
    Into July With 148Apps How do you know what apps are worth your time and money? Just look to the review team at 148Apps. We sort through the chaos and find the apps you're looking for. The ones we love become Editor’s Choice, standing out above the... | Read more »
    Sonic Runners Guide
    Despite its flaws, Sonic Runners' platforming action is actually quite fun. Though it can be a little more complicated than old-school Sonic games. Here's how to make sure you're up to speed when jumping in. [Read more] | Read more »
    Rage of Bahamut is Giving Almost All of...
    The App Store isn't what it used to be back in 2012, so it's not unexpected to see some games changing their structures with the times. Now we can add Rage of Bahamut to that list with the recent announcement that the game is severely cutting back... | Read more »
    Adventures of Pip (Games)
    Adventures of Pip 1.0 Device: iOS iPhone Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: ** ONE WEEK ONLY — 66% OFF! *** “Adventures of Pip is a delightful little platformer full of charm, challenge and impeccable... | Read more »
    Divide By Sheep - Tips, Tricks, and Stre...
    Who would have thought splitting up sheep could be so involved? Anyone who’s played Divide by Sheep, that’s who! While we’re not about to give you complete solutions to everything (because that’s just cheating), we will happily give you some... | Read more »
    NaturalMotion and Zynga Have Started Tea...
    An official sequel to 2012's CSR Racing is officially on the way, with Zynga and NaturalMotion releasing a short teaser trailer to get everyone excited. Well, as excited as one can get from a trailer with no gameplay footage, anyway. [Read more] | Read more »
    Grab a Friend and Pick up Overkill 3, Be...
    Overkill 3 is a pretty enjoyable third-person shooter that was sort of begging for some online multiplayer. Fortunately the begging can stop, because its newest update has added an online co-op mode. [Read more] | Read more »
    Scanner Pro's Newest Update Adds Au...
    Scanner Pro is one of the most popular document scanning apps on iOS, thanks in no small part to its near-constant updates, I'm sure. Now we're up to update number six, and it adds some pretty handy new features. [Read more] | Read more »
    Heroki (Games)
    Heroki 1.0 Device: iOS Universal Category: Games Price: $7.99, Version: 1.0 (iTunes) Description: CLEAR THE SKIES FOR A NEW HERO!The peaceful sky village of Levantia is in danger! The dastardly Dr. N. Forchin and his accomplice,... | Read more »
    Wars of the Roses (Games)
    Wars of the Roses 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: | Read more »

    Price Scanner via MacPrices.net

    Apple refurbished Mac minis available startin...
    The Apple Store has Apple Certified Refurbished 2014 Mac minis available starting at $419. Apple’s one-year warranty is included with each mini, and shipping is free: - 1.4GHz Mac mini: $419 $80 off... Read more
    College Student Deals: Additional $100 off Ma...
    Take an additional $100 off all MacBooks and iMacs at Best Buy Online with their College Students Deals Savings, valid through August 8, 2015. Anyone with a valid .EDU email address can take... Read more
    Sky Atlas Star Walk 2 App For iPhone And iPa...
    Vito Technology, developer of educational apps for Android and iOS, is for a limited time offering free of charge their Star Walk 2, the next generation of the company’s best-selling stargazing guide... Read more
    13-inch 1.6GHz MacBook Air on sale for $849,...
    Amazon has the 2015 13″ 1.6GHz/128GB MacBook Air on sale for $849.99 including free shipping. Their price is $150 off MSRP, and it’s the lowest price available for this model. Read more
    13-inch 2.5GHz MacBook Pro on sale for $999,...
    Adorama has the 13-inch 2.5GHz MacBook Pro on sale for $999 including free shipping plus NY & NJ sales tax only. Their price is $100 off MSRP. Read more
    Updated Mac Price Trackers
    We’ve updated our Mac Price Trackers with the latest information on prices, bundles, and availability on systems from Apple’s authorized internet/catalog resellers: - 15″ MacBook Pros - 13″ MacBook... Read more
    15-inch Retina MacBook Pros on sale for up to...
    B&H Photo has new 2015 15″ Retina MacBook Pros on sale for up to $225 off MSRP including free shipping plus NY sales tax only: - 15″ 2.2GHz Retina MacBook Pro: $1819 $180 off - 15″ 2.5GHz Retina... Read more
    RamDisk4Mac App Helps Run Your Mac Faster And...
    Ever use a RAM disk? If you’ve come to the Mac in the OS X era, likely not. The Classic Mac OS had a RAM disk function built-in, but that was dropped in the conversion to OS X. What is a RAM disk?... Read more
    13-inch 1.6GHz MacBook Air on sale for $849,...
    Best Buy has the 2015 13″ 1.6GHz/128GB MacBook Air on sale for $849.99 on their online store this weekend. Choose free shipping or free local store pickup (if available). Sale price for online orders... Read more
    Apple Refurbished iMacs available for up to $...
    The Apple Store has Apple Certified Refurbished iMacs available for up to $380 off the cost of new models. Apple’s one-year warranty is standard, and shipping is free: - 27″ 3.5GHz 5K iMac – $1949 $... Read more

    Jobs Board

    *Apple* Solutions Consultant - Retail Sales...
    **Job Summary** As an Apple Solutions Consultant (ASC) you are the link between our customers and our products. Your role is to drive the Apple business in a retail Read more
    Senior Payments Security Manager - *Apple*...
    **Job Summary** Apple , Inc. is looking for a highly motivated, innovative and hands-on senior payments security manager to join the Apple Pay security team. You will Read more
    Sr. Technical Services Consultant, *Apple*...
    **Job Summary** Apple Professional Services (APS) has an opening for a senior technical position that contributes to Apple 's efforts for strategic and transactional Read more
    Sr. Payment Program Manager, *Apple* Pay -...
    **Job Summary** Apple Pay is an exciting environment and a…devices in a simple, private and secure way. The Apple Pay Team is looking for an experienced Senior Read more
    Project Manager - *Apple* Pay Security - Ap...
    **Job Summary** The Apple Pay Security team is seeking a highly organized, results-driven Project Manager to drive the development of Apple Pay Security. If you are Read more
    All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.