TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Overview

We won't keep you in suspense. In the majority of overall averages of our tests, Parallels Desktop is the clear winner running 14-20% faster than VMware Fusion. The one exception is for those that need to run Windows XP, 32-bit on 2 virtual processors, VMware Fusion runs about 10% faster than Parallels Desktop.

Here are the overall conclusions, but you should really look at more of the detail to understand what works best for you. (Note: In all cases except battery life, when looking at the graphs in this article, take note that shorter bars are better.)


Figure 1: Overall Results, Parallels Desktop vs. VMware Fusion

For 32-bit Windows OSes, running under a single virtual processor (the default when you create virtual machines in either product, and therefore, the most commonly used configuration), Parallels Desktop runs both XP and Vista 14% faster than VMware Fusion. (Comparing 3 types of VM launch times, compression, transcoding MP3, 7 types of file and network IO, 3 types of application launches, and 3 application performance tests.)

For 32-bit Windows OSes, running under two virtual processors, VMware Fusion runs XP 10% faster than Parallels Desktop, and Parallels Desktop runs Vista 20% faster than VMware Fusion. (Comparing 3 types of VM launch times, compression, transcoding MP3, 3 types of application launches, and 3 application performance tests.)

For 64-bit Windows Vista, running under two virtual processors, Parallels Desktop runs 15% faster than VMware Fusion. (Compares 3 types of VM launch times, compression, and transcoding MP3.)


Another way to look at this is the color-coding on the results matrix. Green cell coloring means Parallels Desktop was faster than VMware Fusion. Blue cell coloring indicates VMware Fusion was faster than Parallels Desktop. Darkest coloring means faster by 10% or more, medium coloring indicates 1-10% difference, and lightest coloring means less than 1% difference. (Note: Not all tests were run on all configurations, hence the empty cells.)


Figure 2: Test Results Matrix with Coloring
(Note: This is not intended to be read, but to give you an overview of results
by coloring. See the ftp site for the spreadsheet.)

One thing to note: VMware Fusion was several times slower than Parallels Desktop in the Internet Explorer tests (across the board), so we removed IE from the overall analysis to avoid skewing the overall results. See more on this in the Internet Explorer section below.

The Test Suite and Results

In the sections below, we'll walk you through what we tested, and the results for each. These tests are designed to arm you with information to help you make the best decision for your type of use.

For each set of results, you can see the analysis for each model of computer for XP, and for Vista. If you want to see more detail for multiple processors, 64-bit, or on an individual Mac model, you can review the spreadsheet for those details.

For the launch tests (launching the VM, Windows, and Applications), we had the option of an "Adam" test, and a "Successive" test. Adam tests are when the computer has been completely restarted (hence avoiding caching). Successive tests are repeated tests without restarting the machine in between tests, and can benefit from caching. Both mimic real use situations.

The tests used were selected specifically to give a real-world view of what VMware Fusion and Parallels Desktop are like to run for many users. We eliminated those tests that we ran which were so short in time frame (e.g., fast) that we could not create statistically significant results, or that had imperceivable differences.

For some of the analysis, we "normalized" results by dividing the result by the fastest result for that test across all the machine configurations. We did this specifically so that we could make comparisons across different groups, and to be able to give you overview results combining a series of types of tests, and computer models.

Instead of a plain "average" or "mean", overall conclusions are done using a "geomean", which is a specific type of average that focuses on the central results and minimizes outliers. Geomean is the same averaging methodology used by SPEC tests, PCMark, Unixbench, and others, and it helps prevent against minor result skewing. (If you are interested in how it differs from a mean, instead of adding the set of numbers and then dividing the sum by the count of numbers in the set, n, the numbers are multiplied and then the nth root of the resulting product is taken.)

For those interested in the benchmarking methodologies, see the more detailed testing information in Appendix A. For the detailed results of the tests used for the analysis, see Appendix B. Both appendices are available on the MacTech web site.

Launch and CPU Tests

There are three situations in which users commonly launch a virtual machine:

  • Launch the virtual machine from "off" mode, including a full Windows boot
  • Launch the virtual machine from a suspended state, and resume from suspend (Adam)
  • Launch the virtual machine from a suspended state, and resume from suspend (Successive)

For the first test, we started at the Finder and launched the virtualization application, which then immediately launched the virtual machine. The visual feedback is fairly different between Parallels Desktop and VMware Fusion when Windows first starts up. As a result, we focused on timing to the point of actually accomplishing something. In this case, we hovered over the Start button and launched Internet Explorer. The test ended when the home page (a very small locally served page which loaded fast in all environments) was rendered.

The primary difference between the last two types of VM launch test is that the computer is fully rebooted (both the virtual machine as well as Mac OS X) in between the "Adam" tests. The successive tests are launching the virtual machines and restoring them without restarting the Mac in between.

Successive tests benefit from both Mac OS X and possibly virtual machine caching, and are significantly faster. But, you may only see these types of situations if you constantly launching and terminating your virtual machine.

We noticed that while doing these tests, results wildly varied even within the same test machines. To be fair, we did these tests multiple times, and took the best results for each product.

End result for each of these sets of tests (geomean across Mac models) is:

  • Launch the virtual machine including a full Windows boot:

    • XP: Parallels Desktop 11% faster (the actual range was 3-8 seconds faster, fastest test: 44 seconds)

    • Vista: Parallels Desktop 31% faster (range: 9-28 seconds faster, fastest: 32 seconds)

  • Launch the virtual machine, and resume from suspend (Adam)

    • XP: Parallels Desktop 7% faster (range: 1-9 seconds faster, fastest: 23 seconds)

    • Vista: Parallels Desktop 10% faster (range: 1 second slower to 10 seconds faster, fastest: 27 seconds)
  • Launch the virtual machine, and resume from suspend (Successive)

    • XP: Parallels Desktop 22% faster (range: 0-3 seconds faster, fastest: 4 seconds)

    • Vista: Parallels Desktop 17% faster (range: 0-1 seconds faster, fastest: 4 seconds)


Figure 3: Windows OS Launch Performance

Clearly, machines with more memory took far longer to restore, so if you are going in and out of a VM often, you may want to think about using less RAM, not more. In fact, you should just use as little as you need anyway for the best experience under either virtualized environment. (We suggest 1GB for most people.)

There are two CPU performance tests that are commonly run as part of benchmarks, and that we did here as well. These include:

  • Compressing files using the built-in Windows compression tools

    • XP: Parallels Desktop 15% faster (range: 0-3 seconds faster, fastest: 6 seconds)

    • Vista: Parallels Desktop 12% faster (range: 0-2 seconds faster, fastest: 8 seconds)

  • Transcoding an MP3 to a .wav file

    • XP: Parallels Desktop 30% faster (range: 2-6 seconds faster, fastest: 7 seconds)

    • Vista: Parallels Desktop 6% faster (range: 0-1 seconds faster, fastest: 9 seconds)

As a matter of interest, we used compression instead of decompression, because with today's fast computers, decompression is actually much closer to a file copy than it is to CPU work. Compression requires the system to do a good amount of analysis to do the compression, and is therefore a better measurement of CPU.


Figure 4: Virtual Machine CPU Performance

Application Launch Test

Here, we tested two of the most common applications used in virtualized desktop environments: Microsoft Word and Microsoft Outlook. Most applications, including these, launch very quickly with the worst performance being under Vista for Adam launches.

Similar to the OS launch tests, an Adam launch is one where Windows has been completely rebooted, and then given a few minutes to finish its startup process. A successive launch test is done repeatedly without restarting Windows.

Here are the results:

  • Microsoft Word Adam Launch

    • XP: VMware Fusion 8% faster (range: 2 seconds slower to 1 second faster, fastest: 3 seconds)

    • Vista: Parallels Desktop 33% faster (range: 3-6 seconds faster, fastest: 8 seconds)

  • Microsoft Word Successive Launch

    • XP: VMware Fusion 17% faster (range: 0-0.5 seconds faster, fastest: 1.4 seconds)

    • Vista: VMware Fusion 30% faster (range: 0.2-1 seconds faster, fastest: 1.7 seconds)

  • Microsoft Outlook Successive Launch

    • XP: VMware Fusion 1% faster (range: 0.3 seconds slower to 0.25 seconds faster, fastest: 3.4 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.15-1.2 seconds faster, fastest: 2 seconds)


Figure 5: Windows Application Launch Performance



Start | 1 | 2 | 3 | 4
 

Community Search:
MacTech Search:

Software Updates via MacUpdate

WhiteCap 6.7.1 - Visual plug-in for iTun...
WhiteCap is a sleek and sophisticated music visualizer and screensaver that features futuristic, wireframe mesh visuals with dynamic backgrounds and colors. WhiteCap contains thousands of visual... Read more
DiskMaker X 6.0 rc5 - Make a bootable OS...
DiskMaker X (was Lion DiskMaker) helps you to build a bootable drive from the official OS X installer app (the one you download from the Mac App Store). It detects the OS X Install program with... Read more
Lyn 1.9 - Lightweight image browser and...
Lyn is a fast, lightweight image browser and viewer designed for photographers, graphic artists, and Web designers. Featuring an extremely versatile and aesthetically pleasing interface, it delivers... Read more
MacFamilyTree 8.2.1 - Create and explore...
MacFamilyTree gives genealogy a facelift: modern, interactive, convenient and fast. Explore your family tree and your family history in a way generations of chroniclers before you would have loved.... Read more
LaunchBar 6.9 - Powerful file/URL/email...
LaunchBar is an award-winning productivity utility that offers an amazingly intuitive and efficient way to search and access any kind of information stored on your computer or on the Web. It provides... Read more
LaunchBar 6.9 - Powerful file/URL/email...
LaunchBar is an award-winning productivity utility that offers an amazingly intuitive and efficient way to search and access any kind of information stored on your computer or on the Web. It provides... Read more
MacFamilyTree 8.2.1 - Create and explore...
MacFamilyTree gives genealogy a facelift: modern, interactive, convenient and fast. Explore your family tree and your family history in a way generations of chroniclers before you would have loved.... Read more
Spotify 1.0.57.474. - Stream music, crea...
Spotify is a streaming music service that gives you on-demand access to millions of songs. Whether you like driving rock, silky R&B, or grandiose classical music, Spotify's massive catalogue puts... Read more
VOX 2.8.26 - Music player that supports...
VOX just sounds better! The beauty is in its simplicity, yet behind the minimal exterior lies a powerful music player with a ton of features and support for all audio formats you should ever need.... Read more
beaTunes 5.0.1 - Organize your music col...
beaTunes is a full-featured music player and organizational tool for music collections. How well organized is your music library? Are your artists always spelled the same way? Any R.E.M. vs REM?... Read more

Latest Forum Discussions

See All

This War of Mine gets a new ending and m...
This War of Mine just got a big new update, featuring free DLC that adds a new ending to the game, among other exciting changes. The update is celebrating the game's two-year release anniversary. Apart from the new ending, which will be quite... | Read more »
Summon eight new heroes in Fire Emblem H...
Nintendo keeps coming at us with Fire Emblem Heroes updates, and it doesn't look like that trend is stopping anytime soon. The folks behind the game have just announced the new War of the Clerics Voting Gauntlet, expected to start next Tuesday. [... | Read more »
The best deals on the App Store this wee...
iOS publishers are pulling out all the stops this week -- there's a huge number of seriously great games at discounted prices this week. Let's not waste any time and get right down to business. [Read more] | Read more »
The House of da Vinci (Games)
The House of da Vinci 1.0.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0.0 (iTunes) Description: Enter The House of Da Vinci, a new must-try 3D puzzle adventure game. Solve mechanical puzzles, discover hidden... | Read more »
Solve the disappearance of history’s gre...
Blue Brain Games invites you to indulge in an immersive hands-on 3D puzzle adventure in similar vein to The Room series, with its debut release The House of Da Vinci. Set during the historic period of the Italian Renaissance (when Leonardo himself... | Read more »
Age of Rivals (Games)
Age of Rivals 3.3 Device: iOS Universal Category: Games Price: $.99, Version: 3.3 (iTunes) Description: Deep civilization-building strategy in a fast-paced card game! | Read more »
Panthera Frontier (Games)
Panthera Frontier 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: | Read more »
Angry Birds Evolution beginner's gu...
Angry Birds changes things up a fair bit in its latest iteration, Angry Birds Evolution. The familiar sling-shot physics mechanics are still there, but the game now features team-based gameplay, RPG elements, and a new top-down view. With all of... | Read more »
Sega Forever is for the retro game fans
Sega is launching a new retro games service titled Sega Forever, in a move that's sure to delight games enthusiasts with a bit of nostalgia. Sega's releasing five classic games for free. The titles include Sonic the Hedgehog, Phantasy Star II,... | Read more »
The Little Acre (Games)
The Little Acre 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: | Read more »

Price Scanner via MacPrices.net

ABBYY TextGrabber 6 for iOS Implements Instan...
ABBYY has announced the release of TextGrabber 6.0.0, an important feature update to the company’s productivity app developed for iOS and Android devices. TextGrabber 6.0 now offers Real-Time... Read more
vPhone, First Smartphone That Can’t Be Lost,...
Austin, Texas based Hypori has introduced the vPhone, a virtual smartphone that affords every business user the benefits of separate work and personal phones, conveniently delivered on a single... Read more
Save this weekend with 2016 refurbished MacBo...
Apple has dropped prices on Certified Refurbished 2016 15″ and 13″ MacBook Pros by as much as $590 off original MSRP. An Apple one-year warranty is included with each model, and shipping is free: -... Read more
New 27-inch 3.4GHz iMac on sale for $1699, sa...
MacMall has the new 2017 27″ 3.4GHz iMac (MNE92LL/A) in stock and on sale for $1699 including free shipping. Their price is $100 off MSRP. Read more
Clearance 2016 MacBook Pros available for up...
B&H Photo has clearance 2016 13″ and 15″ MacBook Pros in stock today and on sale for up to $400 off original MSRP. Shipping is free, and B&H charges NY & NJ sales tax only: - 15″ 2.7GHz... Read more
Apple Ranks 9th In comScore Top 50 U.S. Digit...
comScore, Inc. has released its monthly ranking of U.S. online activity at the top digital media properties for May 2017 based on data from comScore Media Metrix Multi-Platform. * Entity has... Read more
10.5-inch iPad Pros available for up to $20 o...
B&H Photo has the new 2017 10.5″ iPad Pros available for up to $20 off MSRP including free shipping plus NY & NJ sales tax only: - 64GB iPad Pro WiFi: $649 - 256GB iPad Pro WiFi: $749 - 512GB... Read more
Three Off-The-Beaten-Track iOS Apps That Dese...
One of the great things about using iPads and iPhones is the vast selection of apps available for most anything you want or need to do. The three outlined in this article have been in my core app... Read more
Apple No. 1 Spot In Gartner Top 100 Vendors i...
Gartner, Inc. has unveiled the top global 100 vendors in IT in 2016 based on their revenue across IT (excluding communication services) and component market segments. In the Gartner Global Top 100:... Read more
Clearance iMacs available for up to $300 off...
B&H Photo has clearance 21″ and 27″ Apple iMacs available starting at $949, each including free shipping plus NY & NJ sales tax only: - 27″ 3.3GHz iMac 5K: $1999 $300 off original MSRP - 27″... Read more

Jobs Board

*Apple* News Product Marketing Mgr., Publish...
…organizational consensus on strategy and vision for publisher tools, authoring, and Apple News Format.Carries this strategy and vision across the organization to Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
Security Data Analyst - *Apple* Information...
…data sources need to be collected to allow Information Security to better protect Apple employees and customers from a wide range of threats.Act as the subject matter Read more
Lead *Apple* Solutions Consultant - Apple I...
…integrity, and trust.Success Metrics/Key Performance Indicators:Quantitative* Year over Year growth in Apple Product and Beyond the Box sales in the assigned Point of Read more
*Apple* Solutions Consultant till v%u00E5r...
…ethics, integrity, and trust.Success Metrics/Key Performance Indicators:QuantitativeYear over Year growth in Apple Product and Beyond the Box sales in the assigned Point Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.