TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Overview

We won't keep you in suspense. In the majority of overall averages of our tests, Parallels Desktop is the clear winner running 14-20% faster than VMware Fusion. The one exception is for those that need to run Windows XP, 32-bit on 2 virtual processors, VMware Fusion runs about 10% faster than Parallels Desktop.

Here are the overall conclusions, but you should really look at more of the detail to understand what works best for you. (Note: In all cases except battery life, when looking at the graphs in this article, take note that shorter bars are better.)


Figure 1: Overall Results, Parallels Desktop vs. VMware Fusion

For 32-bit Windows OSes, running under a single virtual processor (the default when you create virtual machines in either product, and therefore, the most commonly used configuration), Parallels Desktop runs both XP and Vista 14% faster than VMware Fusion. (Comparing 3 types of VM launch times, compression, transcoding MP3, 7 types of file and network IO, 3 types of application launches, and 3 application performance tests.)

For 32-bit Windows OSes, running under two virtual processors, VMware Fusion runs XP 10% faster than Parallels Desktop, and Parallels Desktop runs Vista 20% faster than VMware Fusion. (Comparing 3 types of VM launch times, compression, transcoding MP3, 3 types of application launches, and 3 application performance tests.)

For 64-bit Windows Vista, running under two virtual processors, Parallels Desktop runs 15% faster than VMware Fusion. (Compares 3 types of VM launch times, compression, and transcoding MP3.)


Another way to look at this is the color-coding on the results matrix. Green cell coloring means Parallels Desktop was faster than VMware Fusion. Blue cell coloring indicates VMware Fusion was faster than Parallels Desktop. Darkest coloring means faster by 10% or more, medium coloring indicates 1-10% difference, and lightest coloring means less than 1% difference. (Note: Not all tests were run on all configurations, hence the empty cells.)


Figure 2: Test Results Matrix with Coloring
(Note: This is not intended to be read, but to give you an overview of results
by coloring. See the ftp site for the spreadsheet.)

One thing to note: VMware Fusion was several times slower than Parallels Desktop in the Internet Explorer tests (across the board), so we removed IE from the overall analysis to avoid skewing the overall results. See more on this in the Internet Explorer section below.

The Test Suite and Results

In the sections below, we'll walk you through what we tested, and the results for each. These tests are designed to arm you with information to help you make the best decision for your type of use.

For each set of results, you can see the analysis for each model of computer for XP, and for Vista. If you want to see more detail for multiple processors, 64-bit, or on an individual Mac model, you can review the spreadsheet for those details.

For the launch tests (launching the VM, Windows, and Applications), we had the option of an "Adam" test, and a "Successive" test. Adam tests are when the computer has been completely restarted (hence avoiding caching). Successive tests are repeated tests without restarting the machine in between tests, and can benefit from caching. Both mimic real use situations.

The tests used were selected specifically to give a real-world view of what VMware Fusion and Parallels Desktop are like to run for many users. We eliminated those tests that we ran which were so short in time frame (e.g., fast) that we could not create statistically significant results, or that had imperceivable differences.

For some of the analysis, we "normalized" results by dividing the result by the fastest result for that test across all the machine configurations. We did this specifically so that we could make comparisons across different groups, and to be able to give you overview results combining a series of types of tests, and computer models.

Instead of a plain "average" or "mean", overall conclusions are done using a "geomean", which is a specific type of average that focuses on the central results and minimizes outliers. Geomean is the same averaging methodology used by SPEC tests, PCMark, Unixbench, and others, and it helps prevent against minor result skewing. (If you are interested in how it differs from a mean, instead of adding the set of numbers and then dividing the sum by the count of numbers in the set, n, the numbers are multiplied and then the nth root of the resulting product is taken.)

For those interested in the benchmarking methodologies, see the more detailed testing information in Appendix A. For the detailed results of the tests used for the analysis, see Appendix B. Both appendices are available on the MacTech web site.

Launch and CPU Tests

There are three situations in which users commonly launch a virtual machine:

  • Launch the virtual machine from "off" mode, including a full Windows boot
  • Launch the virtual machine from a suspended state, and resume from suspend (Adam)
  • Launch the virtual machine from a suspended state, and resume from suspend (Successive)

For the first test, we started at the Finder and launched the virtualization application, which then immediately launched the virtual machine. The visual feedback is fairly different between Parallels Desktop and VMware Fusion when Windows first starts up. As a result, we focused on timing to the point of actually accomplishing something. In this case, we hovered over the Start button and launched Internet Explorer. The test ended when the home page (a very small locally served page which loaded fast in all environments) was rendered.

The primary difference between the last two types of VM launch test is that the computer is fully rebooted (both the virtual machine as well as Mac OS X) in between the "Adam" tests. The successive tests are launching the virtual machines and restoring them without restarting the Mac in between.

Successive tests benefit from both Mac OS X and possibly virtual machine caching, and are significantly faster. But, you may only see these types of situations if you constantly launching and terminating your virtual machine.

We noticed that while doing these tests, results wildly varied even within the same test machines. To be fair, we did these tests multiple times, and took the best results for each product.

End result for each of these sets of tests (geomean across Mac models) is:

  • Launch the virtual machine including a full Windows boot:

    • XP: Parallels Desktop 11% faster (the actual range was 3-8 seconds faster, fastest test: 44 seconds)

    • Vista: Parallels Desktop 31% faster (range: 9-28 seconds faster, fastest: 32 seconds)

  • Launch the virtual machine, and resume from suspend (Adam)

    • XP: Parallels Desktop 7% faster (range: 1-9 seconds faster, fastest: 23 seconds)

    • Vista: Parallels Desktop 10% faster (range: 1 second slower to 10 seconds faster, fastest: 27 seconds)
  • Launch the virtual machine, and resume from suspend (Successive)

    • XP: Parallels Desktop 22% faster (range: 0-3 seconds faster, fastest: 4 seconds)

    • Vista: Parallels Desktop 17% faster (range: 0-1 seconds faster, fastest: 4 seconds)


Figure 3: Windows OS Launch Performance

Clearly, machines with more memory took far longer to restore, so if you are going in and out of a VM often, you may want to think about using less RAM, not more. In fact, you should just use as little as you need anyway for the best experience under either virtualized environment. (We suggest 1GB for most people.)

There are two CPU performance tests that are commonly run as part of benchmarks, and that we did here as well. These include:

  • Compressing files using the built-in Windows compression tools

    • XP: Parallels Desktop 15% faster (range: 0-3 seconds faster, fastest: 6 seconds)

    • Vista: Parallels Desktop 12% faster (range: 0-2 seconds faster, fastest: 8 seconds)

  • Transcoding an MP3 to a .wav file

    • XP: Parallels Desktop 30% faster (range: 2-6 seconds faster, fastest: 7 seconds)

    • Vista: Parallels Desktop 6% faster (range: 0-1 seconds faster, fastest: 9 seconds)

As a matter of interest, we used compression instead of decompression, because with today's fast computers, decompression is actually much closer to a file copy than it is to CPU work. Compression requires the system to do a good amount of analysis to do the compression, and is therefore a better measurement of CPU.


Figure 4: Virtual Machine CPU Performance

Application Launch Test

Here, we tested two of the most common applications used in virtualized desktop environments: Microsoft Word and Microsoft Outlook. Most applications, including these, launch very quickly with the worst performance being under Vista for Adam launches.

Similar to the OS launch tests, an Adam launch is one where Windows has been completely rebooted, and then given a few minutes to finish its startup process. A successive launch test is done repeatedly without restarting Windows.

Here are the results:

  • Microsoft Word Adam Launch

    • XP: VMware Fusion 8% faster (range: 2 seconds slower to 1 second faster, fastest: 3 seconds)

    • Vista: Parallels Desktop 33% faster (range: 3-6 seconds faster, fastest: 8 seconds)

  • Microsoft Word Successive Launch

    • XP: VMware Fusion 17% faster (range: 0-0.5 seconds faster, fastest: 1.4 seconds)

    • Vista: VMware Fusion 30% faster (range: 0.2-1 seconds faster, fastest: 1.7 seconds)

  • Microsoft Outlook Successive Launch

    • XP: VMware Fusion 1% faster (range: 0.3 seconds slower to 0.25 seconds faster, fastest: 3.4 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.15-1.2 seconds faster, fastest: 2 seconds)


Figure 5: Windows Application Launch Performance



Start | 1 | 2 | 3 | 4
 

Community Search:
MacTech Search:

Software Updates via MacUpdate

LooperSonic (Music)
LooperSonic 1.0 Device: iOS Universal Category: Music Price: $4.99, Version: 1.0 (iTunes) Description: LooperSonic is a multi-track audio looper and recorder that will take your loops to the next level. Use it like a loop pedal to... | Read more »
Space Grunts guide - How to survive
Space Grunts is a fast-paced roguelike from popular iOS developer, Orange Pixel. While it taps into many of the typical roguelike sensibilities, you might still find yourself caught out by a few things. We delved further to find you some helpful... | Read more »
Dreii guide - How to play well with othe...
Dreii is a rather stylish and wonderful puzzle game that’s reminiscent of cooperative games like Journey. If that sounds immensely appealing, then you should immediately get cracking and give it a whirl. We can offer you some tips and tricks on... | Read more »
Kill the Plumber World guide - How to ou...
You already know how to hop around like Mario, but do you know how to defeat him? Those are your marching orders in Kill the Plumber, and it's not always as easy as it looks. Here are some tips to get you started. This is not a seasoned platform... | Read more »
Planar Conquest (Games)
Planar Conquest 1.0 Device: iOS Universal Category: Games Price: $12.99, Version: 1.0 (iTunes) Description: IMPORTANT: Planar Conquest is compatible only with iPad 3 & newer devices, iPhone 5 & newer. It’s NOT compatible with... | Read more »
We talk to Cheetah Mobile about its plan...
Piano Tiles 2 is a fast-paced rhythm action high score chaser out now on iOS and Android. You have to tap a series of black tiles that appear on the screen in time to the music, being careful not to accidentally hit anywhere else. Do that and it's... | Read more »
Ultimate Briefcase guide - How to dodge...
Ultimate Briefcase is a simple but tricky game that’s highly dependent on how fast you can react. We can still offer you a few tips and tricks on how to survive though. Guess what? That’s exactly what we’re going to do now. Take it easy [Read more... | Read more »
SoundPrism Link Edition (Music)
SoundPrism Link Edition 1.0 Device: iOS Universal Category: Music Price: $4.99, Version: 1.0 (iTunes) Description: ***Introductory price for a the first few days after launch - if you're reading this, get it while it's fresh out of... | Read more »
Pre-register now for hack and slasher An...
Fincon, which won Facebook's Studio to Watch award in 2015, has announced that pre-registration is now open for the massive 3.0 update for its award-winning hack and slasher Angel Stone. Angel Stone is a post-apocalyptic action RPG in which the... | Read more »
Google has named Piano Tiles 2 as its Be...
Google has named Piano Tiles 2, which launched back in August last year, as its Best Game of 2015. If you're yet to play it, now's a good time to do so. It's a sequel to the hugely successful viral hit Piano Tiles (Don't Tap the White Tile) but... | Read more »

Price Scanner via MacPrices.net

Apple refurbished 2014 13-inch Retina MacBook...
Apple has Certified Refurbished 2014 13″ Retina MacBook Pros available for up to $400 off original MSRP, starting at $979. An Apple one-year warranty is included with each model, and shipping is free... Read more
Macs available for up to $300 off MSRP, $20 o...
Purchase a new Mac or iPad using Apple’s Education Store and take up to $300 off MSRP. All teachers, students, and staff of any educational institution qualify for the discount. Shipping is free, and... Read more
Watch Super Bowl 50 Live On Your iPad For Fre...
Watch Super Bowl 50 LIVE on the CBS Sports app for iPad and Apple TV. Get the app and then tune in Sunday, February 7, 2016 at 6:30 PM ET to catch every moment of the big game. The CBS Sports app is... Read more
Two-thirds Of All Smart Watches Shipped In 20...
Apple dominated the smart watch market in 2015, accounting for over 12 million units and two-thirds of all shipments according to Canalys market research analysts’ estimates. Samsung returned to... Read more
12-inch 1.2GHz Retina MacBooks on sale for up...
B&H Photo has 12″ 1.2GHz Retina MacBooks on sale for $180 off MSRP. Shipping is free, and B&H charges NY tax only: - 12″ 1.2GHz Gray Retina MacBook: $1499 $100 off MSRP - 12″ 1.2GHz Silver... Read more
12-inch 1.1GHz Gray Retina MacBook on sale fo...
B&H Photo has the 12″ 1.1GHz Gray Retina MacBook on sale for $1199 including free shipping plus NY sales tax only. Their price is $100 off MSRP, and it’s the lowest price available for this model... Read more
Apple now offering full line of Certified Ref...
Apple now has a full line of Certified Refurbished 2015 21″ & 27″ iMacs available for up to $350 off MSRP. Apple’s one-year warranty is standard, and shipping is free. The following models are... Read more
Free GUI Speedometer – The Ultimate Digital D...
Miami, Florida based RMKapps has announced the official release of GUI Speedometer 1.0, their digital dashboard display developed for iOS devices. GUI Speedometer allows users to track their precise... Read more
FutureCalc: Ergonomic iOS Calculator App For...
London, United Kingdom based Independent software developer and entrepreneur, Hovik Melikyan has announced the release and immediate availability of FutureCalc 1.0, his new ergonomic calculator app... Read more
Save up to $600 with Apple refurbished Mac Pr...
Apple has Certified Refurbished Mac Pros available for up to $600 off the cost of new models. An Apple one-year warranty is included with each Mac Pro, and shipping is free. The following... Read more

Jobs Board

*Apple* Subject Matter Expert - Experis (Uni...
This position is for an Apple Subject Matter Expert to assist in developing the architecture, support and services for integration of Apple devices into the domain. Read more
*Apple* Macintosh OSX - Net2Source Inc. (Uni...
…: * Work Authorization : * Contact Number(Best time to reach you) : Skills : Apple Macintosh OSX Location : New York, New York. Duartion : 6+ Months The associate would Read more
Computer Operations Technician ll - *Apple*...
# Web Announcement** Apple Technical Liaison**The George Mason University, Information Technology Services (ITS), Technology Support Services, Desktop Support Read more
Restaurant Manager - Apple Gilroy Inc./Apple...
…in every aspect of daily operation. WHY YOU'LL LIKE IT: You'll be the Big Apple . You'll solve problems. You'll get to show your ability to handle the stress and Read more
Simply Mac *Apple* Specialist- Service Repa...
Simply Mac is the largest premier retailer of Apple products in the nation. In order to support our growing customer base, we are currently looking for a driven Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.