TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Overview

We won't keep you in suspense. In the majority of overall averages of our tests, Parallels Desktop is the clear winner running 14-20% faster than VMware Fusion. The one exception is for those that need to run Windows XP, 32-bit on 2 virtual processors, VMware Fusion runs about 10% faster than Parallels Desktop.

Here are the overall conclusions, but you should really look at more of the detail to understand what works best for you. (Note: In all cases except battery life, when looking at the graphs in this article, take note that shorter bars are better.)


Figure 1: Overall Results, Parallels Desktop vs. VMware Fusion

For 32-bit Windows OSes, running under a single virtual processor (the default when you create virtual machines in either product, and therefore, the most commonly used configuration), Parallels Desktop runs both XP and Vista 14% faster than VMware Fusion. (Comparing 3 types of VM launch times, compression, transcoding MP3, 7 types of file and network IO, 3 types of application launches, and 3 application performance tests.)

For 32-bit Windows OSes, running under two virtual processors, VMware Fusion runs XP 10% faster than Parallels Desktop, and Parallels Desktop runs Vista 20% faster than VMware Fusion. (Comparing 3 types of VM launch times, compression, transcoding MP3, 3 types of application launches, and 3 application performance tests.)

For 64-bit Windows Vista, running under two virtual processors, Parallels Desktop runs 15% faster than VMware Fusion. (Compares 3 types of VM launch times, compression, and transcoding MP3.)


Another way to look at this is the color-coding on the results matrix. Green cell coloring means Parallels Desktop was faster than VMware Fusion. Blue cell coloring indicates VMware Fusion was faster than Parallels Desktop. Darkest coloring means faster by 10% or more, medium coloring indicates 1-10% difference, and lightest coloring means less than 1% difference. (Note: Not all tests were run on all configurations, hence the empty cells.)


Figure 2: Test Results Matrix with Coloring
(Note: This is not intended to be read, but to give you an overview of results
by coloring. See the ftp site for the spreadsheet.)

One thing to note: VMware Fusion was several times slower than Parallels Desktop in the Internet Explorer tests (across the board), so we removed IE from the overall analysis to avoid skewing the overall results. See more on this in the Internet Explorer section below.

The Test Suite and Results

In the sections below, we'll walk you through what we tested, and the results for each. These tests are designed to arm you with information to help you make the best decision for your type of use.

For each set of results, you can see the analysis for each model of computer for XP, and for Vista. If you want to see more detail for multiple processors, 64-bit, or on an individual Mac model, you can review the spreadsheet for those details.

For the launch tests (launching the VM, Windows, and Applications), we had the option of an "Adam" test, and a "Successive" test. Adam tests are when the computer has been completely restarted (hence avoiding caching). Successive tests are repeated tests without restarting the machine in between tests, and can benefit from caching. Both mimic real use situations.

The tests used were selected specifically to give a real-world view of what VMware Fusion and Parallels Desktop are like to run for many users. We eliminated those tests that we ran which were so short in time frame (e.g., fast) that we could not create statistically significant results, or that had imperceivable differences.

For some of the analysis, we "normalized" results by dividing the result by the fastest result for that test across all the machine configurations. We did this specifically so that we could make comparisons across different groups, and to be able to give you overview results combining a series of types of tests, and computer models.

Instead of a plain "average" or "mean", overall conclusions are done using a "geomean", which is a specific type of average that focuses on the central results and minimizes outliers. Geomean is the same averaging methodology used by SPEC tests, PCMark, Unixbench, and others, and it helps prevent against minor result skewing. (If you are interested in how it differs from a mean, instead of adding the set of numbers and then dividing the sum by the count of numbers in the set, n, the numbers are multiplied and then the nth root of the resulting product is taken.)

For those interested in the benchmarking methodologies, see the more detailed testing information in Appendix A. For the detailed results of the tests used for the analysis, see Appendix B. Both appendices are available on the MacTech web site.

Launch and CPU Tests

There are three situations in which users commonly launch a virtual machine:

  • Launch the virtual machine from "off" mode, including a full Windows boot
  • Launch the virtual machine from a suspended state, and resume from suspend (Adam)
  • Launch the virtual machine from a suspended state, and resume from suspend (Successive)

For the first test, we started at the Finder and launched the virtualization application, which then immediately launched the virtual machine. The visual feedback is fairly different between Parallels Desktop and VMware Fusion when Windows first starts up. As a result, we focused on timing to the point of actually accomplishing something. In this case, we hovered over the Start button and launched Internet Explorer. The test ended when the home page (a very small locally served page which loaded fast in all environments) was rendered.

The primary difference between the last two types of VM launch test is that the computer is fully rebooted (both the virtual machine as well as Mac OS X) in between the "Adam" tests. The successive tests are launching the virtual machines and restoring them without restarting the Mac in between.

Successive tests benefit from both Mac OS X and possibly virtual machine caching, and are significantly faster. But, you may only see these types of situations if you constantly launching and terminating your virtual machine.

We noticed that while doing these tests, results wildly varied even within the same test machines. To be fair, we did these tests multiple times, and took the best results for each product.

End result for each of these sets of tests (geomean across Mac models) is:

  • Launch the virtual machine including a full Windows boot:

    • XP: Parallels Desktop 11% faster (the actual range was 3-8 seconds faster, fastest test: 44 seconds)

    • Vista: Parallels Desktop 31% faster (range: 9-28 seconds faster, fastest: 32 seconds)

  • Launch the virtual machine, and resume from suspend (Adam)

    • XP: Parallels Desktop 7% faster (range: 1-9 seconds faster, fastest: 23 seconds)

    • Vista: Parallels Desktop 10% faster (range: 1 second slower to 10 seconds faster, fastest: 27 seconds)
  • Launch the virtual machine, and resume from suspend (Successive)

    • XP: Parallels Desktop 22% faster (range: 0-3 seconds faster, fastest: 4 seconds)

    • Vista: Parallels Desktop 17% faster (range: 0-1 seconds faster, fastest: 4 seconds)


Figure 3: Windows OS Launch Performance

Clearly, machines with more memory took far longer to restore, so if you are going in and out of a VM often, you may want to think about using less RAM, not more. In fact, you should just use as little as you need anyway for the best experience under either virtualized environment. (We suggest 1GB for most people.)

There are two CPU performance tests that are commonly run as part of benchmarks, and that we did here as well. These include:

  • Compressing files using the built-in Windows compression tools

    • XP: Parallels Desktop 15% faster (range: 0-3 seconds faster, fastest: 6 seconds)

    • Vista: Parallels Desktop 12% faster (range: 0-2 seconds faster, fastest: 8 seconds)

  • Transcoding an MP3 to a .wav file

    • XP: Parallels Desktop 30% faster (range: 2-6 seconds faster, fastest: 7 seconds)

    • Vista: Parallels Desktop 6% faster (range: 0-1 seconds faster, fastest: 9 seconds)

As a matter of interest, we used compression instead of decompression, because with today's fast computers, decompression is actually much closer to a file copy than it is to CPU work. Compression requires the system to do a good amount of analysis to do the compression, and is therefore a better measurement of CPU.


Figure 4: Virtual Machine CPU Performance

Application Launch Test

Here, we tested two of the most common applications used in virtualized desktop environments: Microsoft Word and Microsoft Outlook. Most applications, including these, launch very quickly with the worst performance being under Vista for Adam launches.

Similar to the OS launch tests, an Adam launch is one where Windows has been completely rebooted, and then given a few minutes to finish its startup process. A successive launch test is done repeatedly without restarting Windows.

Here are the results:

  • Microsoft Word Adam Launch

    • XP: VMware Fusion 8% faster (range: 2 seconds slower to 1 second faster, fastest: 3 seconds)

    • Vista: Parallels Desktop 33% faster (range: 3-6 seconds faster, fastest: 8 seconds)

  • Microsoft Word Successive Launch

    • XP: VMware Fusion 17% faster (range: 0-0.5 seconds faster, fastest: 1.4 seconds)

    • Vista: VMware Fusion 30% faster (range: 0.2-1 seconds faster, fastest: 1.7 seconds)

  • Microsoft Outlook Successive Launch

    • XP: VMware Fusion 1% faster (range: 0.3 seconds slower to 0.25 seconds faster, fastest: 3.4 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.15-1.2 seconds faster, fastest: 2 seconds)


Figure 5: Windows Application Launch Performance



Start | 1 | 2 | 3 | 4
 

Community Search:
MacTech Search:

Software Updates via MacUpdate

OmniOutliner Pro 4.2 - Pro version of th...
OmniOutliner Pro is a flexible program for creating, collecting, and organizing information. Give your creativity a kick start by using an application that's actually designed to help you think. It's... Read more
VLC Media Player 2.2.1 - Popular multime...
VLC Media Player is a highly portable multimedia player for various audio and video formats (MPEG-1, MPEG-2, MPEG-4, DivX, MP3, OGG, ...) as well as DVDs, VCDs, and various streaming protocols. It... Read more
Nisus Writer Pro 2.1.1 - Multilingual wo...
Nisus Writer Pro is a powerful multilingual word processor, similar to its entry level products, but brings new features such as table of contents, indexing, bookmarks, widow and orphan control,... Read more
Tinderbox 6.2.0 - Store and organize you...
Tinderbox is a personal content management assistant. It stores your notes, ideas, and plans. It can help you organize and understand them. And Tinderbox helps you share ideas through Web journals... Read more
OmniOutliner 4.2 - Organize your ideas,...
OmniOutliner is a flexible program for creating, collecting, and organizing information. Give your creativity a kick start by using an application that's actually designed to help you think. It's... Read more
Things 2.5.4 - Elegant personal task man...
Things is a task management solution that helps to organize your tasks in an elegant and intuitive way. Things combines powerful features with simplicity through the use of tags and its intelligent... Read more
NeoOffice 2014.10 - Mac-tailored, OpenOf...
NeoOffice is a complete office suite for OS X. With NeoOffice, users can view, edit, and save OpenOffice documents, PDF files, and most Microsoft Word, Excel, and PowerPoint documents. NeoOffice 3.x... Read more
iPhoto Library Manager 4.2 - Manage mult...
iPhoto Library Manager allows you to organize your photos among multiple iPhoto libraries, rather than having to store all of your photos in one giant library. You can browse the photos in all your... Read more
Web Snapper 3.3.8 - Capture entire Web p...
Web Snapper lets you capture Web pages exactly as they appear in your browser. You can send them to a file as images or vector-based, multi-page PDFs. It captures the whole Web page - eliminating the... Read more
TeamViewer 10.0.41404 - Establish remote...
TeamViewer gives you remote control of any computer or Mac over the Internet within seconds, or can be used for online meetings. Find out why more than 200 million users trust TeamViewer! Free for... Read more

Chainsaw Warrior: Lords of the Night has...
It's time to put the Darkness back in its place now that Chainsaw Warrior: Lords of the Night has officially made it to iOS. | Read more »
A World of Ice and Fire Lets You Stalk 2...
George R. R. Martin’s A World of Ice and Fire, by Random House, is a mobile guide to the epic series. The new update gives you the Journeys map feture that will let you track the movements of 25 different characters. But don't worry, you can protect... | Read more »
Gameloft Announces Battle Odyssey, a New...
Battle Odyssey, Gameloft's newest puzzle RPG, is coming to the App Store next week. Set in the world of Pondera, you will need to control the power of the elements to defend the world from evil. You'll be able to entlist over 500 allies to aid you... | Read more »
Fusion - HDR Camera (Photography)
Fusion - HDR Camera 1.0.0 Device: iOS Universal Category: Photography Price: $1.99, Version: 1.0.0 (iTunes) Description: Fusion creates HDR (high dynamic range) photos by capturing different exposures and then combining them into one... | Read more »
Sago Mini Toolbox (Education)
Sago Mini Toolbox 1.1 Device: iOS Universal Category: Education Price: $2.99, Version: 1.1 (iTunes) Description: Come build with the Sago Mini friends! Use a wrench, try a saw, or hammer some nails. From sewing hand puppets to... | Read more »
You Should Probably Grab Hitman GO While...
Hitman GO is a surprisingly cool (yet also incredibly drastic) departure from the Hitman series. It's well worth playing for any puzzle game fans out there, and at the moment you can get your hands - or garrotte if you will - on it for a mere $0.99... | Read more »
IFTTT is Bringing Do Button and Do Note...
IFTTT has announced Do Button and Do Note for the Apple Watch. Do Button lets you make your own personalized button that can connect to things like your Google Drive, control the temperature in your home with Nest Thermostat, or turn the lights on... | Read more »
How Many Days, Hours, and Minutes Are Le...
Countdown, by Yves Tscherry, is now available on the App Store. The app keeps track of countdowns to your favorite things such as someones birthday or days till the New Year. You can display the time in seconds, minutes, hours, days, weeks, months,... | Read more »
The All-New Misfit 2.0 App is Available...
Misfit has just given their app a complete overhaul. Misfit 2.0 now has a brand new interface with a sleek design and is easier to navigate. You'll be able to sync your Misfit device and look up health and fitness information faster than ever before... | Read more »
Halo: Spartan Strike (Games)
Halo: Spartan Strike 1.0 Device: iOS Universal Category: Games Price: $5.99, Version: 1.0 (iTunes) Description: Delve into 30 challenging missions through cities and jungles using a devastating arsenal of weapons, abilities and... | Read more »

Price Scanner via MacPrices.net

TigerText Introduces First Secure Enterprise...
TigerText, a provider of secure, real-time messaging for the enterprise, has announced the launch of TigerText for the Apple Watch. TigerText for the Apple Watch enables users to securely send and... Read more
The Conservation Fund Partners with Apple To...
The Conservation Fund has announced that it will partner with Apple to help protect working forests in the United States. The Apple initiative will conserve more than 36,000 acres of working... Read more
Clearance 13-inch 2.6GHz Retina MacBook Pro a...
B&H Photo has clearance 2014 13″ 2.6GHz/128GB Retina MacBook Pros now available for $1099, or $200 off original MSRP. Shipping is free, and B&H charges NY sales tax only. Read more
Apple refurbished 2014 13-inch Retina MacBook...
The Apple Store has Apple Certified Refurbished 2014 13″ Retina MacBook Pros available for up to $400 off original MSRP, starting at $979. An Apple one-year warranty is included with each model, and... Read more
iMacs on sale for up to $205 off MSRP, NY tax...
B&H Photo has 21″ and 27″ iMacs on sale for up to $205 off MSRP including free shipping plus NY sales tax only: - 21″ 1.4GHz iMac: $1019 $80 off - 21″ 2.7GHz iMac: $1189 $110 off - 21″ 2.9GHz... Read more
Sale! 16GB iPhone 5S for $1 with service
Best Buy is offering 16GB iPhone 5Ss for $1.00 with 2-year activation at a participating cellular provider. Choose free home shipping and activation, or buy online and activate during in-store pickup... Read more
Apple refurbished 2014 MacBook Airs available...
The Apple Store has Apple Certified Refurbished 2014 MacBook Airs available starting at $679. An Apple one-year warranty is included with each MacBook, and shipping is free. These are currently the... Read more
27-inch 3.5GHz 5K iMac on sale for $2349, sav...
 Adorama has the 27″ 3.5GHz 5K iMac in stock today and on sale for $2349 including free shipping plus NY & NJ sales tax only. Their price is $150 off MSRP. For a limited time, Adorama will... Read more
Save up to $380 on an iMac with Apple refurbi...
The Apple Store has Apple Certified Refurbished iMacs available for up to $380 off the cost of new models. Apple’s one-year warranty is standard, and shipping is free: - 27″ 3.5GHz 5K iMac – $2119 $... Read more
iFixIt Teardown Awards 12-IInch Retina MacBoo...
iFixIt has posted its illustrated teardown of the new 12-inch MacBook Retina. They note that this new MacBook is less than half the thickness of the last Apple notebook called just “MacBook” back in... Read more

Jobs Board

*Apple* Watch SW Application Project Manager...
**Job Summary** The Apple Watch software team is looking for an Application Engineering Project Manager to work on new projects for Apple . The successful candidate Read more
*Apple* Solutions Consultant - Retail Sales...
**Job Summary** As an Apple Solutions Consultant (ASC) you are the link between our customers and our products. Your role is to drive the Apple business in a retail Read more
*Apple* Retail - Multiple Positions (US) - A...
Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, you're also the Read more
Technical Project Manager - *Apple* Pay - A...
**Job Summary** Apple Pay is seeking an experienced technical PM to…manage the on boarding of new merchants for the Apple Pay platform in the US Within this role you Read more
Senior Identity Architect - *Apple* Pay - A...
**Job Summary** Apple , Inc. is looking for a highly motivated, innovative and hands-on senior identity architect to join the Apple Pay Engineering team. You will Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.