TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Application Performance Tests

In many cases, applications today, perform so well and so fast, even under virtualized environments, that anyone would be pleased for small documents and activities. We focused our efforts on larger tasks that were not only large enough to measure, but will also stress the systems to some extent.

For Microsoft Word, we took a very large document and did a global search and replace of about 95,000 items. For Microsoft Excel, we ran a macro that generated a large quantity of random numbers, and filled cells with them. And, for PowerPoint, we had the application render slides with transitions as quickly as possible (all the other PowerPoint tests worked too fast to measure).

  • Word Global Find & Replace

    • XP: Parallels Desktop 4% faster (range: 0.5 seconds slower to 6.5 seconds faster, fastest: 34 seconds)

    • Vista: Parallels Desktop 9% faster (range: 14 seconds slower to 21 seconds faster, fastest: 42 seconds)

  • Excel Macro Test

    • XP: Parallels Desktop 14% faster (range: 0.5-1.6 seconds faster, fastest: 5.5 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.3-1.3 seconds faster, fastest: 4.5 seconds)

  • PowerPoint View slide transitions

    • XP: VMware Fusion 2% faster (range: 0.2 seconds slower to 0.2 seconds faster, fastest: 5.5 seconds)

    • Vista: Both performed almost the same (range: 4.7-5.6 seconds)


    Figure 6: Windows Application Performance

    Many web pages are simple enough that they load very quickly. So, to test the speed of Internet Explorer, we created a large, complex page in HTML loaded from a local LAN server. The page was very long, but used only common HTML elements, (no JavaScript, etc.). But, for whatever reason, VMware Fusion took significantly longer ... sometimes, an order of magnitude longer--across the board. As a result, we removed this test from the overall analysis (the average of averages ... or more technically, the geomean of geomeans) so that it wouldn't skew the overall results.

    The tests performed used the same web page ... with and without SSL.

    • Internet Explorer Load complex web page

      • XP: Parallels Desktop 82% faster (range: 40-60 seconds faster, fastest: 9 seconds)

      • Vista: Parallels Desktop 91% faster (range: 79-126 seconds faster, fastest: 9 seconds)

    • Internet Explorer Load complex web page (SSL)

      • XP: Parallels Desktop 80% faster (range: 40-60 seconds faster, fastest: 11 seconds)

      • Vista: Parallels Desktop 84% faster (range: 54-80 seconds faster, fastest: 10 seconds)


    Figure 7: Internet Explorer Application Performance

    Footprint Tests

    One of the most interesting things in the virtualization market is how little overhead virtualization takes today compared to what it used to. To assess this, we measured in a variety of ways. Specifically, we focused on CPU usage (overall for the Mac), real memory usage (overall for the Mac), and how long the battery would last. CPU and memory usage were measured using "top" (a command line tool that's part of UNIX with a minimum of 50 continuous samples averaged for the result).

    We ran three CPU usage tests. The first test was to boot Windows and let it sit for a few minutes to finish up its startup activities. Once done, CPU use was measured while both the Mac OS X and Windows were sitting idle. The next test studied the same thing except both Microsoft Word and Microsoft Outlook were launched and left sitting idle. The last test explored CPU usage while playing a DVD.

    (Note: For testing the playing of a DVD, we had a bit of a challenge. Parallels Desktop supports the default application for playing DVDs that comes with Windows (Windows Media Player), but we had problems with WMP under VMware Fusion. Their web site also talks about these issues. As a workaround, VMware suggests the open source VLC Player, but we had trouble getting VLC Player to work in Parallels Desktop. It was important for both virtualization environments to use the same application, so we used Media Player Classic for the tests.)

    For the two idle tests, both virtualized environments did very, very well with only 2-5% of the CPU being used. So, while one may be 1/3 or more faster, it's not a significant difference to the user in real terms.

    • CPU use for sitting idle (in %)

      • XP: Parallels Desktop used 1/3rd less CPU (range: 1-8% CPU use)

        Vista: Parallels Desktop used 1/3rd less CPU (range: 1-9% CPU use)

    • CPU use for VM sitting idle with both Word/Outlook (in %)

      • XP: Parallels Desktop used 1/5th less CPU (range: 1-8% CPU use)

      • Vista: Parallels Desktop used 1/7th less CPU (range: 1-10% CPU use)

    • CPU use for play DVD (in %)

      • XP: About the same (range: 3-33% CPU use)

      • Vista: Parallels Desktop used 1/25th less CPU (range: 3-36% CPU use)


    Figure 8: Virtual Machine CPU Usage

    The memory footprint was done for two idle tests, similar to the CPU usage tests above. Here, however, the differences were more meaningful, and would be noticeable to the user. Take note, we're looking at both 1GB and 2GB virtual machines here.

    • Real Memory use for sitting idle (in MB)

      • XP: Parallels Desktop used 48% less RAM (range: 716-1748 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 274-1125 MB less)

    • Real Memory use for VM sitting idle with both Word/Outlook (in MB)

      • XP: Parallels Desktop used 39% less RAM (range: 527-1567 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 257-1109 MB less)


    Figure 9: Virtual Machine Memory Usage

    Take note, Parallels is doing something interesting here with memory allocation: Parallels Desktop only takes memory from Mac OS X when Windows needs it. In other words, if you have a 2GB virtual machine, it will initially take less than 2GB of memory from the Mac, until you've opened enough application or documents that Windows needs the RAM. By contrast, VMware Fusion appears to allocate all the memory for the virtual machine at launch.

    For the exhaust battery test, we ran an "endless loop" macro in Excel that generated random numbers. When approaching the end of battery, Parallels Desktop will pause the virtual machine, and ultimately, the Mac will go into a hibernate mode saving off where things are at. VMware Fusion will suspend the virtual machine before sleeping.

    • Exhaust Battery: Endless Macro in Excel

      • XP: Parallels Desktop battery usage lasted 8% longer (9 minutes longer for 99 min total)

      • Vista: Parallels Desktop battery usage lasted 9% longer (9 minutes longer for 92 min total)


    Figure 10: Virtualized Machine Battery Performance

    File and Network IO Tests

    Originally, we ran file copy tests on all the environments. In analyzing the results, we realized that there was a huge problem. Mac OS X and Windows were interfering, in a good way for typical users, with the results. Both Mac OS X and Windows have some pretty sophisticated caching schemes, but they also made File and Network IO tests unpredictable. As just one example, sometimes a MacBook was faster than a Mac Pro, and other times it was not. In the end, we tossed out the several hundred test times, and re-tested.

    Due to time constraints, the retests focused solely on the MacBook Pro. To avoid the interaction problems with Mac OS X and Windows, we tested using data set sizes that were about the same size as the physical memory, or larger. This prevented the Mac and Windows from any type of caching. The data sets we copied from one location to another were 3.7GB total (two 1.85GB files because we needed to stay below the 2GB file limit).

    The same set of files was used for all the copies so that you can see the differences between the different methods of copying. (Most of which were in the same relative time frame, except for copying to a USB Flash Drive. See the chart.)

    Networking was done via the default NAT setup in both virtualized environments, and the defaults for disk setup for each application were used as well.

    Here were the results:

    • File copy - duplicate on local virtual hard drive

      • XP: Parallels Desktop 31% faster (75 seconds faster, fastest: 165 seconds)

      • Vista: Parallels Desktop 43% faster (137 seconds faster, fastest: 181 seconds)

    • File copy - to local Mac hard drive

      • XP: Parallels Desktop 11% faster (18 seconds faster, fastest: 149 seconds)

      • Vista: VMware Fusion 8% faster (14 seconds faster, fastest: 181 seconds)

    • File copy - from local Mac hard drive

      • XP: Parallels Desktop 36% faster (94 seconds faster, fastest: 167 seconds)

      • Vista: Parallels Desktop 42% faster (134 seconds faster, fastest: 182 seconds)

    • File copy - to LAN Server

      • XP: Parallels Desktop 35% faster (113 seconds faster, fastest: 213 seconds)

      • Vista: Parallels Desktop 16% faster (36 seconds faster, fastest: 186 seconds)

    • File copy - from LAN Server

      • XP: Parallels Desktop 28% faster (70 seconds faster, fastest: 176 seconds)

      • Vista: Parallels Desktop 14% faster (27 seconds faster, fastest: 168 seconds)

    • File copy - to USB Flash Drive

      • XP: Parallels Desktop 6% faster (53 seconds faster, fastest: 774 seconds)

      • Vista: Parallels Desktop 4% faster (37 seconds faster, fastest: 859 seconds)

    • File copy - from USB Flash Drive

      • XP: Parallels Desktop 15% faster (52 seconds faster, fastest: 300 seconds)

      • Vista: VMware Fusion 8% faster (22 seconds faster, fastest: 283 seconds)

    Or, said much better on a graph, it looks like this:


    Figure 11: Virtual Machine File and Network I/O Performance



    Start | 1 | 2 | 3 | 4
  •  
    AAPL
    $98.77
    Apple Inc.
    -0.26
    MSFT
    $44.00
    Microsoft Corpora
    +0.03
    GOOG
    $589.11
    Google Inc.
    -1.49

    MacTech Search:
    Community Search:

    Software Updates via MacUpdate

    OS X Yosemite Wallpaper 1.0 - Desktop im...
    OS X Yosemite Wallpaper is the gorgeous new background image for Apple's upcoming OS X 10.10 Yosemite. This wallpaper is available for all screen resolutions with a source file that measures 5,418... Read more
    Acorn 4.4 - Bitmap image editor. (Demo)
    Acorn is a new image editor built with one goal in mind - simplicity. Fast, easy, and fluid, Acorn provides the options you'll need without any overhead. Acorn feels right, and won't drain your bank... Read more
    Bartender 1.2.20 - Organize your menu ba...
    Bartender lets you organize your menu bar apps. Features: Lets you tidy your menu bar apps how you want. See your menu bar apps when you want. Hide the apps you need to run, but do not need to... Read more
    TotalFinder 1.6.2 - Adds tabs, hotkeys,...
    TotalFinder is a universally acclaimed navigational companion for your Mac. Enhance your Mac's Finder with features so smart and convenient, you won't believe you ever lived without them. Tab-based... Read more
    Vienna 3.0.0 RC 2 :be5265e: - RSS and At...
    Vienna is a freeware and Open-Source RSS/Atom newsreader with article storage and management via a SQLite database, written in Objective-C and Cocoa, for the OS X operating system. It provides... Read more
    VLC Media Player 2.1.5 - Popular multime...
    VLC Media Player is a highly portable multimedia player for various audio and video formats (MPEG-1, MPEG-2, MPEG-4, DivX, MP3, OGG, ...) as well as DVDs, VCDs, and various streaming protocols. It... Read more
    Default Folder X 4.6.7 - Enhances Open a...
    Default Folder X attaches a toolbar to the right side of the Open and Save dialogs in any OS X-native application. The toolbar gives you fast access to various folders and commands. You just click... Read more
    TinkerTool 5.3 - Expanded preference set...
    TinkerTool is an application that gives you access to additional preference settings Apple has built into Mac OS X. This allows to activate hidden features in the operating system and in some of the... Read more
    Audio Hijack Pro 2.11.0 - Record and enh...
    Audio Hijack Pro drastically changes the way you use audio on your computer, giving you the freedom to listen to audio when you want and how you want. Record and enhance any audio with Audio Hijack... Read more
    Intermission 1.1.1 - Pause and rewind li...
    Intermission allows you to pause and rewind live audio from any application on your Mac. Intermission will buffer up to 3 hours of audio, allowing users to skip through any assortment of audio... Read more

    Latest Forum Discussions

    See All

    To The End Review
    To The End Review By Lee Hamlet on July 29th, 2014 Our Rating: :: A VICIOUS CYCLEUniversal App - Designed for iPhone and iPad To The End will test players’ patience, timing, and dedication as they try to navigate all 13 levels in... | Read more »
    Traps n’ Gemstones Review
    Traps n’ Gemstones Review By Campbell Bird on July 28th, 2014 Our Rating: :: CASTLEVANIA JONESUniversal App - Designed for iPhone and iPad Fight mummies, dig tunnels, and ride a runaway minecart to discover ancient secrets in this... | Read more »
    The Phantom PI Mission Apparition Review
    The Phantom PI Mission Apparition Review By Jordan Minor on July 28th, 2014 Our Rating: :: GHOSTS BUSTEDUniversal App - Designed for iPhone and iPad The Phantom PI is an exceedingly clever and well-crafted adventure game.   | Read more »
    More Stubies Are Coming Your Way in a Ne...
    More Stubies Are Coming Your Way in a New Update Posted by Jessica Fisher on July 28th, 2014 [ permalink ] Universal App - Designed for iPhone and iPad | Read more »
    The Great Prank War Review
    The Great Prank War Review By Nadia Oxford on July 28th, 2014 Our Rating: :: PRANKING IS SERIOUS BUSINESSUniversal App - Designed for iPhone and iPad Though short, The Great Prank War offers an interesting and fun mix of action and... | Read more »
    Marvel Contest of Champions Announced at...
    Marvel Contest of Champions Announced at Comic-Con Posted by Jennifer Allen on July 28th, 2014 [ permalink ] Announced over the weekend at San Diego Comic-Con was the fairly exciting looking Marvel Contest of Champions. | Read more »
    Teenage Mutant Ninja Turtles Review
    Teenage Mutant Ninja Turtles Review By Jennifer Allen on July 28th, 2014 Our Rating: :: DULL SWIPINGUniversal App - Designed for iPhone and iPad The pizza power is weak when it comes to this Teenage Mutant Ninja Turtles game.   | Read more »
    Exploration Focused Puzzle Game Beatbudd...
    Exploration Focused Puzzle Game Beatbuddy Set to Make Transition from PC to iOS this September Posted by Jennifer Allen on July 28th, 2014 [ permalink ] | Read more »
    PlanetHD
    PlanetHD By Nadia Oxford on July 28th, 2014 Our Rating: :: SPACE MADNESSUniversal App - Designed for iPhone and iPad PlanetHD will keep players busy for a while, though its unpredictable physics are a handful to deal with.   | Read more »
    This Week at 148Apps: July 21-25, 2014
    Another Week of Expert App Reviews   At 148Apps, we help you sort through the great ocean of apps to find the ones we think you’ll like and the ones you’ll need. Our top picks become Editor’s Choice, our stamp of approval for apps with that little... | Read more »

    Price Scanner via MacPrices.net

    Apple updates MacBook Pros with slightly fast...
    Apple updated 13″ and 15″ Retina MacBook Pros today with slightly faster Haswell processors. 13″ models now ship with 8GB of RAM standard, while 15″ MacBook Pros ship with 16GB across the board. Most... Read more
    Apple drops price on 13″ 2.5GHz MacBook Pro b...
    The Apple Store has dropped their price for the 13″ 2.5GHz MacBook Pro by $100 to $1099 including free shipping. Read more
    Apple drops prices on refurbished 2013 MacBoo...
    The Apple Store has dropped prices on Apple Certified Refurbished 13″ and 15″ 2013 MacBook Pros, with model now available starting at $929. Apple’s one-year warranty is standard, and shipping is free... Read more
    iOS 8 and OS X 10.10 To Support DuckDuckGo As...
    Writing for Quartz, Dan Frommer reports that Apple’s forthcoming iOS 8 and OS X 10.10 operating systems version updates will allow users to select DuckDuckGo as their default search engine. He notes... Read more
    U.K. Hospital Using iPods and iPads To Record...
    British news journal GazetteLive’s. Ian McNeal notes that the old “an apple a day keeps the doctor away” proverb is being turned on its head at http://southtees.nhs.uk/hospitals/james-cook/ James... Read more
    13-inch 2.5GHz MacBook Pro on sale for $1099,...
    Best Buy has the 13″ 2.5GHz MacBook Pro available for $1099.99 on their online store. Choose free shipping or free instant local store pickup (if available). Their price is $100 off MSRP. Price is... Read more
    Roundup of Apple refurbished MacBook Pros, th...
    The Apple Store has Apple Certified Refurbished 13″ and 15″ MacBook Pros available for up to $400 off the cost of new models. Apple’s one-year warranty is standard, and shipping is free. Their prices... Read more
    Record Mac Shipments In Q2/14 Confound Analys...
    A Seeking Alpha Trefis commentary notes that Apple’s fiscal Q3 2014 results released July 22, beat market predictions on earnings, although revenues were slightly lower than anticipated. Apple’s Mac’... Read more
    Intel To Launch Core M Silicon For Use In Not...
    Digitimes’ Monica Chen and Joseph Tsai, report that Intel will launch 14nm-based Core M series processors specifically for use in fanless notebook/tablet 2-in-1 models in Q4 2014, with many models to... Read more
    Apple’s 2014 Back to School promotion: $100 g...
     Apple’s 2014 Back to School promotion includes a free $100 App Store Gift Card with the purchase of any new Mac (Mac mini excluded), or a $50 Gift Card with the purchase of an iPad or iPhone,... Read more

    Jobs Board

    Sr Software Lead Engineer, *Apple* Online S...
    Sr Software Lead Engineer, Apple Online Store Publishing Systems Keywords: Company: Apple Job Code: E3PCAK8MgYYkw Location (City or ZIP): Santa Clara Status: Full Read more
    *Apple* Solutions Consultant (ASC) - Apple (...
    **Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
    Sr. Product Leader, *Apple* Store Apps - Ap...
    **Job Summary** Imagine what you could do here. At Apple , great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring Read more
    *Apple* Solutions Consultant (ASC) - Apple (...
    **Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
    *Apple* Solutions Consultant (ASC) - Apple (...
    **Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
    All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.