TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Application Performance Tests

In many cases, applications today, perform so well and so fast, even under virtualized environments, that anyone would be pleased for small documents and activities. We focused our efforts on larger tasks that were not only large enough to measure, but will also stress the systems to some extent.

For Microsoft Word, we took a very large document and did a global search and replace of about 95,000 items. For Microsoft Excel, we ran a macro that generated a large quantity of random numbers, and filled cells with them. And, for PowerPoint, we had the application render slides with transitions as quickly as possible (all the other PowerPoint tests worked too fast to measure).

  • Word Global Find & Replace

    • XP: Parallels Desktop 4% faster (range: 0.5 seconds slower to 6.5 seconds faster, fastest: 34 seconds)

    • Vista: Parallels Desktop 9% faster (range: 14 seconds slower to 21 seconds faster, fastest: 42 seconds)

  • Excel Macro Test

    • XP: Parallels Desktop 14% faster (range: 0.5-1.6 seconds faster, fastest: 5.5 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.3-1.3 seconds faster, fastest: 4.5 seconds)

  • PowerPoint View slide transitions

    • XP: VMware Fusion 2% faster (range: 0.2 seconds slower to 0.2 seconds faster, fastest: 5.5 seconds)

    • Vista: Both performed almost the same (range: 4.7-5.6 seconds)


    Figure 6: Windows Application Performance

    Many web pages are simple enough that they load very quickly. So, to test the speed of Internet Explorer, we created a large, complex page in HTML loaded from a local LAN server. The page was very long, but used only common HTML elements, (no JavaScript, etc.). But, for whatever reason, VMware Fusion took significantly longer ... sometimes, an order of magnitude longer--across the board. As a result, we removed this test from the overall analysis (the average of averages ... or more technically, the geomean of geomeans) so that it wouldn't skew the overall results.

    The tests performed used the same web page ... with and without SSL.

    • Internet Explorer Load complex web page

      • XP: Parallels Desktop 82% faster (range: 40-60 seconds faster, fastest: 9 seconds)

      • Vista: Parallels Desktop 91% faster (range: 79-126 seconds faster, fastest: 9 seconds)

    • Internet Explorer Load complex web page (SSL)

      • XP: Parallels Desktop 80% faster (range: 40-60 seconds faster, fastest: 11 seconds)

      • Vista: Parallels Desktop 84% faster (range: 54-80 seconds faster, fastest: 10 seconds)


    Figure 7: Internet Explorer Application Performance

    Footprint Tests

    One of the most interesting things in the virtualization market is how little overhead virtualization takes today compared to what it used to. To assess this, we measured in a variety of ways. Specifically, we focused on CPU usage (overall for the Mac), real memory usage (overall for the Mac), and how long the battery would last. CPU and memory usage were measured using "top" (a command line tool that's part of UNIX with a minimum of 50 continuous samples averaged for the result).

    We ran three CPU usage tests. The first test was to boot Windows and let it sit for a few minutes to finish up its startup activities. Once done, CPU use was measured while both the Mac OS X and Windows were sitting idle. The next test studied the same thing except both Microsoft Word and Microsoft Outlook were launched and left sitting idle. The last test explored CPU usage while playing a DVD.

    (Note: For testing the playing of a DVD, we had a bit of a challenge. Parallels Desktop supports the default application for playing DVDs that comes with Windows (Windows Media Player), but we had problems with WMP under VMware Fusion. Their web site also talks about these issues. As a workaround, VMware suggests the open source VLC Player, but we had trouble getting VLC Player to work in Parallels Desktop. It was important for both virtualization environments to use the same application, so we used Media Player Classic for the tests.)

    For the two idle tests, both virtualized environments did very, very well with only 2-5% of the CPU being used. So, while one may be 1/3 or more faster, it's not a significant difference to the user in real terms.

    • CPU use for sitting idle (in %)

      • XP: Parallels Desktop used 1/3rd less CPU (range: 1-8% CPU use)

        Vista: Parallels Desktop used 1/3rd less CPU (range: 1-9% CPU use)

    • CPU use for VM sitting idle with both Word/Outlook (in %)

      • XP: Parallels Desktop used 1/5th less CPU (range: 1-8% CPU use)

      • Vista: Parallels Desktop used 1/7th less CPU (range: 1-10% CPU use)

    • CPU use for play DVD (in %)

      • XP: About the same (range: 3-33% CPU use)

      • Vista: Parallels Desktop used 1/25th less CPU (range: 3-36% CPU use)


    Figure 8: Virtual Machine CPU Usage

    The memory footprint was done for two idle tests, similar to the CPU usage tests above. Here, however, the differences were more meaningful, and would be noticeable to the user. Take note, we're looking at both 1GB and 2GB virtual machines here.

    • Real Memory use for sitting idle (in MB)

      • XP: Parallels Desktop used 48% less RAM (range: 716-1748 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 274-1125 MB less)

    • Real Memory use for VM sitting idle with both Word/Outlook (in MB)

      • XP: Parallels Desktop used 39% less RAM (range: 527-1567 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 257-1109 MB less)


    Figure 9: Virtual Machine Memory Usage

    Take note, Parallels is doing something interesting here with memory allocation: Parallels Desktop only takes memory from Mac OS X when Windows needs it. In other words, if you have a 2GB virtual machine, it will initially take less than 2GB of memory from the Mac, until you've opened enough application or documents that Windows needs the RAM. By contrast, VMware Fusion appears to allocate all the memory for the virtual machine at launch.

    For the exhaust battery test, we ran an "endless loop" macro in Excel that generated random numbers. When approaching the end of battery, Parallels Desktop will pause the virtual machine, and ultimately, the Mac will go into a hibernate mode saving off where things are at. VMware Fusion will suspend the virtual machine before sleeping.

    • Exhaust Battery: Endless Macro in Excel

      • XP: Parallels Desktop battery usage lasted 8% longer (9 minutes longer for 99 min total)

      • Vista: Parallels Desktop battery usage lasted 9% longer (9 minutes longer for 92 min total)


    Figure 10: Virtualized Machine Battery Performance

    File and Network IO Tests

    Originally, we ran file copy tests on all the environments. In analyzing the results, we realized that there was a huge problem. Mac OS X and Windows were interfering, in a good way for typical users, with the results. Both Mac OS X and Windows have some pretty sophisticated caching schemes, but they also made File and Network IO tests unpredictable. As just one example, sometimes a MacBook was faster than a Mac Pro, and other times it was not. In the end, we tossed out the several hundred test times, and re-tested.

    Due to time constraints, the retests focused solely on the MacBook Pro. To avoid the interaction problems with Mac OS X and Windows, we tested using data set sizes that were about the same size as the physical memory, or larger. This prevented the Mac and Windows from any type of caching. The data sets we copied from one location to another were 3.7GB total (two 1.85GB files because we needed to stay below the 2GB file limit).

    The same set of files was used for all the copies so that you can see the differences between the different methods of copying. (Most of which were in the same relative time frame, except for copying to a USB Flash Drive. See the chart.)

    Networking was done via the default NAT setup in both virtualized environments, and the defaults for disk setup for each application were used as well.

    Here were the results:

    • File copy - duplicate on local virtual hard drive

      • XP: Parallels Desktop 31% faster (75 seconds faster, fastest: 165 seconds)

      • Vista: Parallels Desktop 43% faster (137 seconds faster, fastest: 181 seconds)

    • File copy - to local Mac hard drive

      • XP: Parallels Desktop 11% faster (18 seconds faster, fastest: 149 seconds)

      • Vista: VMware Fusion 8% faster (14 seconds faster, fastest: 181 seconds)

    • File copy - from local Mac hard drive

      • XP: Parallels Desktop 36% faster (94 seconds faster, fastest: 167 seconds)

      • Vista: Parallels Desktop 42% faster (134 seconds faster, fastest: 182 seconds)

    • File copy - to LAN Server

      • XP: Parallels Desktop 35% faster (113 seconds faster, fastest: 213 seconds)

      • Vista: Parallels Desktop 16% faster (36 seconds faster, fastest: 186 seconds)

    • File copy - from LAN Server

      • XP: Parallels Desktop 28% faster (70 seconds faster, fastest: 176 seconds)

      • Vista: Parallels Desktop 14% faster (27 seconds faster, fastest: 168 seconds)

    • File copy - to USB Flash Drive

      • XP: Parallels Desktop 6% faster (53 seconds faster, fastest: 774 seconds)

      • Vista: Parallels Desktop 4% faster (37 seconds faster, fastest: 859 seconds)

    • File copy - from USB Flash Drive

      • XP: Parallels Desktop 15% faster (52 seconds faster, fastest: 300 seconds)

      • Vista: VMware Fusion 8% faster (22 seconds faster, fastest: 283 seconds)

    Or, said much better on a graph, it looks like this:


    Figure 11: Virtual Machine File and Network I/O Performance



    Start | 1 | 2 | 3 | 4
  •  

    Community Search:
    MacTech Search:

    Software Updates via MacUpdate

    Safari Technology Preview 11.1 - The new...
    Safari Technology Preview contains the most recent additions and improvements to WebKit and the latest advances in Safari web technologies. And once installed, you will receive notifications of... Read more
    Google Chrome 61.0.3163.91 - Modern and...
    Google Chrome is a Web browser by Google, created to be a modern platform for Web pages and applications. It utilizes very fast loading of Web pages and has a V8 engine, which is a custom built... Read more
    Dropbox 35.4.20 - Cloud backup and synch...
    Dropbox is an application that creates a special Finder folder that automatically syncs online and between your computers. It allows you to both backup files and keep them up-to-date between systems... Read more
    GraphicConverter 10.5 - $39.95
    GraphicConverter is an all-purpose image-editing program that can import 200 different graphic-based formats, edit the image, and export it to any of 80 available file formats. The high-end editing... Read more
    Chromium 61.0.3163.91 - Fast and stable...
    Chromium is an open-source browser project that aims to build a safer, faster, and more stable way for all Internet users to experience the web. Version 61.0.3163.91: Release notes were unavailable... Read more
    Vitamin-R 2.50 - Personal productivity t...
    Vitamin-R creates the optimal conditions for your brain to work at its best by structuring your work into short bursts of distraction-free, highly focused activity alternating with opportunities for... Read more
    XMind 8 Update 4 - Popular mind mapping...
    XMind is the most popular mind mapping tool. Millions of people use XMind to clarify thinking, manage complex information, run brainstorming and get work organized. It couldn't be easier to get... Read more
    Direct Mail 5.0.1 - Create and send grea...
    Direct Mail is an easy-to-use, fully-featured email marketing app purpose-built for macOS. Create, send, and track great looking email campaigns that get results. Start your newsletter by selecting... Read more
    Quicken 4.6.3 - Complete personal financ...
    Quicken makes managing your money easier than ever. Whether paying bills, upgrading from Windows, enjoying more reliable downloads, or getting expert product help, Quicken's new and improved features... Read more
    Smultron 10.0 - Easy-to-use, powerful te...
    Smultron 10 is an elegant and powerful text editor that is easy to use. You can use Smultron 10 to create or edit any text document. Everything from a web page, a note or a script to any single piece... Read more

    Find out how you can save £35 and win a...
    Nothing raises excitement like a good competition, and we’re thrilled to announce our latest contest. We’ll be sending one lucky reader and a friend to the Summoners War World Arena Championship at Le Comedia in Paris on October 7th. It’s the... | Read more »
    Another Lost Phone: Laura's Story...
    Another Lost Phone: Laura's Story 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: Another Lost Phone is a game about exploring the social life of a young woman whose phone you have just... | Read more »
    The Witness (Games)
    The Witness 1.0 Device: iOS Universal Category: Games Price: $9.99, Version: 1.0 (iTunes) Description: You wake up, alone, on a strange island full of puzzles that will challenge and surprise you. You don't remember who you are, and... | Read more »
    Egg, Inc. guide - how to build your gold...
    Egg, Inc.'s been around for some time now, but don't you believe for one second that this quirky clicker game has gone out of style. The game keeps popping up on Reddit and other community forums thanks to the outlandish gameplay (plus, the... | Read more »
    The best deals on the App Store this wee...
    Good news, everyone! Your favorite day of the week has arrived at last -- it's discount roundup day! This fine Wednesday evening we're gathering up the hottest deals on the App Store. We've got action platformers, we've got puzzle games, we've got... | Read more »
    Morphite (Games)
    Morphite 1.08 Device: iOS Universal Category: Games Price: $7.99, Version: 1.08 (iTunes) Description: | Read more »
    Fitness AR (Healthcare & Fitness)
    Fitness AR 0.1.1 Device: iOS Universal Category: Healthcare & Fitness Price: $2.99, Version: 0.1.1 (iTunes) Description: Explore your Strava bike rides and runs in augmented reality. A beautiful 3D terrain map, powered by Mapbox... | Read more »
    ARise (Games)
    ARise 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: **ARKit only Puzzle game****Chapter 1 available now - More worlds coming soon!** ARise is an experience about perspective. Using the AR... | Read more »
    The best games to play while you wait fo...
    SteamWorld Dig 2 is out this week on PC and Switch, and people are understandably excited. This clever series by Image and Form combines our favorite metroidvania mechanics with an esquisite universe, excellent storytelling, and true wit. While... | Read more »
    Drag'n'Boom beginner's gu...
    Have you ever wanted to burn and pillage a village as a bloodthirsty dragon? If you answered yes to that question, Drag'n'Boom offers you the perfect chance to do so, casting you as an adorable little dragon that wants to set humankind aflame. It... | Read more »

    Price Scanner via MacPrices.net

    $100 off new 2017 13-inch MacBook Airs
    B&H Photo has 2017 13″ MacBook Airs on sale today for $100 off MSRP including free shipping. B&H charges NY & NJ sales tax only: – 13″ 1.8GHz/128GB MacBook Air (MQD32LL/A): $899, $100 off... Read more
    Apple restocks Certified Refurbished 13-inch...
    Apple has Certified Refurbished 2015 13″ MacBook Airs available starting at $719 and 2016 models available starting at $809. An Apple one-year warranty is included with each MacBook, and shipping is... Read more
    Is iPhone X Really The Future Of The Smartpho...
    Should iPhone X even be called a telephone? It does of course support telephony and texting, but its main feature set is oriented to other things. It is also debatable whether it makes any rational... Read more
    OtterBox Announces Full Case Lineup for iPhon...
    Apple revolutionized the smartphone industry 10 years ago with the original iPhone, and OtterBox has set the standard of protection from the very beginning by protecting every generation of iPhone.... Read more
    LifeProof Introduces What’s NEXT Cases for iP...
    LifeProof built its reputation on sleek, ultra-protective iPhone cases. From 360-degree coverage to the first screenless waterproof case, the protection pioneer has always pushed the limits.... Read more
    Apple Refurbished 2016 15-inch MacBook Pros a...
    Apple has Certified Refurbished 2016 15″ Touch Bar MacBook Pros available starting at $1949. An Apple one-year warranty is included with each model, and shipping is free: – 15″ 2.7GHz Touch Bar Space... Read more
    Wednesday deal: 15-inch MacBook Pros for up t...
    B&H Photo has 2017 15″ MacBook Pros on sale for $150-$200 off MSRP. Shipping is free, and B&H charges sales tax in NY & NJ only: – 15″ 2.8GHz MacBook Pro Space Gray: $2199, $200 off MSRP... Read more
    2.6GHz Mac mini on sale for $599, $100 off MS...
    B&H Photo has the 2.6GHz Mac mini (MGEN2LL/A) on sale for $599 including free shipping plus NY sales tax only. Their price is $100 off MSRP. Read more
    Snag a 15-inch 2.2GHz Retina MacBook Pro, App...
    Apple has Certified Refurbished 2015 15″ 2.2GHz Retina MacBook Pros available for $1699. That’s $300 off original MSRP, and it’s the lowest price available for a 15″ MacBook Pro currently offered by... Read more
    Apple Refurbished 3TB Time Capsule for $279,...
    Apple has Certified Refurbished 3TB Time Capsules available for $279 including free shipping plus Apple’s standard one-year warranty. Their price is $120 off MSRP. Read more

    Jobs Board

    Full time *Apple* Hardware Tech needed - ma...
    …high level of attention to detail Ethics, integrity and trust Be a geek & Previous Apple experience a must. Previous Apple Retail or other Apple Specialist Read more
    Development Operations and Site Reliability E...
    Development Operations and Site Reliability Engineer, Apple Payment Gateway Job Number: 57572631 Santa Clara Valley, California, United States Posted: Jul. 27, 2017 Read more
    *Apple* Store - Technical Specialist - Apple...
    …customers purchase our products, you're the one who helps them get more out of their new Apple technology. Your day in the Apple Store is filled with a range of Read more
    *Apple* Retail - Multiple Positions - Apple,...
    Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
    *Apple* News Product Marketing Mgr., Publish...
    Job Summary The Apple News Product Marketing Manager will work closely with a cross-functional group to assist in defining and marketing new features and services. Read more
    All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.