TweetFollow Us on Twitter

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion

Volume Number: 25 (2009)
Issue Number: 04
Column Tag: Virtualization

Head-to-Head: Parallels Desktop for Mac vs. VMware Fusion (cont.)

How do VMware Fusion and Parallels Desktop for Mac stack up?

by Neil Ticktin, Editor-in-Chief/Publisher

Start | 1 | 2 | 3 | 4

Application Performance Tests

In many cases, applications today, perform so well and so fast, even under virtualized environments, that anyone would be pleased for small documents and activities. We focused our efforts on larger tasks that were not only large enough to measure, but will also stress the systems to some extent.

For Microsoft Word, we took a very large document and did a global search and replace of about 95,000 items. For Microsoft Excel, we ran a macro that generated a large quantity of random numbers, and filled cells with them. And, for PowerPoint, we had the application render slides with transitions as quickly as possible (all the other PowerPoint tests worked too fast to measure).

  • Word Global Find & Replace

    • XP: Parallels Desktop 4% faster (range: 0.5 seconds slower to 6.5 seconds faster, fastest: 34 seconds)

    • Vista: Parallels Desktop 9% faster (range: 14 seconds slower to 21 seconds faster, fastest: 42 seconds)

  • Excel Macro Test

    • XP: Parallels Desktop 14% faster (range: 0.5-1.6 seconds faster, fastest: 5.5 seconds)

    • Vista: Parallels Desktop 13% faster (range: 0.3-1.3 seconds faster, fastest: 4.5 seconds)

  • PowerPoint View slide transitions

    • XP: VMware Fusion 2% faster (range: 0.2 seconds slower to 0.2 seconds faster, fastest: 5.5 seconds)

    • Vista: Both performed almost the same (range: 4.7-5.6 seconds)


    Figure 6: Windows Application Performance

    Many web pages are simple enough that they load very quickly. So, to test the speed of Internet Explorer, we created a large, complex page in HTML loaded from a local LAN server. The page was very long, but used only common HTML elements, (no JavaScript, etc.). But, for whatever reason, VMware Fusion took significantly longer ... sometimes, an order of magnitude longer--across the board. As a result, we removed this test from the overall analysis (the average of averages ... or more technically, the geomean of geomeans) so that it wouldn't skew the overall results.

    The tests performed used the same web page ... with and without SSL.

    • Internet Explorer Load complex web page

      • XP: Parallels Desktop 82% faster (range: 40-60 seconds faster, fastest: 9 seconds)

      • Vista: Parallels Desktop 91% faster (range: 79-126 seconds faster, fastest: 9 seconds)

    • Internet Explorer Load complex web page (SSL)

      • XP: Parallels Desktop 80% faster (range: 40-60 seconds faster, fastest: 11 seconds)

      • Vista: Parallels Desktop 84% faster (range: 54-80 seconds faster, fastest: 10 seconds)


    Figure 7: Internet Explorer Application Performance

    Footprint Tests

    One of the most interesting things in the virtualization market is how little overhead virtualization takes today compared to what it used to. To assess this, we measured in a variety of ways. Specifically, we focused on CPU usage (overall for the Mac), real memory usage (overall for the Mac), and how long the battery would last. CPU and memory usage were measured using "top" (a command line tool that's part of UNIX with a minimum of 50 continuous samples averaged for the result).

    We ran three CPU usage tests. The first test was to boot Windows and let it sit for a few minutes to finish up its startup activities. Once done, CPU use was measured while both the Mac OS X and Windows were sitting idle. The next test studied the same thing except both Microsoft Word and Microsoft Outlook were launched and left sitting idle. The last test explored CPU usage while playing a DVD.

    (Note: For testing the playing of a DVD, we had a bit of a challenge. Parallels Desktop supports the default application for playing DVDs that comes with Windows (Windows Media Player), but we had problems with WMP under VMware Fusion. Their web site also talks about these issues. As a workaround, VMware suggests the open source VLC Player, but we had trouble getting VLC Player to work in Parallels Desktop. It was important for both virtualization environments to use the same application, so we used Media Player Classic for the tests.)

    For the two idle tests, both virtualized environments did very, very well with only 2-5% of the CPU being used. So, while one may be 1/3 or more faster, it's not a significant difference to the user in real terms.

    • CPU use for sitting idle (in %)

      • XP: Parallels Desktop used 1/3rd less CPU (range: 1-8% CPU use)

        Vista: Parallels Desktop used 1/3rd less CPU (range: 1-9% CPU use)

    • CPU use for VM sitting idle with both Word/Outlook (in %)

      • XP: Parallels Desktop used 1/5th less CPU (range: 1-8% CPU use)

      • Vista: Parallels Desktop used 1/7th less CPU (range: 1-10% CPU use)

    • CPU use for play DVD (in %)

      • XP: About the same (range: 3-33% CPU use)

      • Vista: Parallels Desktop used 1/25th less CPU (range: 3-36% CPU use)


    Figure 8: Virtual Machine CPU Usage

    The memory footprint was done for two idle tests, similar to the CPU usage tests above. Here, however, the differences were more meaningful, and would be noticeable to the user. Take note, we're looking at both 1GB and 2GB virtual machines here.

    • Real Memory use for sitting idle (in MB)

      • XP: Parallels Desktop used 48% less RAM (range: 716-1748 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 274-1125 MB less)

    • Real Memory use for VM sitting idle with both Word/Outlook (in MB)

      • XP: Parallels Desktop used 39% less RAM (range: 527-1567 MB less)

      • Vista: Parallels Desktop used 21% less RAM (range: 257-1109 MB less)


    Figure 9: Virtual Machine Memory Usage

    Take note, Parallels is doing something interesting here with memory allocation: Parallels Desktop only takes memory from Mac OS X when Windows needs it. In other words, if you have a 2GB virtual machine, it will initially take less than 2GB of memory from the Mac, until you've opened enough application or documents that Windows needs the RAM. By contrast, VMware Fusion appears to allocate all the memory for the virtual machine at launch.

    For the exhaust battery test, we ran an "endless loop" macro in Excel that generated random numbers. When approaching the end of battery, Parallels Desktop will pause the virtual machine, and ultimately, the Mac will go into a hibernate mode saving off where things are at. VMware Fusion will suspend the virtual machine before sleeping.

    • Exhaust Battery: Endless Macro in Excel

      • XP: Parallels Desktop battery usage lasted 8% longer (9 minutes longer for 99 min total)

      • Vista: Parallels Desktop battery usage lasted 9% longer (9 minutes longer for 92 min total)


    Figure 10: Virtualized Machine Battery Performance

    File and Network IO Tests

    Originally, we ran file copy tests on all the environments. In analyzing the results, we realized that there was a huge problem. Mac OS X and Windows were interfering, in a good way for typical users, with the results. Both Mac OS X and Windows have some pretty sophisticated caching schemes, but they also made File and Network IO tests unpredictable. As just one example, sometimes a MacBook was faster than a Mac Pro, and other times it was not. In the end, we tossed out the several hundred test times, and re-tested.

    Due to time constraints, the retests focused solely on the MacBook Pro. To avoid the interaction problems with Mac OS X and Windows, we tested using data set sizes that were about the same size as the physical memory, or larger. This prevented the Mac and Windows from any type of caching. The data sets we copied from one location to another were 3.7GB total (two 1.85GB files because we needed to stay below the 2GB file limit).

    The same set of files was used for all the copies so that you can see the differences between the different methods of copying. (Most of which were in the same relative time frame, except for copying to a USB Flash Drive. See the chart.)

    Networking was done via the default NAT setup in both virtualized environments, and the defaults for disk setup for each application were used as well.

    Here were the results:

    • File copy - duplicate on local virtual hard drive

      • XP: Parallels Desktop 31% faster (75 seconds faster, fastest: 165 seconds)

      • Vista: Parallels Desktop 43% faster (137 seconds faster, fastest: 181 seconds)

    • File copy - to local Mac hard drive

      • XP: Parallels Desktop 11% faster (18 seconds faster, fastest: 149 seconds)

      • Vista: VMware Fusion 8% faster (14 seconds faster, fastest: 181 seconds)

    • File copy - from local Mac hard drive

      • XP: Parallels Desktop 36% faster (94 seconds faster, fastest: 167 seconds)

      • Vista: Parallels Desktop 42% faster (134 seconds faster, fastest: 182 seconds)

    • File copy - to LAN Server

      • XP: Parallels Desktop 35% faster (113 seconds faster, fastest: 213 seconds)

      • Vista: Parallels Desktop 16% faster (36 seconds faster, fastest: 186 seconds)

    • File copy - from LAN Server

      • XP: Parallels Desktop 28% faster (70 seconds faster, fastest: 176 seconds)

      • Vista: Parallels Desktop 14% faster (27 seconds faster, fastest: 168 seconds)

    • File copy - to USB Flash Drive

      • XP: Parallels Desktop 6% faster (53 seconds faster, fastest: 774 seconds)

      • Vista: Parallels Desktop 4% faster (37 seconds faster, fastest: 859 seconds)

    • File copy - from USB Flash Drive

      • XP: Parallels Desktop 15% faster (52 seconds faster, fastest: 300 seconds)

      • Vista: VMware Fusion 8% faster (22 seconds faster, fastest: 283 seconds)

    Or, said much better on a graph, it looks like this:


    Figure 11: Virtual Machine File and Network I/O Performance



    Start | 1 | 2 | 3 | 4
  •  

    Community Search:
    MacTech Search:

    Software Updates via MacUpdate

    TunnelBear 3.5.1 - Subscription-based pr...
    TunnelBear is a subscription-based virtual private network (VPN) service and companion app, enabling you to browse the internet privately and securely. Features Browse privately - Secure your data... Read more
    Typinator 7.4 - Speedy and reliable text...
    Typinator turbo-charges your typing productivity. Type a little. Typinator does the rest. We've all faced projects that require repetitive typing tasks. With Typinator, you can store commonly used... Read more
    Fantastical 2.4.5 - Create calendar even...
    Fantastical 2 is the Mac calendar you'll actually enjoy using. Creating an event with Fantastical is quick, easy, and fun: Open Fantastical with a single click or keystroke Type in your event... Read more
    Monosnap 3.4.9 - Versatile screenshot ut...
    Monosnap lets you capture screenshots, share files, and record video and .gifs! Features Capture Capture full screen, just part of the screen, or a selected window Make your crop area pixel... Read more
    Skim 1.4.32 - PDF reader and note-taker...
    Skim is a PDF reader and note-taker for OS X. It is designed to help you read and annotate scientific papers in PDF, but is also great for viewing any PDF file. Skim includes many features and has a... Read more
    ForkLift 3.1.1 - Powerful file manager:...
    ForkLift is a powerful file manager and ferociously fast FTP client clothed in a clean and versatile UI that offers the combination of absolute simplicity and raw power expected from a well-executed... Read more
    Direct Mail 5.2.1 - Create and send grea...
    Direct Mail is an easy-to-use, fully-featured email marketing app purpose-built for macOS. Create, send, and track great looking email campaigns that get results. Start your newsletter by selecting... Read more
    Direct Mail 5.2.1 - Create and send grea...
    Direct Mail is an easy-to-use, fully-featured email marketing app purpose-built for macOS. Create, send, and track great looking email campaigns that get results. Start your newsletter by selecting... Read more
    Skim 1.4.32 - PDF reader and note-taker...
    Skim is a PDF reader and note-taker for OS X. It is designed to help you read and annotate scientific papers in PDF, but is also great for viewing any PDF file. Skim includes many features and has a... Read more
    ForkLift 3.1.1 - Powerful file manager:...
    ForkLift is a powerful file manager and ferociously fast FTP client clothed in a clean and versatile UI that offers the combination of absolute simplicity and raw power expected from a well-executed... Read more

    Latest Forum Discussions

    See All

    What mobile gaming can learn from the Ni...
    While Nintendo might not have had things all its own way since it began developing for mobile, one thing it has got right is the release of the Switch. After the disappointment of the WiiU, which I still can't really explain, the Switch felt a... | Read more »
    Programmer of Sonic The Hedgehog launche...
    Japanese programmer Yuji Naka is best known for leading the team that created the original Sonic The Hedgehog. He’s moved on from the speedy blue hero since then, launching his own company based in Tokyo – Prope Games. Legend of Coin is the... | Read more »
    Why doesn't mobile gaming have its...
    The Overwatch League is a pretty big deal. It's an attempt to really push eSports into the mainstream, by turning them into, well, regular sports. But slightly less sweaty. It's a lavish affair with teams from all around the world, and more... | Read more »
    Give Webzen’s new billiard game PoolTime...
    Best known for producing hugely popular MMO titles, South Korean publisher Webzen is now taking aim at a different genre altogether. PoolTime is a realistic eight ball pool simulator, allowing you to compete in real-time matches against players... | Read more »
    Let Them Come Guide - How to survive aga...
    Let Them Come is all about making it as far as possible against overwhelming odds. Check out some of these tips to help you last a little longer in your unwinnable fight: [Read more] | Read more »
    All the best games on sale for iPhone an...
    Happy last day of the week. I hope you've been having a good one. I have. I saw ten doggos today. So because I'm in a good mood, I thought I'd round up all of the best games that are currently on sale on the App Store. [Read more] | Read more »
    The very best games that came out for iP...
    We're getting to the end of the first real, full, proper week of 2018. And in that time we've seen some pretty awesome games landing on the App Store. Of course, we've seen some absolute duffers as well. The sort of games that you look at and... | Read more »
    Rusty Lake Paradise (Games)
    Rusty Lake Paradise 1.4 Device: iOS Universal Category: Games Price: $2.99, Version: 1.4 (iTunes) Description: Jakob, the oldest son of the Eilander family, is returning to Paradise island after his mother passed away. Since her... | Read more »
    Antihero Guide - Sneaky tricks to get ah...
    Games of Antihero start out small and streamlined, but they quickly turn into long strategic conquests as you fight for control of the Victorian-era streets. If you find yourself struggling in the skullduggery department, here are a few things you... | Read more »
    Here's why Niantic pulling Pokemon...
    If there's one thing that Pokemon GO did well, it was bringing people together. I still remember seeing groups of people around the marina near where I live in the weeks after the game came out, all of them trying to grab some water Pokemon. There... | Read more »

    Price Scanner via MacPrices.net

    10″ iPad Pros on sale for $50-$75 off MSRP, n...
    B&H Photo has 10″ and #Apple #iPad Pros on sale for up to $75 off MSRP. Shipping is free, and B&H charges sales tax in NY & NJ only. Note that some sale prices are restricted to certain... Read more
    Apple refurbished Mac minis available startin...
    Apple has restocked Certified Refurbished Mac minis starting at $419. Apple’s one-year warranty is included with each mini, and shipping is free: – 1.4GHz Mac mini: $419 $80 off MSRP – 2.6GHz Mac... Read more
    Amazon offers Silver 13″ Apple MacBook Pros f...
    Amazon has new Silver 2017 13″ #Apple #MacBook Pros on sale today for up to $150 off MSRP, each including free shipping: – 13″ 2.3GHz/128GB Silver MacBook Pro (MPXR2LL/A): $1199.99 $100 off MSRP – 13... Read more
    Sale: 12″ 1.3GHz MacBooks on sale for $1499,...
    B&H Photo has Space Gray and Rose Gold 12″ 1.3GHz #Apple MacBooks on sale for $100 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 12″ 1.3GHz Space... Read more
    Apple offers Certified Refurbished 2017 iMacs...
    Apple has a full line of Certified Refurbished iMacs available for up to $350 off original MSRP. Apple’s one-year warranty is standard, and shipping is free. The following models are available: – 27... Read more
    13″ MacBook Airs on sale for $120-$100 off MS...
    B&H Photo has 2017 13″ 128GB MacBook Airs on sale for $120 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 13″ 1.8GHz/128GB MacBook Air (MQD32LL/A): $... Read more
    15″ Touch Bar MacBook Pros on sale for up to...
    Adorama has Space Gray 15″ MacBook Pros on sale for $200 off MSRP. Shipping is free, and Adorama charges sales tax in NJ and NY only: – 15″ 2.8GHz MacBook Pro Space Gray (MPTR2LL/A): $2199, $200 off... Read more
    21″ 3.4GHz 4K iMac on sale for $1399, $100 of...
    Adorama has the 21″ 3.4GHz 4K #Apple #iMac on sale today for $1399. Their price is $100 off MSRP. Shipping is free, and Adorama charges sales tax in NJ and NY only: – 21″ 3.4GHz 4K iMac (MNE02LL/A... Read more
    B&H offering 13″ Apple MacBook Pros for u...
    B&H Photo has 13″ MacBook Pros on sale for up to $75-$120 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 13-inch 2.3GHz/128GB Space Gray MacBook Pro (... Read more
    B&H continues to offer clearance 2016 15″...
    B&H Photo has clearance 2016 15″ #MacBook Pros available for up to $800 off original MSRP. Shipping is free, and B&H charges NY & NJ sales tax only: – 15″ 2.7GHz Touch Bar MacBook Pro... Read more

    Jobs Board

    Commerce Engineer, *Apple* Media Products -...
    # Commerce Engineer, Apple Media Products Job Number: 113161479 Santa Clara Valley, California, United States Posted: 01-Nov-2017 Weekly Hours: 40.00 **Job Summary** Read more
    *Apple* Retail - Multiple Positions - Apple,...
    Job Description:SalesSpecialist - Retail Customer Service and SalesTransform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
    Site Reliability Engineer, *Apple* Pay - Ap...
    # Site Reliability Engineer, Apple Pay Job Number: 113356036 Santa Clara Valley, California, United States Posted: 12-Jan-2018 Weekly Hours: 40.00 **Job Summary** Read more
    UI Tools and Automation Engineer, *Apple* M...
    # UI Tools and Automation Engineer, Apple Media Products Job Number: 86351939 Santa Clara Valley, California, United States Posted: 11-Jan-2018 Weekly Hours: 40.00 Read more
    *Apple* Retail - Multiple Positions - Apple,...
    Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
    All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.