TweetFollow Us on Twitter

Benchmarks 2
Volume Number:3
Issue Number:9
Column Tag:Mac Cad

Benchmarks Re-visited

By Paul Zarchan, Cambridge, Mass

With the emergence of the Mac 2 and the growing base of useful, easy to use scientific software, the field of desktop engineering will surely grow this year. The purpose of this article is to compare, from an engineering user point of view, the new Mac’s (using a Prodigy 4 as the equivalent of a Mac 2) with their counterparts in the IBM micro world, DEC mini world and IBM mainframe world. First the issue of compilation and linking will be addressed and then standardized benchmarks will be used to compare various machines from both a cost and performance point of view. Most of the non Mac results were provided to me by A. Tetewsky and D. Feenberg. These results will soon be published in Ref. 1.

Compiling and Linking

When using a compiled language for programming, such as FORTRAN, the issue of compile and link times is extremely important. In engineering applications, excessive compile and link times may make it worthwhile to develop engineering software in an interpretive language such as BASIC, and then port it to a compiled language after initial debugging and algorithm development have been completed. If switching languages may not be practical, it may be worthwhile to stay in FORTRAN but develop the engineering software on a computer with faster compilation times. After program development the source code can easily be ported to the computer of interest for final compilation.

Let’s consider an example in finding complex roots of real polynomials. The 144 lines of program source code for this example can be found in Ref. 2. This example, like that of the Butterworth example in Ref. 3, uses single precision arithmetic but unlike the Butterworth example has virtually no input/output code. In this root finding example, a solution is found for a 30th order, well-behaved polynomial. The compile and link times for the 144 lines of code, using MS FORTRAN (both in the Apple and non Apple world), are indicated in Table 1 for a variety of micros.

In this example, compilation and linking were done using a hard disk for the IBM AT and Compaq 386, while in the Macintosh world, compilation and linking were done in RAM. In the IBM world, compiling in RAM is not significantly faster than compiling from the hard disk. This will always be the case since the operating system software, DOS, is written for 64k segmented 8086/8088 processors. Although an operating system which is developed for the 80386 or OS/2 should be better and improve compilation times, it will not be available for at least one year. If history is any guide, the wait time may be significantly longer. In addition, due to memory segmentation and the lack of a FORTRAN editor (a word processor must be used), it may be difficult to fit all necessary engineering tools into RAM. In the Macintosh world, memory is linear and easily expandable with third party upgrades. For example a 512K Mac can be upgraded to 2 Megs for about $500. This permits the creation of a 1.5 Meg recoverable RAM disk which is large enough to fit FORTRAN and many other useful tools into RAM. Therefore, compiling in RAM with a Mac is much faster than compiling from a hard disk.

In addition, in the IBM world one must compile and link before the code can be executed. The user must nurse the computer through the compiling, linking and execution process. In the Macintosh world, linking is dynamic and therefore automatic from a user point of view. The user simply double clicks on “compile and execute” and the source code compiles, links and runs.

The execution time for this complex root finding example for a variety of micros appears in Table 2. In this example all the micros with the exception of the Mac Plus had math coprocessors.

The Table shows that, for this example, the Prodigy 4 is about 10 times faster than a Mac Plus, more than 5 times faster than an IBM AT and 2.5 times faster than a Compaq 386. In the IBM world, with the exception of the PC, the math coprocessor never seems to run at the same clock rate as the CPU. That is why for this example, an AT and PC (where the math coprocessor is matched to the CPU at 4.77 MHz) have similar execution times. The Compaq 386 is only twice as fast as the AT even though the Compaq has 32 bits rather than 16 bits and runs at 16 Mhz rather than 6 Mhz. In principal, when the IBM operating system software is written and a 16 MHz Intel 80387 math coprocessor becomes available, it should be in the same speed class as the Prodigy 4. Interestingly enough, the Compaq 386 is rated at 3.5 MIPs while the Prodigy 4 is only rated at 2.0 MIPs. We can see that in numerical applications, MIP ratings may not tell the whole story (see Ref. 4 for example).

Often the user may only be interested in the turn around time, which is the sum of the compile, link and execution times. For this example we can see by comparing Tables 1 and 2 that the turn around times are significantly better in the Macintosh world. Table 3 summarizes the results for the complex root example.

The sample problem only had 144 lines of FORTRAN code. If we consider a “traveling salesman” program using 1500 lines of FORTRAN code, the comparison of compile and linking times are even more dramatic. Table 4 shows that the Macintosh and Prodigy 4 are considerably faster for larger programs than either the IBM AT or Compaq 386.

Whetstone Benchmarking

The Whetstone benchmark, devised in England by Curnow and Wichman in the Feb. 1976 issue of the Computer Journal, is an attempt to cover a typical mix of all floating point operations. This benchmark contains linear arrays, and add, subtract, multiply, divide and transcendental operations. Whetstones were originally written in ALGOL, but later translated to FORTRAN in 1979 by D. Frank. Since that time, many computer manufacturers have rated their machines in terms of thousands of Whetstones per second or kw/sec. Higher Whetstone ratings mean more powerful machines. Table 5 presents single and double Whetstone ratings for a variety of micro, mini and mainframe computers. In addition, ratios referenced to Prodigy 4 speed are indicated in the Table. A ratio of 1.7 means that the computer is 1.7 times faster than the Prodigy 4. All computers, with the exception of the Mac Plus, have math coprocessors or floating point accelerators. The poor double precision Whetstone rating of the Mac Plus may, relative to the IBM PC, may be one of the reasons there has been a scarcity of scientific software for the Mac. Of course, we can see from this Table that the Prodigy 4 and hence new Mac 2 changes all that.

The Whetstone results of Table 5 (with no I/O) can be compared to the Butterworth simulation results( with considerable I/O and more representative of a realistic engineering application) of Ref. 3. Figure 1 shows that all the benchmarks, whether they be Whetstones or Butterworth simulations, yield about the same relative machine performance. Only the Mac Plus seems to yields results which are significantly benchmark dependent. It yields worse performance on the Whetstones because of it’s lack of a math coprocessor.

Figure 1 - Relative Machine Performance is Approximately Independent of Benchmark

The performance comparison of Fig. 1 can be placed into proper perspective when the cost of the host computer is considered. For simplicity, computer cost can be considered to be the machines purchase price only. This neglects the cost of the small army of technicians required to operate the larger machines and the cost of software leasing agreements. We can see from Fig. 2 that generally higher cost computers yield faster performance. However the cost is not always commensurate with the performance. For example, a VAX 11/780 is only 1.5 times as fast as a Prodigy 4 and yet is 40 times more expensive. An IBM 3084Q is 11.7 times faster than a Prodigy 4 and is 500 times more expensive. On the micro side an IBM RT is 2.5 times slower than a Prodigy 4 and yet costs twice as much.

Figure 2 - Micros are More Cost Effective Than Larger Machines

If we normalize the computer performance as measured by double precision whetstones per second to the computer purchase price we can generate “bang for the buck” information. More “bang for the buck” means that the computer yields a higher double precision Whetstone rating for less cost. Figure 3 presents this cost effectiveness information and shows that the Compaq 386, Prodigy 4 and Micro Vax 2 are very cost effective, with the Prodigy 4 yielding the most “bang for the buck”. The curve also indicates that if a micro can do the job, it is more cost effective from a performance point of view than a mainframe.

Figure 3 - Prodigy 4 Outperforms Every Other Computer

Summary

The intent of this article was to show that FORTRAN runs very efficiently on the Prodigy 4 (and hence Mac 2) when compared to non Apple micros. When compilation and linking times are taken into account, the comparison is even more dramatic. A relative performance curve is presented quantifying “bang for the buck” information for a variety of micros, minis and mainframes. As expected, the new Mac 2 appears to out- perform every other computer.

Acknowledgements

I wish to thank Micro/Systems, Av Tetewsky and Dan Feenberg for permitting me to extract from Ref. 1 the benchmark timings on all the non Apple machines and for providing the technical explanation for the “features” of the various DOS machines. In addition, I would like to thank Owen Deutsch, for providing me with the “travelling salesman” FORTRAN code.

References

1) Tetewsky, A. and Feenberg, D. “A Survey of 6 FORTRAN Compilers” to appear in Sept. 1987 edition of Micro/Systems Journal.

2) Press, N. H. et al, “Numerical Recipes The Art of Scientific Computation”, Cambridge University Press, 1986.

3) Zarchan, P. “New Mac Workstation Potential”, MacTutor, Vol. 3, No. 3, March 1987, pp 15-21.

4) Boston Computer Society IBM PC Report, “PC Technical Report: MIPs, MFlops, Benchmarks and Other Half-Truths”, May-June 1987.

5) Marshall, T., Jones, C., and Kluger, S. “Definicon 68020 Coprocessor”, BYTE, July 1986, pp 120-144.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

Amazon Chime 4.0.5528 - Amazon-based com...
Amazon Chime is a communications service that transforms online meetings with a secure, easy-to-use application that you can trust. Amazon Chime works seamlessly across your devices so that you can... Read more
Sparkle 2.1.0 - $79.99
Sparkle will change your mind if you thought building websites wasn't for you. Sparkle is the intuitive site builder that lets you create sites for your online portfolio, team or band pages, or... Read more
Bookends 12.7.9 - Reference management a...
Bookends is a full-featured bibliography/reference and information-management system for students and professionals. Bookends uses the cloud to sync reference libraries on all the Macs you use.... Read more
Dash 4.0.0 - Instant search and offline...
Dash is an API documentation browser and code snippet manager. Dash helps you store snippets of code, as well as instantly search and browse documentation for almost any API you might use (for a full... Read more
TrailRunner 3.8.834 - Route planning for...
TrailRunner is the perfect companion for runners, bikers, hikers, and all people wandering under the sky. Plan routes on a geographical map. Import GPS or workout recordings and journalize your... Read more
Dash 4.0.0 - Instant search and offline...
Dash is an API documentation browser and code snippet manager. Dash helps you store snippets of code, as well as instantly search and browse documentation for almost any API you might use (for a full... Read more
Bookends 12.7.9 - Reference management a...
Bookends is a full-featured bibliography/reference and information-management system for students and professionals. Bookends uses the cloud to sync reference libraries on all the Macs you use.... Read more
TrailRunner 3.8.834 - Route planning for...
TrailRunner is the perfect companion for runners, bikers, hikers, and all people wandering under the sky. Plan routes on a geographical map. Import GPS or workout recordings and journalize your... Read more
iFFmpeg 6.2.5 - Convert multimedia files...
iFFmpeg is a comprehensive media tool to convert movie, audio and media files between formats. The FFmpeg command line instructions can be very hard to master/understand, so iFFmpeg does all the hard... Read more
DaisyDisk 4.4 - $9.99
DaisyDisk allows you to visualize your disk usage and free up disk space by quickly finding and deleting big unused files. The program scans your disk and displays its content as a sector diagram... Read more

RPG Djinn Caster (Games)
RPG Djinn Caster 1.0.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0.0 (iTunes) Description: SPECIAL PRICE 38% OFF(USD 7.99 -> USD 4.99)!!!A Fantasy Action RPG of far foreign lands! Summon the Djinns and rise to... | Read more »
Alto's Odyssey gets its first trail...
There's finally video evidence of Alto's Odyssey, the follow up to the 2015 App Store hit, Alto's Adventure. It looks just as soothing and atmospheric as Alto's last outing, but this time players will be journeying to the desert. Whereas Alto's... | Read more »
Last week on Pocket Gamer
What’s going on in the wider world of portable gaming? Each week we ask that question of our sister website Pocket Gamer. The PG team covers iOS gaming, just like 148Apps, but it also strays into the world of Android games and handheld consoles... | Read more »
Pokémon GO Generation 2 evolution guide
At long last, Niantic Labs finally unleashed the Generation 2 Pokémon into the wild. Pokémon GO trainers are scrambling to grab up this new set of 80 Pokémon. There are some special new tricks required to catch all of these new beasties, though.... | Read more »
The best new games we played this week
It feels as though the New Year got off to a creaking start as far as mobile games go, but that's changed over the past few weeks. The last few days alone have seen the debut of a number of wonderful games, so we thought we'd take the time to... | Read more »
Recruit more scallywags and discover new...
Get ready to show off your sea legs all over again in Oceans & Empires’ new grand update, which aims to make the act of rising to the role of seven seas ruler even more fresh and appealing, thanks to a richness of new content on both iOS and... | Read more »
Mage the Ascension: Refuge (Games)
Mage the Ascension: Refuge 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: The groundbreaking roleplaying game Mage: The Ascension manifests in our turbulent present with Refuge, an... | Read more »
Vampire: Prelude (Games)
Vampire: Prelude 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: The classic roleplaying game Vampire: The Masquerade returns to digital games with a Prelude of things to come. Experience a... | Read more »
Digby Forever Guide: How to dig to the d...
Digby Forever is a sparkling homage to arcade classics, and while you may be tiring of the number of arcade games being thrown at you, this endless digger finds many ways to stand out from the rest of the pack. The game manages to be challenging... | Read more »
The best sales on the App Store this wee...
It's been quite the week in mobile games, but if the latest releases(there were some pretty darn good ones, in case you missed out) aren't really doing the trick, perhaps some of these discounted games will. Many of these premium games had their... | Read more »

Price Scanner via MacPrices.net

Apple Certified Refurbished iMacs available f...
Apple has Certified Refurbished 2015 21″ & 27″ iMacs available for up to $350 off MSRP. Apple’s one-year warranty is standard, and shipping is free. The following models are available: - 21″ 3.... Read more
Apple offering Certified Refurbished Series 1...
Apple is now offering Certified Refurbished Series 1 and Series 2 Apple Watches for 14-16% off MSRP, starting at $229. An Apple one-year warranty is included with each watch. Shipping is free: Series... Read more
1.4GHz Mac mini on sale for $449, save $50
B&H Photo has the 1.4GHz Mac mini on sale for $50 off MSRP including free shipping plus NY sales tax only: - 1.4GHz Mac mini: $449 $50 off MSRP Read more
12-inch Retina MacBooks on sale for $200-$250...
Newegg has the 12″ 1.2GHz Space Gray Retina MacBook (sku MLH82LL/A) on sale for $1349.99 including free shipping. Their price is $250 off MSRP, and it’s the lowest price available for this model.... Read more
13-inch 2.0GHz Space Gray MacBook Pro on sale...
Adorama has the non-Touch Bar 13″ 2.0GHz Space Gray MacBook Pro in stock today for $100 off MSRP. Shipping is free, and Adorama charges NY & NJ sales tax only: - 13″ 2.0GHz MacBook Pro Space Gray... Read more
13-inch Touch Bar MacBook Pros on sale for $1...
B&H Photo has select 2016 Apple 13″ Touch Bar MacBook Pros in stock today and up to $100 off MSRP. Shipping is free, and B&H charges NY sales tax only: - 13″ 2.9GHz/512GB Touch Bar MacBook... Read more
KSI-1802R SX Disinfect-able Keyboard With Wav...
KSI has unveiled a new, innovative medical keyboard, the KSI-1802R SX, at HIMSS 2017, running February 19-22 in Orlando, Florida. KSI-1802R SX is the only keyboard that combines dual factor... Read more
15-inch Touch Bar MacBook Pros on sale for up...
Amazon has 15″ Touch Bar MacBook Pros in stock today and on sale for up to $150 off MSRP including free shipping: - 15″ 2.7GHz Touch Bar MacBook Pro Space Gray: $2720.38 $79 off MSRP - 15″ 2.7GHz... Read more
Apple’s Education discount saves up to $300 o...
Purchase a new Mac or iPad using Apple’s Education Store and take up to $300 off MSRP. All teachers, students, and staff of any educational institution qualify for the discount. Shipping is free: -... Read more
13-inch 1.6GHz/256GB MacBook Air on sale for...
Newegg has the 13″ 1.6GHz/256GB MacBook Air (MMGG2LL/A) on sale for $1029.99 including free shipping. Their price is $170 off MSRP, and it’s the lowest price available for this model. Choose Newegg... Read more

Jobs Board

*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
Manager *Apple* Systems Administration - Pu...
Req ID 3315BR Position Title Manager, Apple Systems Administration Job Description The Manager of Apple Systems Administration oversees the administration and Read more
*Apple* Technician - nfrastructure (United S...
Let’s Work Together Apple Technician This position is based in Portland, ME Life at nfrastructure At nfrastructure, we understand that our success results from our Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
Manager *Apple* Systems Administration - Pu...
Req ID 3315BR Position Title Manager, Apple Systems Administration Job Description The Manager of Apple Systems Administration oversees the administration and Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.