TweetFollow Us on Twitter

May 94 Cornfield
Volume Number:10
Issue Number:5
Column Tag:From The Corn Field

Thoughts From The Cornfield

Provocative, perhaps inflammatory, but just say no to assembly language on PowerPC

By Steve Kiene, MindVision Software, Lincoln, Nebraska

About the author

Steve, author of things like Stacker for Macintosh, cares about performance, code size, performance, portability, and performance as much as anyone we know (well, there’s always Mike Scanlin, too). Steve’s recently worked through a number of issues about porting to the PowerPC for performance, and along the way surprised himself with his conclusions. He’s curious about your reaction, so please let us know if they surprise you, too. I can just see our assistant Al holding up a placard with this in big letters: editorial@xplain.com

Writing code in assembly language instead of a high-level language to get performance is fast becoming an historic anachronism. The fierce competition in the 90’s leads to time-to-market battles that cannot be won by the company that insists on writing large chunks of their product in assembly language.

I’ve seen plenty of code whose authors have spent an inordinate amount of time tweaking assembly language instructions to get the most speed out of the code when the real problem was a slow algorithm. It’s the old problem of not seeing the forest for the trees. Careful examination of the algorithm offers more potential for improved performance than coding a bad algorithm in tightly-tuned assembly language. This generally holds true even when the improved algorithm is coded in C.

I took some code a friend had written; he had spent weeks hand-tuning assembly code. I re-examined the algorithms and found a better way to do it. I coded it up in C and the new C code ran fifty times faster on the 68K than the assembly solution had before. Now, it not only performs, it’s portable and more maintainable. After simply recompiling the code for Power Macintosh, its speed doubled. To convert the assembly code would have taken at least a couple of weeks for someone proficient not only in writing PowerPC assembly code, but also good at scheduling the assembly instructions to keep the chip as busy as possible.

Now, with all that said, there are reasons for writing PowerPC assembly language. So, if you have to write part of your program in assembly, make sure it’s the right part and be completely sure you cannot increase the speed by improving the algorithm. There’s little sense in writing assembly language for code that only amounted to 4% of the execution time, but it’s not that hard to find programs that do just that. What was gained by writing the code in assembly language rather than a high-level language?

The release of the Power Macintosh machines has sent many 68K assembly language programmers scrambling to learn the new architecture and its assembly language so that they can continue to performance-program the Macintosh. However, as they are finding out, programming in PowerPC assembly language is much harder than on the 68K Macintosh.

I’ve seen several examples of PowerPC assembly language code that at first glance looks fast but after careful examination the code turns out to run slower than expected. RISCprocessors require understanding the architecture of both the CPU and the memory bus to get good performance, and it’s simply difficult to keep all of the rules and constraints in your head while trying to be creative and write code. Compilers, on the other hand, just don’t care how many rules they have to remember.

Reasons to avoid assembly language

(1) Assembly language code is not easily ported to different instruction set architectures. There are tools which will port 68K assembly to PowerPC assembly, but you run the risk that the architectures are so different a port doesn’t get you the full potential of the new architecture.

(2) Code can be written in a shorter amount of time in a high level language than it can be in assembly. People want to argue this, claiming that bit manipulation routines are too hard to do in C, but it’s just not true. I suspect that if they knew C as well as they knew assembler there would be little or no argument.

(3) It is far easier to make mistakes in assembly than it is in a high level language. High level languages offer abstraction and structure which makes many common assembly language problems simply non-existent.

(4) Code written in assembly is harder to maintain both for the original programmer as well as a different programmer. Because of the fine-grain control you get with assembly language, it is not always easy to follow the flow of the code.

(5) The development tools available for writing assembly language are not advancing at the same rate as those for high level languages. In fact, there are many situations where the tools are getting worse. Apple’s PowerPC Assembler for MPW is not nearly as sophisticated as their 68K Assembler.

Reasons to use assembly language

(1) Highly time-critical code, such as software which interfaces with a piece of hardware which has very specific timing dependencies. Not very common.

(2) Code where space is at a minimum, such as embedded controllers. Generally not applicable to the Macintosh.

(3) Code that is proven to be an unacceptable bottleneck in a specific task.

(4) Places where parameters are passed in specific locations that are not easily accessible to a high level language. [Between the PowerPCruntime architecture, and the protocol conversion that Mixed Mode does for you, this problem essentially goes away on the Power Macintosh - Ed stb]

In all of these instances, there is a need for assembly only in specific places in the code. There is no need to code large parts in assembly.

How to speed up your code - the old way

The most common way to speed up existing code is to find the parts of the program that are slow and rewrite them in assembly. In the past that may have been a good way to gain more speed. Today, that model is not only outdated, it can backfire. I’ve seen people rewrite their code in PowerPC assembly language only to see it run SLOWER. Do not assume you know more about the processor architecture than the compiler. Unless you understand the instruction scheduling of the processor entirely, you probably can’t out-do a good compiler.

How to speed up your code - the new way

Determine which parts of your program are used the most. If a particular feature takes several minutes to run but is only used once a month, maybe it’s not as important as features which takes ten seconds but are used every five minutes. Watch your customers’ usage patterns. Ask them which parts of the program are annoyingly slow. Ask them why they think those parts are slow. Remember, slowness is subjective. What is slow to a power user may seem perfectly fine to a novice user. Who uses your product, the novice or the power user?

Once you have identified the areas of your software that seem slow, you may want to back up the results with scientific data. Run performance analysis tools to see exactly where in the code things are slow when you perform the tasks that users said were slow. THINK C and CodeWarrior have performance monitoring tools included that work well. MPW has its own performance tools which are adequate. If you are writing code that is not easily interfaced to these tools, I recommend you look at the source code provided for the performance tools in THINK C. It is very easy to adapt this code to monitor the performance of any piece of code.

One thing to remember is that the performance of your software may differ greatly when comparing Power Macintosh to the 68K Macintosh. Performance may also vary quite a bit between specific Macintosh models. Machines with a 32 bit data bus will perform memory intensive operations much faster than machines with a 16 bit data bus.

Now that you have figured out which parts of your program are slow, it is time to decide how to make them faster. The first thing to do is to examine the underlying algorithms of the code. Is there anything fundamental that you can do to speed things up? For example, if you are performing a text search, how do you search through the text? Do you use Munger? Perhaps something like a Boyer-Moore algorithm would be much faster. Remember, the key is to work smarter. Brute force is not the answer - it’s a matter of brains over brawn.

Sometimes simply a small change to your existing algorithm will make things much faster. I sped up a search algorithm I wrote years ago by a factor of three by simply adding two lines of code. Look at your algorithm and examine how it operates with common data that goes through it. Perhaps certain shortcuts can be taken when the most common data runs through it.

If you don’t have many books on fundamental computer algorithms, now is the time to stock up. I am a firm believer that you cannot have enough books on algorithms. At the end of this article I have listed several books that will help broaden and round out your algorithm skills. I highly recommend all of them.

Once you have analyzed the specific parts of your program that are bottlenecks, it is time to look at the architecture of your program as a whole. If your program is rather large you may want to look at it as several modules working together.

Is the underlying architecture of your program going to be a bottleneck? Are there time consuming tasks that can be done in the background at idle time rather than being done while the user must wait? Are you doing network communication synchronously when you could do it asynchronously and give the user their machine back? Are there tasks that need to be performed but don’t need to give immediate feedback to the user? These kinds of tasks are good candidates for idle time processing, additional user feedback, modeless dialog boxes, asynchronous programming, and other methods of helping the user feel as if they are not waiting on your program, or at least aren’t prevented from doing something else while you get your thing done. If you keep the user occupied or help them feel productive while your program is working, they’ll be more patient with whatever performance you have.

How to write the code in Assembly Language

If, after careful examination, you have determined a bottleneck in your program, analyzed the algorithms as best you can, rewritten them to be as efficient as possible, and still it is not fast enough, perhaps it is time to code a small part in assembly. The best place to start is to disassemble compiler- generated code for the routine you want to code in assembly. Look at the code. What is inefficient about it? Are registers constantly being reloaded? Are the registers being used efficiently? Are the instructions scheduled for maximum pipelining? Very often you can take the disassembled code, make a few minor modifications to it and see a very nice speed increase.

Perform accurate timing tests on the code you are optimizing. Unless you completely understand the PowerPC Architecture Manual and the PowerPC 601 User’s Guide, more often than not you will make PowerPC code slower than a good compiler. The bottom line is that it must run faster, not look faster.

Maintain an exact high-level equivalent of the assembly code, and keep it right there in the same file. This way if you port your code to a different architecture, you’ve got what you need to get up and running quickly. In many cases the bottleneck on one machine will not be a bottleneck on another.

In Conclusion

This article has discussed some alternate methods of speeding up your program execution that are in many ways better than traditional methods used by many programmers. The goal is to maximize your gain and minimize your effort. By working smarter rather than harder, you can have a faster program in less time.

Recommended Books

[1] Thomas H. Cormen, Charles E. Leiserson, and Ronald L. Rivest. Introduction to Algorithms. MIT Press, 1990.

[2] Alfred V. Aho, John E. Hopcroft, and Jeffrey D. Ullman. The Design and Analysis of Computer Algorithms. Addison-Wesley, 1974.

[3] Saumyendra Sengupta and Paul Edwards. Data Structures in ANSI C. Academic Press, 1991.

[4] Donald Knuth. The Art of Computer Programming, Volumes 1-3. Addison-Wesley, 1973

[5] Daniel H. Greene and Donald E. Knuth. Mathematics for the Analysis of Algorithms., Third Edition Birkhäuser, 1990.

[6] P. D. Eastman. Go, Dog, Go! Random House, 1961.

[7] Manoochehr Azmoodeh. Abstract Data Types and Algorithms, Second Edition. Macmillan, 1990.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

MacFamilyTree 8.2.1 - Create and explore...
MacFamilyTree gives genealogy a facelift: modern, interactive, convenient and fast. Explore your family tree and your family history in a way generations of chroniclers before you would have loved.... Read more
LaunchBar 6.9 - Powerful file/URL/email...
LaunchBar is an award-winning productivity utility that offers an amazingly intuitive and efficient way to search and access any kind of information stored on your computer or on the Web. It provides... Read more
LaunchBar 6.9 - Powerful file/URL/email...
LaunchBar is an award-winning productivity utility that offers an amazingly intuitive and efficient way to search and access any kind of information stored on your computer or on the Web. It provides... Read more
MacFamilyTree 8.2.1 - Create and explore...
MacFamilyTree gives genealogy a facelift: modern, interactive, convenient and fast. Explore your family tree and your family history in a way generations of chroniclers before you would have loved.... Read more
Spotify 1.0.57.474. - Stream music, crea...
Spotify is a streaming music service that gives you on-demand access to millions of songs. Whether you like driving rock, silky R&B, or grandiose classical music, Spotify's massive catalogue puts... Read more
VOX 2.8.26 - Music player that supports...
VOX just sounds better! The beauty is in its simplicity, yet behind the minimal exterior lies a powerful music player with a ton of features and support for all audio formats you should ever need.... Read more
beaTunes 5.0.1 - Organize your music col...
beaTunes is a full-featured music player and organizational tool for music collections. How well organized is your music library? Are your artists always spelled the same way? Any R.E.M. vs REM?... Read more
LibreOffice 5.3.4.2 - Free, open-source...
LibreOffice is an office suite (word processor, spreadsheet, presentations, drawing tool) compatible with other major office suites. The Document Foundation is coordinating development and... Read more
Sparkle Pro 2.2 - $79.99
Sparkle Pro will change your mind if you thought building websites wasn't for you. Sparkle is the intuitive site builder that lets you create sites for your online portfolio, team or band pages, or... Read more
calibre 3.1.1 - Complete e-book library...
Calibre is a complete e-book library manager. Organize your collection, convert your books to multiple formats, and sync with all of your devices. Let Calibre be your multi-tasking digital librarian... Read more

Latest Forum Discussions

See All

This War of Mine gets a new ending and m...
This War of Mine just got a big new update, featuring free DLC that adds a new ending to the game, among other exciting changes. The update is celebrating the game's two-year release anniversary. Apart from the new ending, which will be quite... | Read more »
Summon eight new heroes in Fire Emblem H...
Nintendo keeps coming at us with Fire Emblem Heroes updates, and it doesn't look like that trend is stopping anytime soon. The folks behind the game have just announced the new War of the Clerics Voting Gauntlet, expected to start next Tuesday. [... | Read more »
The best deals on the App Store this wee...
iOS publishers are pulling out all the stops this week -- there's a huge number of seriously great games at discounted prices this week. Let's not waste any time and get right down to business. [Read more] | Read more »
The House of da Vinci (Games)
The House of da Vinci 1.0.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0.0 (iTunes) Description: Enter The House of Da Vinci, a new must-try 3D puzzle adventure game. Solve mechanical puzzles, discover hidden... | Read more »
Solve the disappearance of history’s gre...
Blue Brain Games invites you to indulge in an immersive hands-on 3D puzzle adventure in similar vein to The Room series, with its debut release The House of Da Vinci. Set during the historic period of the Italian Renaissance (when Leonardo himself... | Read more »
Age of Rivals (Games)
Age of Rivals 3.3 Device: iOS Universal Category: Games Price: $.99, Version: 3.3 (iTunes) Description: Deep civilization-building strategy in a fast-paced card game! | Read more »
Panthera Frontier (Games)
Panthera Frontier 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: | Read more »
Angry Birds Evolution beginner's gu...
Angry Birds changes things up a fair bit in its latest iteration, Angry Birds Evolution. The familiar sling-shot physics mechanics are still there, but the game now features team-based gameplay, RPG elements, and a new top-down view. With all of... | Read more »
Sega Forever is for the retro game fans
Sega is launching a new retro games service titled Sega Forever, in a move that's sure to delight games enthusiasts with a bit of nostalgia. Sega's releasing five classic games for free. The titles include Sonic the Hedgehog, Phantasy Star II,... | Read more »
The Little Acre (Games)
The Little Acre 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: | Read more »

Price Scanner via MacPrices.net

ABBYY TextGrabber 6 for iOS Implements Instan...
ABBYY has announced the release of TextGrabber 6.0.0, an important feature update to the company’s productivity app developed for iOS and Android devices. TextGrabber 6.0 now offers Real-Time... Read more
vPhone, First Smartphone That Can’t Be Lost,...
Austin, Texas based Hypori has introduced the vPhone, a virtual smartphone that affords every business user the benefits of separate work and personal phones, conveniently delivered on a single... Read more
Save this weekend with 2016 refurbished MacBo...
Apple has dropped prices on Certified Refurbished 2016 15″ and 13″ MacBook Pros by as much as $590 off original MSRP. An Apple one-year warranty is included with each model, and shipping is free: -... Read more
New 27-inch 3.4GHz iMac on sale for $1699, sa...
MacMall has the new 2017 27″ 3.4GHz iMac (MNE92LL/A) in stock and on sale for $1699 including free shipping. Their price is $100 off MSRP. Read more
Clearance 2016 MacBook Pros available for up...
B&H Photo has clearance 2016 13″ and 15″ MacBook Pros in stock today and on sale for up to $400 off original MSRP. Shipping is free, and B&H charges NY & NJ sales tax only: - 15″ 2.7GHz... Read more
Apple Ranks 9th In comScore Top 50 U.S. Digit...
comScore, Inc. has released its monthly ranking of U.S. online activity at the top digital media properties for May 2017 based on data from comScore Media Metrix Multi-Platform. * Entity has... Read more
10.5-inch iPad Pros available for up to $20 o...
B&H Photo has the new 2017 10.5″ iPad Pros available for up to $20 off MSRP including free shipping plus NY & NJ sales tax only: - 64GB iPad Pro WiFi: $649 - 256GB iPad Pro WiFi: $749 - 512GB... Read more
Three Off-The-Beaten-Track iOS Apps That Dese...
One of the great things about using iPads and iPhones is the vast selection of apps available for most anything you want or need to do. The three outlined in this article have been in my core app... Read more
Apple No. 1 Spot In Gartner Top 100 Vendors i...
Gartner, Inc. has unveiled the top global 100 vendors in IT in 2016 based on their revenue across IT (excluding communication services) and component market segments. In the Gartner Global Top 100:... Read more
Clearance iMacs available for up to $300 off...
B&H Photo has clearance 21″ and 27″ Apple iMacs available starting at $949, each including free shipping plus NY & NJ sales tax only: - 27″ 3.3GHz iMac 5K: $1999 $300 off original MSRP - 27″... Read more

Jobs Board

*Apple* News Product Marketing Mgr., Publish...
…organizational consensus on strategy and vision for publisher tools, authoring, and Apple News Format.Carries this strategy and vision across the organization to Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
Security Data Analyst - *Apple* Information...
…data sources need to be collected to allow Information Security to better protect Apple employees and customers from a wide range of threats.Act as the subject matter Read more
Lead *Apple* Solutions Consultant - Apple I...
…integrity, and trust.Success Metrics/Key Performance Indicators:Quantitative* Year over Year growth in Apple Product and Beyond the Box sales in the assigned Point of Read more
*Apple* Solutions Consultant till v%u00E5r...
…ethics, integrity, and trust.Success Metrics/Key Performance Indicators:QuantitativeYear over Year growth in Apple Product and Beyond the Box sales in the assigned Point Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.