TweetFollow Us on Twitter

MacTech Magazine Article Archives

Volume Number: 23 (2007)
Issue Number: 01
Column Tag: Network Administration

Jumbo Frame Networks

Tap into extra Ethernet speed

By Steve Modica

Approximately one year ago, Apple introduced its first dual Ethernet G5 PowerMac. The system sported an internal Broadcom chip that provided the user with two high-speed Gigabit Ethernet ports.

Why would Apple include a second Ethernet port on their new PowerMac systems? One reason (probably the most obvious) is for Xsan support. To add a system to an Xsan storage network (or almost any clustered filesystem network), the system must be connected to the Fibre Channel based storage, its normal internet connection, and a dedicated "Meta-data" network.

On the previous generation of PowerMacs, this would require the customer to purchase an extra Gigabit Ethernet NIC (network interface card), which uses up one PCIX or PCIE slot and requires the user to open up the machine to install the device. When you consider the extra Fibre Channel card (which may have been ordered directly from Apple), you're now down to one free PCI slot to house your high-speed video capture or other application specific devices.

Given the minimal price premium for going to a dual port Gigabit Chip from a single port, adding that second connector was a no-brainer for Apple.

Xsan and clustered filesystems in general, have a lot of promise. Systems can be attached directly to the shared storage using Fibre Channel, and the Ethernet based "meta-data" network is used as the traffic cop. It assures that multiple systems aren't modifying the same filesystem structures simultaneously.

The problem with these new filesystem technologies is the entry point cost. Purchasing an Apple XRAID is quite economical given their cost per byte ratio (one of the lowest in the industry), but when you add in the cost of a Fibre Channel switch, Fibre Channel adapters for each machine, additional Ethernet ports for the meta-data network and the software licenses, the cost begins to approach $30,000 for even the smallest network. When compared to even high-end NAS storage devices, the choice is easy.

So assuming you are one of the many 5-10 system shops that simply can't justify a $30,000 entry point for storage, but you've paid for all of these great PowerMac and Mac Pro systems with second Gigabit Ethernet ports, what can you do to take advantage of them? There's nothing worse than buying something and leaving it sit idle, especially when shared network performance is one of the most common complaints at small shops.

One very common use of these extra ports is to create a dedicated storage network that uses Gigabit Ethernet's built-in "jumbo frame" technology to speed up the transfer of data, while reducing the amount of cpu overhead created when transferring that data.

A configuration like this can significantly improve network performance for file-transfers, captures and downloads, while freeing the "normal" office network for things like email, web browsing and DHCP services. This setup will also increase the amount of CPU cycles available on the server and the clients for local image processing -- a big win for everyone in the office.

What are Jumbo Frames? Seven years ago, when Gigabit Ethernet was just becoming available, processors were a lot slower than they are today. Vendors weren't crowing about how many Ghz their systems were clocked at. They were still working on hitting the 1Ghz mark! These new "high-speed" Gigabit adapters were expensive and quirky. Finding adapters (which typically ran $1500 or more) that worked with all your platforms and a switch that worked with all your adapters was no small task.

During this period, a typical Gigabit Ethernet adapter would easily eat up an entire CPU just for interrupt processing. It was rare to see a Gigabit adapter perform at "line rate" (IE 1 Gb). More typically, adapters would get between 400 and 600Mbits/sec. This is still plenty good, but it must be remembered that while maintaining these rates, your machine wasn't doing anything else.

Enter the notion of "Jumbo Frames"

Ethernet (and all of its add-on features) are defined as IEEE 802.3. This spec includes things like auto-negotiation, link aggregation, 10MbEthernet, 100Mb/Ethernet and even 10Gb/Ethernet. The spec defines the size of an Ethernet frame as 1500 bytes -- typically somewhere between 1488 and 1514 bytes depending on the platform.

Receiving 1 billion bits of data adds up to 83,333 packets per second. Theoretically, each one of these packets requires the CPU to stop what its doing, receive the packet from the Gigabit card, process the headers, and provide the data to the waiting application (you).

At 83,333 packets per second, most of the CPUs time is spent context switching. It's constantly saving and recalling what it was doing just prior to processing your last packet. No real work is getting done.

Vendors quickly realized that unless they wanted to wait for processor and bus speeds to catch up, they wouldn't sell many cards. They needed a solution that would allow their products to work on the slower processors available at that time. Jumbo frames provided one such solution.

Rather than moving data in 1500 byte chunks, they allowed their cards to use much larger packets. Some vendors supported 16384 bytes, others supported smaller numbers. The "de facto" standard was 9000 bytes.

At 9000 bytes per frame, the packet processing load is reduced by a factor of 6 (13,888 packets per second). The CPU has 1/6th the number of headers to process and theoretically, 1/6th the number of interrupts to handle.

Today, all but the very cheapest switches support jumbo frames and switch ports for Gigabit are well under $100 per port. This makes it extremely easy and economical to create a dedicated jumbo frame network.

Benefits

1. Having a separate network means less bandwidth contention for critical operations like captures or online editing.

2. Jumbo frames allow local systems to have more CPU cycles available for things like Final Cut Pro, improving the users experience running the application.

3. A jumbo frame network can support a larger class of systems including Apple Macbook, Macbook Pros, Mac Minis and iMacs.

4. Jumbo frames can be used to access "storage over Ethernet" devices like iSCSI and AoE RAIDS, such as those designed by companies like 2 Degrees Frost. These products eliminate typical bottlenecks found in client/server networks.

Conclusion

Having extra Gigabit ports on your machines makes using jumbo frames easier than ever and the benefits are tremendous. All small video capture and post houses, audio and pre-press shops should consider this simple, elegant solution to improve their network without breaking the bank.


Steve Modica is the Chief Technical Officer of Small Tree Communications. Mr. Modica brings over 15 years of experience in the field of high performance operating systems to the company. Prior to founding STC, he worked at Silicon Graphics Inc. managing a group of device driver engineers and managing third party vendor relationships. For the four years prior to joining SGI, he owned and operated HPC Consulting; a company specialized in customizing corporate networks. Mr. Modica attended Wayne State University in Detroit on a Merit Scholarship and received his degree in Electrical Engineering in 1992.

 
AAPL
$106.98
Apple Inc.
-0.36
MSFT
$46.05
Microsoft Corpora
-0.57
GOOG
$550.31
Google Inc.
+0.98

MacTech Search:
Community Search:

Software Updates via MacUpdate

Sandvox 2.9.2 - Easily build eye-catchin...
Sandvox is for Mac users who want to create a professional looking website quickly and easily. With Sandvox, you don't need to be a Web genius to build a stylish, feature-rich, standards-compliant... Read more
Cocktail 8.0.1 - General maintenance and...
Cocktail is a general purpose utility for OS X that lets you clean, repair and optimize your Mac. It is a powerful digital toolset that helps hundreds of thousands of Mac users around the world get... Read more
LibreOffice 4.3.3.2 - Free Open Source o...
LibreOffice is an office suite (word processor, spreadsheet, presentations, drawing tool) compatible with other major office suites. The Document Foundation is coordinating development and... Read more
VMware Fusion 7.0.1 - Run Windows apps a...
VMware Fusion allows you to create a Virtual Machine on your Mac and run Windows (including Windows 8.1) and Windows software on your Mac. Run your favorite Windows applications alongside Mac... Read more
OneNote 15.3.2 - Free digital notebook f...
OneNote is your very own digital notebook. With OneNote, you can capture that flash of genius, that moment of inspiration, or that list of errands that's too important to forget. Whether you're at... Read more
Audio Hijack Pro 2.11.4 - Record and enh...
Audio Hijack Pro drastically changes the way you use audio on your computer, giving you the freedom to listen to audio when you want and how you want. Record and enhance any audio with Audio Hijack... Read more
Iridient Developer 3.0.0 beta 3 - Powerf...
Iridient Developer (was RAW Developer) is a powerful image conversion application designed specifically for OS X. Iridient Developer gives advanced photographers total control over every aspect of... Read more
TextWrangler 4.5.11 - Free general purpo...
TextWrangler is the powerful general purpose text editor, and Unix and server administrator's tool. Oh, and also, like the best things in life, it's free. TextWrangler is the "little brother" to... Read more
NeoFinder 6.6 - Catalog your external me...
NeoFinder (formerly CDFinder) rapidly organizes your data, either on external or internal disks, or any other volumes. It catalogs all your data, so you stay in control of your data archive or disk... Read more
Chromium 38.0.2125.111 - Fast and stable...
Chromium is an open-source browser project that aims to build a safer, faster, and more stable way for all Internet users to experience the web. FreeSMUG-Free OpenSource Mac User Group build is... Read more

Latest Forum Discussions

See All

Night Sky Pro™ (Reference)
Night Sky Pro™ 3.0.1 Device: iOS Universal Category: Reference Price: $2.99, Version: 3.0.1 (iTunes) Description: Night Sky Pro™Wonder No More™ Night Sky Pro™ is the ultimate stargazing experience. From the creators of the original... | Read more »
Audio Defence : Zombie Arena (Games)
Audio Defence : Zombie Arena 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: A zombie shooter audio game. Made from gut-wrenching 3D binaural sound, for a new kind of weird immersion. You... | Read more »
RPG Asdivine Hearts (Games)
RPG Asdivine Hearts 1.1.0 Device: iOS Universal Category: Games Price: $3.99, Version: 1.1.0 (iTunes) Description: SPECIAL PRICE50% OFF (USD 7.99 -> USD 3.99)!!! Travel alongside four companions and a cat in the adventure of a... | Read more »
Haunt the House: Terrortown (Games)
Haunt the House: Terrortown 1.0.1 Device: iOS Universal Category: Games Price: $.99, Version: 1.0.1 (iTunes) Description: 66.6% OFF! SPECIAL SPOOKY HALLOWEEN LAUNCH PRICE! 66.6% OFF! ...What was that sound? Is somebody there? | Read more »
SAS: Zombie Assault 4 Review
SAS: Zombie Assault 4 Review By Jennifer Allen on October 30th, 2014 Our Rating: :: FLAWED SHOOTERUniversal App - Designed for iPhone and iPad Shoot everything that moves in this fun, if flawed, twin-stick shooter.   | Read more »
Naailde the Witch Review
Naailde the Witch Review By Amy Solomon on October 30th, 2014 Our Rating: :: PITCH-PERFECT STORYTELLINGUniversal App - Designed for iPhone and iPad Marvelous storytelling, narration, and moving illustrations make this storybook... | Read more »
1st & Goal Review
1st & Goal Review By Andrew Fisher on October 30th, 2014 Our Rating: :: FOR THE D&D LOVING QBUniversal App - Designed for iPhone and iPad 1st & Goal is a board gamer’s football game, a football fan’s board game, and... | Read more »
French Developer Pated Unveils Seashine
French Developer Pated Unveils Seashine Posted by Ellis Spice on October 30th, 2014 [ permalink ] French one-man studio Pated has unveiled Seashine, “a poetic journey into the abyss.” Players take on the role of a jellyfish strugglin | Read more »
Agents of Storm: Tips, Tricks, and Strat...
Calling all agents: Would you like to see what we thought of this rather pretty base builder? Check out our Agents of Storm review! Have you downloaded Agents of Storm, been bowled over by the graphics, and aren’t quite sure what to do next? Never... | Read more »
Any.DO 2.0 Hopes to Help Manage Producti...
Any.DO 2.0 Hopes to Help Manage Productivity Posted by Ellis Spice on October 30th, 2014 [ permalink ] iPhone App - Designed for the iPhone, compatible with the iPad | Read more »

Price Scanner via MacPrices.net

Apple Regains Momentum As Windows Stutters An...
The latest smartphone sales data from Kantar Worldpanel ComTech, for the three months to March 2014, shows Apple performing strongly in the first quarter of the year, with sales bouncing back in... Read more
Worldwide Smartphone Shipments Increase 25.2%...
New smartphone releases and an increased emphasis on emerging markets drove global smartphone shipments above 300 million units for the second consecutive quarter, according to preliminary data from... Read more
Apple now offering refurbished 2014 15-inch M...
The Apple Store is now offering Apple Certified Refurbished 2014 15″ Retina MacBook Pros for up to $400 off the cost of new models. An Apple one-year warranty is included with each model, and... Read more
Apple drops prices on refurbished 2013 Retina...
The Apple Store has dropped prices on 2013 Apple Certified Refurbished 13″ and 15″ Retina MacBook Pros, with Retina models now available starting at $999. Apple’s one-year warranty is standard, and... Read more
New 2.8GHz Mac mini on sale for $949, save $5...
Abt Electronics has the new 2.8GHz Mac mini in stock and on sale for $949.05 including free shipping. Their price is $50 off MSRP, and it’s the lowest price available for this model from any reseller... Read more
Sale! 3.7GHz Quad Core Mac Pro available for...
 B&H Photo has the 3.7GHz Quad Core Mac Pro on sale for $2649 including free shipping plus NY sales tax only. Their price is $350 off MSRP, and it’s the lowest price for this model from any... Read more
Mujjo Steps Up The Game With Refined Touchscr...
Netherlands based Mujjo have just launched their Refined Touchscreen Gloves, stepping up their game. The gloves feature a updated elegant design that takes these knitted gloves to the next level. A... Read more
Sale! Preorder the new 27-inch 5K iMac for $2...
 Abt Electronics has the new 27″ 3.5GHz 5K iMac on sale and available for preorder for $2374.05 including free shipping. Their price is $125 off MSRP, and it’s the lowest price available for this... Read more
Simplex Solutions Inc. Brings Secure Web Surf...
New York based Simplex Solutions Inc. has announced the release and immediate availability of Private Browser 1.0, its revolutionary new secure web browser developed for iPhone, iPad and iPod touch... Read more
Save up to $180 off MSRP with an Apple refurb...
The Apple Store has Apple Certified Refurbished 2014 MacBook Airs available for up to $180 off the cost of new models. An Apple one-year warranty is included with each MacBook, and shipping is free.... Read more

Jobs Board

Position Opening at *Apple* - Apple (United...
**Job Summary** Every day, business customers come to the Apple Store to discover what powerful, easy-to-use Apple products can do for them. As a Business Leader, Read more
Sr. Manager, *Apple* Deployment Programs fo...
**Job Summary** Apple is seeking candidates for a new position on the Education Content and Technology team. iPad and Mac is in the hands of millions of teachers and Read more
*Apple* Solutions Consultant (ASC) - Apple I...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
*Apple* Solutions Consultant (ASC) - Apple I...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
*Apple* Solutions Consultant (ASC) - Apple I...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.