TweetFollow Us on Twitter

MacTech Magazine Article Archives

Volume Number: 23 (2007)
Issue Number: 01
Column Tag: Network Administration

Jumbo Frame Networks

Tap into extra Ethernet speed

By Steve Modica

Approximately one year ago, Apple introduced its first dual Ethernet G5 PowerMac. The system sported an internal Broadcom chip that provided the user with two high-speed Gigabit Ethernet ports.

Why would Apple include a second Ethernet port on their new PowerMac systems? One reason (probably the most obvious) is for Xsan support. To add a system to an Xsan storage network (or almost any clustered filesystem network), the system must be connected to the Fibre Channel based storage, its normal internet connection, and a dedicated "Meta-data" network.

On the previous generation of PowerMacs, this would require the customer to purchase an extra Gigabit Ethernet NIC (network interface card), which uses up one PCIX or PCIE slot and requires the user to open up the machine to install the device. When you consider the extra Fibre Channel card (which may have been ordered directly from Apple), you're now down to one free PCI slot to house your high-speed video capture or other application specific devices.

Given the minimal price premium for going to a dual port Gigabit Chip from a single port, adding that second connector was a no-brainer for Apple.

Xsan and clustered filesystems in general, have a lot of promise. Systems can be attached directly to the shared storage using Fibre Channel, and the Ethernet based "meta-data" network is used as the traffic cop. It assures that multiple systems aren't modifying the same filesystem structures simultaneously.

The problem with these new filesystem technologies is the entry point cost. Purchasing an Apple XRAID is quite economical given their cost per byte ratio (one of the lowest in the industry), but when you add in the cost of a Fibre Channel switch, Fibre Channel adapters for each machine, additional Ethernet ports for the meta-data network and the software licenses, the cost begins to approach $30,000 for even the smallest network. When compared to even high-end NAS storage devices, the choice is easy.

So assuming you are one of the many 5-10 system shops that simply can't justify a $30,000 entry point for storage, but you've paid for all of these great PowerMac and Mac Pro systems with second Gigabit Ethernet ports, what can you do to take advantage of them? There's nothing worse than buying something and leaving it sit idle, especially when shared network performance is one of the most common complaints at small shops.

One very common use of these extra ports is to create a dedicated storage network that uses Gigabit Ethernet's built-in "jumbo frame" technology to speed up the transfer of data, while reducing the amount of cpu overhead created when transferring that data.

A configuration like this can significantly improve network performance for file-transfers, captures and downloads, while freeing the "normal" office network for things like email, web browsing and DHCP services. This setup will also increase the amount of CPU cycles available on the server and the clients for local image processing -- a big win for everyone in the office.

What are Jumbo Frames? Seven years ago, when Gigabit Ethernet was just becoming available, processors were a lot slower than they are today. Vendors weren't crowing about how many Ghz their systems were clocked at. They were still working on hitting the 1Ghz mark! These new "high-speed" Gigabit adapters were expensive and quirky. Finding adapters (which typically ran $1500 or more) that worked with all your platforms and a switch that worked with all your adapters was no small task.

During this period, a typical Gigabit Ethernet adapter would easily eat up an entire CPU just for interrupt processing. It was rare to see a Gigabit adapter perform at "line rate" (IE 1 Gb). More typically, adapters would get between 400 and 600Mbits/sec. This is still plenty good, but it must be remembered that while maintaining these rates, your machine wasn't doing anything else.

Enter the notion of "Jumbo Frames"

Ethernet (and all of its add-on features) are defined as IEEE 802.3. This spec includes things like auto-negotiation, link aggregation, 10MbEthernet, 100Mb/Ethernet and even 10Gb/Ethernet. The spec defines the size of an Ethernet frame as 1500 bytes -- typically somewhere between 1488 and 1514 bytes depending on the platform.

Receiving 1 billion bits of data adds up to 83,333 packets per second. Theoretically, each one of these packets requires the CPU to stop what its doing, receive the packet from the Gigabit card, process the headers, and provide the data to the waiting application (you).

At 83,333 packets per second, most of the CPUs time is spent context switching. It's constantly saving and recalling what it was doing just prior to processing your last packet. No real work is getting done.

Vendors quickly realized that unless they wanted to wait for processor and bus speeds to catch up, they wouldn't sell many cards. They needed a solution that would allow their products to work on the slower processors available at that time. Jumbo frames provided one such solution.

Rather than moving data in 1500 byte chunks, they allowed their cards to use much larger packets. Some vendors supported 16384 bytes, others supported smaller numbers. The "de facto" standard was 9000 bytes.

At 9000 bytes per frame, the packet processing load is reduced by a factor of 6 (13,888 packets per second). The CPU has 1/6th the number of headers to process and theoretically, 1/6th the number of interrupts to handle.

Today, all but the very cheapest switches support jumbo frames and switch ports for Gigabit are well under $100 per port. This makes it extremely easy and economical to create a dedicated jumbo frame network.

Benefits

1. Having a separate network means less bandwidth contention for critical operations like captures or online editing.

2. Jumbo frames allow local systems to have more CPU cycles available for things like Final Cut Pro, improving the users experience running the application.

3. A jumbo frame network can support a larger class of systems including Apple Macbook, Macbook Pros, Mac Minis and iMacs.

4. Jumbo frames can be used to access "storage over Ethernet" devices like iSCSI and AoE RAIDS, such as those designed by companies like 2 Degrees Frost. These products eliminate typical bottlenecks found in client/server networks.

Conclusion

Having extra Gigabit ports on your machines makes using jumbo frames easier than ever and the benefits are tremendous. All small video capture and post houses, audio and pre-press shops should consider this simple, elegant solution to improve their network without breaking the bank.


Steve Modica is the Chief Technical Officer of Small Tree Communications. Mr. Modica brings over 15 years of experience in the field of high performance operating systems to the company. Prior to founding STC, he worked at Silicon Graphics Inc. managing a group of device driver engineers and managing third party vendor relationships. For the four years prior to joining SGI, he owned and operated HPC Consulting; a company specialized in customizing corporate networks. Mr. Modica attended Wayne State University in Detroit on a Merit Scholarship and received his degree in Electrical Engineering in 1992.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

OmniOutliner Pro 4.2 - Pro version of th...
OmniOutliner Pro is a flexible program for creating, collecting, and organizing information. Give your creativity a kick start by using an application that's actually designed to help you think. It's... Read more
VLC Media Player 2.2.1 - Popular multime...
VLC Media Player is a highly portable multimedia player for various audio and video formats (MPEG-1, MPEG-2, MPEG-4, DivX, MP3, OGG, ...) as well as DVDs, VCDs, and various streaming protocols. It... Read more
Nisus Writer Pro 2.1.1 - Multilingual wo...
Nisus Writer Pro is a powerful multilingual word processor, similar to its entry level products, but brings new features such as table of contents, indexing, bookmarks, widow and orphan control,... Read more
Tinderbox 6.2.0 - Store and organize you...
Tinderbox is a personal content management assistant. It stores your notes, ideas, and plans. It can help you organize and understand them. And Tinderbox helps you share ideas through Web journals... Read more
OmniOutliner 4.2 - Organize your ideas,...
OmniOutliner is a flexible program for creating, collecting, and organizing information. Give your creativity a kick start by using an application that's actually designed to help you think. It's... Read more
Things 2.5.4 - Elegant personal task man...
Things is a task management solution that helps to organize your tasks in an elegant and intuitive way. Things combines powerful features with simplicity through the use of tags and its intelligent... Read more
NeoOffice 2014.10 - Mac-tailored, OpenOf...
NeoOffice is a complete office suite for OS X. With NeoOffice, users can view, edit, and save OpenOffice documents, PDF files, and most Microsoft Word, Excel, and PowerPoint documents. NeoOffice 3.x... Read more
iPhoto Library Manager 4.2 - Manage mult...
iPhoto Library Manager allows you to organize your photos among multiple iPhoto libraries, rather than having to store all of your photos in one giant library. You can browse the photos in all your... Read more
Web Snapper 3.3.8 - Capture entire Web p...
Web Snapper lets you capture Web pages exactly as they appear in your browser. You can send them to a file as images or vector-based, multi-page PDFs. It captures the whole Web page - eliminating the... Read more
TeamViewer 10.0.41404 - Establish remote...
TeamViewer gives you remote control of any computer or Mac over the Internet within seconds, or can be used for online meetings. Find out why more than 200 million users trust TeamViewer! Free for... Read more

Kids Can Practice Healthy Living With Gr...
Bobaka is releasing a new interactive book called Green Riding Hood  in May. The app teaches kids about yoga and organic style of life through mini-games and a fun take on the classic Little Red Riding Hood fairy tale. | Read more »
Chainsaw Warrior: Lords of the Night has...
It's time to put the Darkness back in its place now that Chainsaw Warrior: Lords of the Night has officially made it to iOS. | Read more »
A World of Ice and Fire Lets You Stalk 2...
George R. R. Martin’s A World of Ice and Fire, by Random House, is a mobile guide to the epic series. The new update gives you the Journeys map feture that will let you track the movements of 25 different characters. But don't worry, you can protect... | Read more »
Gameloft Announces Battle Odyssey, a New...
Battle Odyssey, Gameloft's newest puzzle RPG, is coming to the App Store next week. Set in the world of Pondera, you will need to control the power of the elements to defend the world from evil. You'll be able to entlist over 500 allies to aid you... | Read more »
Here's How You Can Get 5 Free Pro D...
It's only been a couple of days since Gamevil released MLB Perfect Inning 15, so building up a decent roster could still take a little time. If you'd like to speed things up a bit, then we've got a deal for you. How does five free Pro drafts sound?... | Read more »
Fusion - HDR Camera (Photography)
Fusion - HDR Camera 1.0.0 Device: iOS Universal Category: Photography Price: $1.99, Version: 1.0.0 (iTunes) Description: Fusion creates HDR (high dynamic range) photos by capturing different exposures and then combining them into one... | Read more »
Sago Mini Toolbox (Education)
Sago Mini Toolbox 1.1 Device: iOS Universal Category: Education Price: $2.99, Version: 1.1 (iTunes) Description: Come build with the Sago Mini friends! Use a wrench, try a saw, or hammer some nails. From sewing hand puppets to... | Read more »
You Should Probably Grab Hitman GO While...
Hitman GO is a surprisingly cool (yet also incredibly drastic) departure from the Hitman series. It's well worth playing for any puzzle game fans out there, and at the moment you can get your hands - or garrotte if you will - on it for a mere $0.99... | Read more »
IFTTT is Bringing Do Button and Do Note...
IFTTT has announced Do Button and Do Note for the Apple Watch. Do Button lets you make your own personalized button that can connect to things like your Google Drive, control the temperature in your home with Nest Thermostat, or turn the lights on... | Read more »
How Many Days, Hours, and Minutes Are Le...
Countdown, by Yves Tscherry, is now available on the App Store. The app keeps track of countdowns to your favorite things such as someones birthday or days till the New Year. You can display the time in seconds, minutes, hours, days, weeks, months,... | Read more »

Price Scanner via MacPrices.net

TigerText Introduces First Secure Enterprise...
TigerText, a provider of secure, real-time messaging for the enterprise, has announced the launch of TigerText for the Apple Watch. TigerText for the Apple Watch enables users to securely send and... Read more
The Conservation Fund Partners with Apple To...
The Conservation Fund has announced that it will partner with Apple to help protect working forests in the United States. The Apple initiative will conserve more than 36,000 acres of working... Read more
Clearance 13-inch 2.6GHz Retina MacBook Pro a...
B&H Photo has clearance 2014 13″ 2.6GHz/128GB Retina MacBook Pros now available for $1099, or $200 off original MSRP. Shipping is free, and B&H charges NY sales tax only. Read more
Apple refurbished 2014 13-inch Retina MacBook...
The Apple Store has Apple Certified Refurbished 2014 13″ Retina MacBook Pros available for up to $400 off original MSRP, starting at $979. An Apple one-year warranty is included with each model, and... Read more
iMacs on sale for up to $205 off MSRP, NY tax...
B&H Photo has 21″ and 27″ iMacs on sale for up to $205 off MSRP including free shipping plus NY sales tax only: - 21″ 1.4GHz iMac: $1019 $80 off - 21″ 2.7GHz iMac: $1189 $110 off - 21″ 2.9GHz... Read more
Sale! 16GB iPhone 5S for $1 with service
Best Buy is offering 16GB iPhone 5Ss for $1.00 with 2-year activation at a participating cellular provider. Choose free home shipping and activation, or buy online and activate during in-store pickup... Read more
Apple refurbished 2014 MacBook Airs available...
The Apple Store has Apple Certified Refurbished 2014 MacBook Airs available starting at $679. An Apple one-year warranty is included with each MacBook, and shipping is free. These are currently the... Read more
27-inch 3.5GHz 5K iMac on sale for $2349, sav...
 Adorama has the 27″ 3.5GHz 5K iMac in stock today and on sale for $2349 including free shipping plus NY & NJ sales tax only. Their price is $150 off MSRP. For a limited time, Adorama will... Read more
Save up to $380 on an iMac with Apple refurbi...
The Apple Store has Apple Certified Refurbished iMacs available for up to $380 off the cost of new models. Apple’s one-year warranty is standard, and shipping is free: - 27″ 3.5GHz 5K iMac – $2119 $... Read more
iFixIt Teardown Awards 12-IInch Retina MacBoo...
iFixIt has posted its illustrated teardown of the new 12-inch MacBook Retina. They note that this new MacBook is less than half the thickness of the last Apple notebook called just “MacBook” back in... Read more

Jobs Board

Event Director, *Apple* Retail Marketing -...
…This senior level position is responsible for leading and imagining the Apple Retail Team's global engagement strategy and team. Delivering an overarching brand Read more
*Apple* Retail - Multiple Positions (US) - A...
Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, you're also the Read more
Communication Manager - *Apple* Pay - Apple...
**Job Summary** This position works within the Apple Pay Merchant Solutions team to create, as well as oversee the development of, materials for use by Apple Pay Read more
Project Manager / Business Analyst, WW *Appl...
…a senior project manager / business analyst to work within our Worldwide Apple Fulfillment Operations and the Business Process Re-engineering team. This role will work Read more
Marketing Program Manager, *Apple* Retail O...
**Job Summary** Imagine what you could do here. At Apple , great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.