TweetFollow Us on Twitter

MacTech Magazine Article Archives

Volume Number: 23 (2007)
Issue Number: 01
Column Tag: Network Administration

Jumbo Frame Networks

Tap into extra Ethernet speed

By Steve Modica

Approximately one year ago, Apple introduced its first dual Ethernet G5 PowerMac. The system sported an internal Broadcom chip that provided the user with two high-speed Gigabit Ethernet ports.

Why would Apple include a second Ethernet port on their new PowerMac systems? One reason (probably the most obvious) is for Xsan support. To add a system to an Xsan storage network (or almost any clustered filesystem network), the system must be connected to the Fibre Channel based storage, its normal internet connection, and a dedicated "Meta-data" network.

On the previous generation of PowerMacs, this would require the customer to purchase an extra Gigabit Ethernet NIC (network interface card), which uses up one PCIX or PCIE slot and requires the user to open up the machine to install the device. When you consider the extra Fibre Channel card (which may have been ordered directly from Apple), you're now down to one free PCI slot to house your high-speed video capture or other application specific devices.

Given the minimal price premium for going to a dual port Gigabit Chip from a single port, adding that second connector was a no-brainer for Apple.

Xsan and clustered filesystems in general, have a lot of promise. Systems can be attached directly to the shared storage using Fibre Channel, and the Ethernet based "meta-data" network is used as the traffic cop. It assures that multiple systems aren't modifying the same filesystem structures simultaneously.

The problem with these new filesystem technologies is the entry point cost. Purchasing an Apple XRAID is quite economical given their cost per byte ratio (one of the lowest in the industry), but when you add in the cost of a Fibre Channel switch, Fibre Channel adapters for each machine, additional Ethernet ports for the meta-data network and the software licenses, the cost begins to approach $30,000 for even the smallest network. When compared to even high-end NAS storage devices, the choice is easy.

So assuming you are one of the many 5-10 system shops that simply can't justify a $30,000 entry point for storage, but you've paid for all of these great PowerMac and Mac Pro systems with second Gigabit Ethernet ports, what can you do to take advantage of them? There's nothing worse than buying something and leaving it sit idle, especially when shared network performance is one of the most common complaints at small shops.

One very common use of these extra ports is to create a dedicated storage network that uses Gigabit Ethernet's built-in "jumbo frame" technology to speed up the transfer of data, while reducing the amount of cpu overhead created when transferring that data.

A configuration like this can significantly improve network performance for file-transfers, captures and downloads, while freeing the "normal" office network for things like email, web browsing and DHCP services. This setup will also increase the amount of CPU cycles available on the server and the clients for local image processing -- a big win for everyone in the office.

What are Jumbo Frames? Seven years ago, when Gigabit Ethernet was just becoming available, processors were a lot slower than they are today. Vendors weren't crowing about how many Ghz their systems were clocked at. They were still working on hitting the 1Ghz mark! These new "high-speed" Gigabit adapters were expensive and quirky. Finding adapters (which typically ran $1500 or more) that worked with all your platforms and a switch that worked with all your adapters was no small task.

During this period, a typical Gigabit Ethernet adapter would easily eat up an entire CPU just for interrupt processing. It was rare to see a Gigabit adapter perform at "line rate" (IE 1 Gb). More typically, adapters would get between 400 and 600Mbits/sec. This is still plenty good, but it must be remembered that while maintaining these rates, your machine wasn't doing anything else.

Enter the notion of "Jumbo Frames"

Ethernet (and all of its add-on features) are defined as IEEE 802.3. This spec includes things like auto-negotiation, link aggregation, 10MbEthernet, 100Mb/Ethernet and even 10Gb/Ethernet. The spec defines the size of an Ethernet frame as 1500 bytes -- typically somewhere between 1488 and 1514 bytes depending on the platform.

Receiving 1 billion bits of data adds up to 83,333 packets per second. Theoretically, each one of these packets requires the CPU to stop what its doing, receive the packet from the Gigabit card, process the headers, and provide the data to the waiting application (you).

At 83,333 packets per second, most of the CPUs time is spent context switching. It's constantly saving and recalling what it was doing just prior to processing your last packet. No real work is getting done.

Vendors quickly realized that unless they wanted to wait for processor and bus speeds to catch up, they wouldn't sell many cards. They needed a solution that would allow their products to work on the slower processors available at that time. Jumbo frames provided one such solution.

Rather than moving data in 1500 byte chunks, they allowed their cards to use much larger packets. Some vendors supported 16384 bytes, others supported smaller numbers. The "de facto" standard was 9000 bytes.

At 9000 bytes per frame, the packet processing load is reduced by a factor of 6 (13,888 packets per second). The CPU has 1/6th the number of headers to process and theoretically, 1/6th the number of interrupts to handle.

Today, all but the very cheapest switches support jumbo frames and switch ports for Gigabit are well under $100 per port. This makes it extremely easy and economical to create a dedicated jumbo frame network.

Benefits

1. Having a separate network means less bandwidth contention for critical operations like captures or online editing.

2. Jumbo frames allow local systems to have more CPU cycles available for things like Final Cut Pro, improving the users experience running the application.

3. A jumbo frame network can support a larger class of systems including Apple Macbook, Macbook Pros, Mac Minis and iMacs.

4. Jumbo frames can be used to access "storage over Ethernet" devices like iSCSI and AoE RAIDS, such as those designed by companies like 2 Degrees Frost. These products eliminate typical bottlenecks found in client/server networks.

Conclusion

Having extra Gigabit ports on your machines makes using jumbo frames easier than ever and the benefits are tremendous. All small video capture and post houses, audio and pre-press shops should consider this simple, elegant solution to improve their network without breaking the bank.


Steve Modica is the Chief Technical Officer of Small Tree Communications. Mr. Modica brings over 15 years of experience in the field of high performance operating systems to the company. Prior to founding STC, he worked at Silicon Graphics Inc. managing a group of device driver engineers and managing third party vendor relationships. For the four years prior to joining SGI, he owned and operated HPC Consulting; a company specialized in customizing corporate networks. Mr. Modica attended Wayne State University in Detroit on a Merit Scholarship and received his degree in Electrical Engineering in 1992.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

iClock Pro 3.4.7 - Customize your menuba...
iClock Pro is a menu bar replacement clock for Apple's default clock. iClock Pro is an update, total rewrite and improvement to the popular iClock. Have the day, date and time in different fonts and... Read more
PhotoDesk 4.1.5 - Instagram client for p...
PhotoDesk lets you view, like, comment, and download Instagram pictures/videos. (NO Uploads! / Image Posting! Instagram forbids that! AND you need an existing Instagram account). But you can do so... Read more
Capo 3.5.1 - Slow down and learn to play...
Capo lets you slow down your favorite songs so you can hear the notes and learn how they are played. With Capo, you can quickly tab out your songs atop a highly-detailed OpenCL-powered spectrogram... Read more
HandBrake 1.0.2 - Versatile video encode...
HandBrake is a tool for converting video from nearly any format to a selection of modern, widely supported codecs. Features Supported Sources VIDEO_TS folder, DVD image or real DVD (unencrypted... Read more
Sound Studio 4.8.6 - Robust audio record...
Sound Studio lets you easily record and professionally edit audio on your Mac. Easily rip vinyls and digitize cassette tapes, or record lectures and voice memos. Prepare for live shows with live... Read more
HandBrake 1.0.2 - Versatile video encode...
HandBrake is a tool for converting video from nearly any format to a selection of modern, widely supported codecs. Features Supported Sources VIDEO_TS folder, DVD image or real DVD (unencrypted... Read more
PhotoDesk 4.1.5 - Instagram client for p...
PhotoDesk lets you view, like, comment, and download Instagram pictures/videos. (NO Uploads! / Image Posting! Instagram forbids that! AND you need an existing Instagram account). But you can do so... Read more
Sound Studio 4.8.6 - Robust audio record...
Sound Studio lets you easily record and professionally edit audio on your Mac. Easily rip vinyls and digitize cassette tapes, or record lectures and voice memos. Prepare for live shows with live... Read more
Capo 3.5.1 - Slow down and learn to play...
Capo lets you slow down your favorite songs so you can hear the notes and learn how they are played. With Capo, you can quickly tab out your songs atop a highly-detailed OpenCL-powered spectrogram... Read more
Google Earth 7.1.8.3036 - View and contr...
Google Earth gives you a wealth of imagery and geographic information. Explore destinations like Maui and Paris, or browse content from Wikipedia, National Geographic, and more. Google Earth combines... Read more

Super Mario Run dashes onto Android in M...
Super Mario Run was one of the biggest mobile launches in 2016 before it was met with a lukewarm response by many. While the game itself plays a treat, it's pretty hard to swallow the steep price for the full game. With that said, Android users... | Read more »
WarFriends Beginner's Guide: How to...
Chillingo's new game, WarFriends, is finally available world wide, and so far it's a refreshing change from common mobile game trends. The game's a mix of tower defense, third person shooter, and collectible card game. There's a lot to unpack here... | Read more »
Super Gridland (Entertainment)
Super Gridland 1.0 Device: iOS Universal Category: Entertainment Price: $1.99, Version: 1.0 (iTunes) Description: Match. Build. Survive. "exquisitely tuned" - Rock Paper Shotgun No in-app purches, and no ads! | Read more »
Red's Kingdom (Games)
Red's Kingdom 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: Mad King Mac has kidnapped your father and stolen your golden nut! Solve puzzles and battle goons as you explore and battle your... | Read more »
Turbo League Guide: How to tame the cont...
| Read more »
Fire Emblem: Heroes coming to Google Pla...
Nintendo gave us our first look at Fire Emblem: Heroes, the upcoming mobile Fire Emblem game the company hinted at last year. Revealed at the Fire Emblem Direct event held today, the game will condense the series' tactical RPG combat into bite-... | Read more »
ReSlice (Music)
ReSlice 1.0 Device: iOS Universal Category: Music Price: $9.99, Version: 1.0 (iTunes) Description: Audio Slice Machine Slice your audio samples with ReSlice and create flexible musical atoms which can be triggered by MIDI notes or... | Read more »
Stickman Surfer rides in with the tide t...
Stickson is back and this time he's taken up yet another extreme sport - surfing. Stickman Surfer is out this Thursday on both iOS and Android, so if you've been following the other Stickman adventures, you might be interested in picking this one... | Read more »
Z-Exemplar (Games)
Z-Exemplar 1.4 Device: iOS Universal Category: Games Price: $3.99, Version: 1.4 (iTunes) Description: | Read more »
5 dastardly difficult roguelikes like th...
Edmund McMillen's popular roguelike creation The Binding of Isaac: Rebirth has finally crawled onto mobile devices. It's a grotesque dual-stick shooter that tosses you into an endless, procedurally generated basement as you, the pitiable Isaac,... | Read more »

Price Scanner via MacPrices.net

12-inch 1.2GHz Space Gray Retina MacBook on s...
Amazon has the 2016 12″ 1.2GHz/512GB Space Gray Retina MacBook (Apple model #MLH82LL/A) on sale for $1299.99 including free shipping. Their price is $300 off MSRP. Read more
Twelve South Releases RelaxedLeather Cases fo...
Inspired by the laid-back luxury of burnished leather boots and crafted in rich tones of taupe, herb and marsala, RelaxedLeather cases deliver smart, easy protection for the iPhone 7. Each genuine... Read more
Week’s Best Deal: New 2016 13-inch 2.0GHz Mac...
Amazon has the new 2016 13″ 2.0GHz non-Touch Bar MacBook Pros on sale for a limited time for $225 off MSRP including free shipping: - 13″ 2.0GHz MacBook Pro, Space Gray (MLL42LL/A): $1274.99 $225 off... Read more
Back in stock: Apple refurbished Mac minis fr...
Apple has Certified Refurbished Mac minis available starting at $419. Apple’s one-year warranty is included with each mini, and shipping is free: - 1.4GHz Mac mini: $419 $80 off MSRP - 2.6GHz Mac... Read more
Apple Ranked ‘Most Intimate Brand’
The top ranked ‘”intimate” brands continued to outperform the S&P and Fortune 500 indices in revenue and profit over the past 10 years, according to MBLM’s Brand Intimacy 2017 Report, the largest... Read more
B-Eng introduces SSD Health Check for Mac OS
Fehraltorf, Switzerland based independant Swiss company- B-Eng has announced the release and immediate availability of SSD Health Check 1.0, the company’s new hard drive utility for Mac OS X. As the... Read more
Apple’s Education discount saves up to $300 o...
Purchase a new Mac or iPad using Apple’s Education Store and take up to $300 off MSRP. All teachers, students, and staff of any educational institution qualify for the discount. Shipping is free: -... Read more
4-core 3.7GHz Mac Pro on sale for $2290, save...
Guitar Center has the 3.7GHz 4-core Mac Pro (MD253LL/A) on sale for $2289.97 including free shipping or free local store pickup (if available). Their price is a $710 savings over standard MSRP for... Read more
128GB Apple iPad Air 2, refurbished, availabl...
Apple has Certified Refurbished 128GB iPad Air 2s WiFis available for $419 including free shipping. That’s an $80 savings over standard MSRP for this model. A standard Apple one-year warranty is... Read more
13-inch 2.7GHz Retina MacBook Pro on sale for...
B&H Photo has the 2015 13″ 2.7GHz/128GB Retina Apple MacBook Pro on sale for $100 off MSRP. Shipping is free, and B&H charges NY tax only: - 13″ 2.7GHz/128GB Retina MacBook Pro (MF839LL/A): $... Read more

Jobs Board

*Apple* macOS Systems Integration Administra...
…most exceptional support available in the industry. SCI is seeking an Junior Apple macOS systems integration administrator that will be responsible for providing Read more
*Apple* Retail - Multiple Positions- Deer Pa...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
*Apple* Technician - nfrastructure (United S...
Let’s Work Together Apple Technician This position is based in Portland, ME Life at nfrastructure At nfrastructure, we understand that our success results from our Read more
*Apple* Mobile Master - Best Buy (United Sta...
**467692BR** **Job Title:** Apple Mobile Master **Location Number:** 000602-Columbia MO-Store **Job Description:** **What does a Best Buy Apple Mobile Master Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.