TweetFollow Us on Twitter

MacTech Magazine Article Archives

Volume Number: 23 (2007)
Issue Number: 01
Column Tag: Network Administration

Jumbo Frame Networks

Tap into extra Ethernet speed

By Steve Modica

Approximately one year ago, Apple introduced its first dual Ethernet G5 PowerMac. The system sported an internal Broadcom chip that provided the user with two high-speed Gigabit Ethernet ports.

Why would Apple include a second Ethernet port on their new PowerMac systems? One reason (probably the most obvious) is for Xsan support. To add a system to an Xsan storage network (or almost any clustered filesystem network), the system must be connected to the Fibre Channel based storage, its normal internet connection, and a dedicated "Meta-data" network.

On the previous generation of PowerMacs, this would require the customer to purchase an extra Gigabit Ethernet NIC (network interface card), which uses up one PCIX or PCIE slot and requires the user to open up the machine to install the device. When you consider the extra Fibre Channel card (which may have been ordered directly from Apple), you're now down to one free PCI slot to house your high-speed video capture or other application specific devices.

Given the minimal price premium for going to a dual port Gigabit Chip from a single port, adding that second connector was a no-brainer for Apple.

Xsan and clustered filesystems in general, have a lot of promise. Systems can be attached directly to the shared storage using Fibre Channel, and the Ethernet based "meta-data" network is used as the traffic cop. It assures that multiple systems aren't modifying the same filesystem structures simultaneously.

The problem with these new filesystem technologies is the entry point cost. Purchasing an Apple XRAID is quite economical given their cost per byte ratio (one of the lowest in the industry), but when you add in the cost of a Fibre Channel switch, Fibre Channel adapters for each machine, additional Ethernet ports for the meta-data network and the software licenses, the cost begins to approach $30,000 for even the smallest network. When compared to even high-end NAS storage devices, the choice is easy.

So assuming you are one of the many 5-10 system shops that simply can't justify a $30,000 entry point for storage, but you've paid for all of these great PowerMac and Mac Pro systems with second Gigabit Ethernet ports, what can you do to take advantage of them? There's nothing worse than buying something and leaving it sit idle, especially when shared network performance is one of the most common complaints at small shops.

One very common use of these extra ports is to create a dedicated storage network that uses Gigabit Ethernet's built-in "jumbo frame" technology to speed up the transfer of data, while reducing the amount of cpu overhead created when transferring that data.

A configuration like this can significantly improve network performance for file-transfers, captures and downloads, while freeing the "normal" office network for things like email, web browsing and DHCP services. This setup will also increase the amount of CPU cycles available on the server and the clients for local image processing -- a big win for everyone in the office.

What are Jumbo Frames? Seven years ago, when Gigabit Ethernet was just becoming available, processors were a lot slower than they are today. Vendors weren't crowing about how many Ghz their systems were clocked at. They were still working on hitting the 1Ghz mark! These new "high-speed" Gigabit adapters were expensive and quirky. Finding adapters (which typically ran $1500 or more) that worked with all your platforms and a switch that worked with all your adapters was no small task.

During this period, a typical Gigabit Ethernet adapter would easily eat up an entire CPU just for interrupt processing. It was rare to see a Gigabit adapter perform at "line rate" (IE 1 Gb). More typically, adapters would get between 400 and 600Mbits/sec. This is still plenty good, but it must be remembered that while maintaining these rates, your machine wasn't doing anything else.

Enter the notion of "Jumbo Frames"

Ethernet (and all of its add-on features) are defined as IEEE 802.3. This spec includes things like auto-negotiation, link aggregation, 10MbEthernet, 100Mb/Ethernet and even 10Gb/Ethernet. The spec defines the size of an Ethernet frame as 1500 bytes -- typically somewhere between 1488 and 1514 bytes depending on the platform.

Receiving 1 billion bits of data adds up to 83,333 packets per second. Theoretically, each one of these packets requires the CPU to stop what its doing, receive the packet from the Gigabit card, process the headers, and provide the data to the waiting application (you).

At 83,333 packets per second, most of the CPUs time is spent context switching. It's constantly saving and recalling what it was doing just prior to processing your last packet. No real work is getting done.

Vendors quickly realized that unless they wanted to wait for processor and bus speeds to catch up, they wouldn't sell many cards. They needed a solution that would allow their products to work on the slower processors available at that time. Jumbo frames provided one such solution.

Rather than moving data in 1500 byte chunks, they allowed their cards to use much larger packets. Some vendors supported 16384 bytes, others supported smaller numbers. The "de facto" standard was 9000 bytes.

At 9000 bytes per frame, the packet processing load is reduced by a factor of 6 (13,888 packets per second). The CPU has 1/6th the number of headers to process and theoretically, 1/6th the number of interrupts to handle.

Today, all but the very cheapest switches support jumbo frames and switch ports for Gigabit are well under $100 per port. This makes it extremely easy and economical to create a dedicated jumbo frame network.

Benefits

1. Having a separate network means less bandwidth contention for critical operations like captures or online editing.

2. Jumbo frames allow local systems to have more CPU cycles available for things like Final Cut Pro, improving the users experience running the application.

3. A jumbo frame network can support a larger class of systems including Apple Macbook, Macbook Pros, Mac Minis and iMacs.

4. Jumbo frames can be used to access "storage over Ethernet" devices like iSCSI and AoE RAIDS, such as those designed by companies like 2 Degrees Frost. These products eliminate typical bottlenecks found in client/server networks.

Conclusion

Having extra Gigabit ports on your machines makes using jumbo frames easier than ever and the benefits are tremendous. All small video capture and post houses, audio and pre-press shops should consider this simple, elegant solution to improve their network without breaking the bank.


Steve Modica is the Chief Technical Officer of Small Tree Communications. Mr. Modica brings over 15 years of experience in the field of high performance operating systems to the company. Prior to founding STC, he worked at Silicon Graphics Inc. managing a group of device driver engineers and managing third party vendor relationships. For the four years prior to joining SGI, he owned and operated HPC Consulting; a company specialized in customizing corporate networks. Mr. Modica attended Wayne State University in Detroit on a Merit Scholarship and received his degree in Electrical Engineering in 1992.

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

TunnelBear 3.5.1 - Subscription-based pr...
TunnelBear is a subscription-based virtual private network (VPN) service and companion app, enabling you to browse the internet privately and securely. Features Browse privately - Secure your data... Read more
Typinator 7.4 - Speedy and reliable text...
Typinator turbo-charges your typing productivity. Type a little. Typinator does the rest. We've all faced projects that require repetitive typing tasks. With Typinator, you can store commonly used... Read more
Monosnap 3.4.9 - Versatile screenshot ut...
Monosnap lets you capture screenshots, share files, and record video and .gifs! Features Capture Capture full screen, just part of the screen, or a selected window Make your crop area pixel... Read more
Fantastical 2.4.5 - Create calendar even...
Fantastical 2 is the Mac calendar you'll actually enjoy using. Creating an event with Fantastical is quick, easy, and fun: Open Fantastical with a single click or keystroke Type in your event... Read more
TunnelBear 3.5.1 - Subscription-based pr...
TunnelBear is a subscription-based virtual private network (VPN) service and companion app, enabling you to browse the internet privately and securely. Features Browse privately - Secure your data... Read more
Typinator 7.4 - Speedy and reliable text...
Typinator turbo-charges your typing productivity. Type a little. Typinator does the rest. We've all faced projects that require repetitive typing tasks. With Typinator, you can store commonly used... Read more
Fantastical 2.4.5 - Create calendar even...
Fantastical 2 is the Mac calendar you'll actually enjoy using. Creating an event with Fantastical is quick, easy, and fun: Open Fantastical with a single click or keystroke Type in your event... Read more
Monosnap 3.4.9 - Versatile screenshot ut...
Monosnap lets you capture screenshots, share files, and record video and .gifs! Features Capture Capture full screen, just part of the screen, or a selected window Make your crop area pixel... Read more
Skim 1.4.32 - PDF reader and note-taker...
Skim is a PDF reader and note-taker for OS X. It is designed to help you read and annotate scientific papers in PDF, but is also great for viewing any PDF file. Skim includes many features and has a... Read more
ForkLift 3.1.1 - Powerful file manager:...
ForkLift is a powerful file manager and ferociously fast FTP client clothed in a clean and versatile UI that offers the combination of absolute simplicity and raw power expected from a well-executed... Read more

Latest Forum Discussions

See All

What mobile gaming can learn from the Ni...
While Nintendo might not have had things all its own way since it began developing for mobile, one thing it has got right is the release of the Switch. After the disappointment of the WiiU, which I still can't really explain, the Switch felt a... | Read more »
Programmer of Sonic The Hedgehog launche...
Japanese programmer Yuji Naka is best known for leading the team that created the original Sonic The Hedgehog. He’s moved on from the speedy blue hero since then, launching his own company based in Tokyo – Prope Games. Legend of Coin is the... | Read more »
Why doesn't mobile gaming have its...
The Overwatch League is a pretty big deal. It's an attempt to really push eSports into the mainstream, by turning them into, well, regular sports. But slightly less sweaty. It's a lavish affair with teams from all around the world, and more... | Read more »
Give Webzen’s new billiard game PoolTime...
Best known for producing hugely popular MMO titles, South Korean publisher Webzen is now taking aim at a different genre altogether. PoolTime is a realistic eight ball pool simulator, allowing you to compete in real-time matches against players... | Read more »
Let Them Come Guide - How to survive aga...
Let Them Come is all about making it as far as possible against overwhelming odds. Check out some of these tips to help you last a little longer in your unwinnable fight: [Read more] | Read more »
All the best games on sale for iPhone an...
Happy last day of the week. I hope you've been having a good one. I have. I saw ten doggos today. So because I'm in a good mood, I thought I'd round up all of the best games that are currently on sale on the App Store. [Read more] | Read more »
The very best games that came out for iP...
We're getting to the end of the first real, full, proper week of 2018. And in that time we've seen some pretty awesome games landing on the App Store. Of course, we've seen some absolute duffers as well. The sort of games that you look at and... | Read more »
Rusty Lake Paradise (Games)
Rusty Lake Paradise 1.4 Device: iOS Universal Category: Games Price: $2.99, Version: 1.4 (iTunes) Description: Jakob, the oldest son of the Eilander family, is returning to Paradise island after his mother passed away. Since her... | Read more »
Antihero Guide - Sneaky tricks to get ah...
Games of Antihero start out small and streamlined, but they quickly turn into long strategic conquests as you fight for control of the Victorian-era streets. If you find yourself struggling in the skullduggery department, here are a few things you... | Read more »
Here's why Niantic pulling Pokemon...
If there's one thing that Pokemon GO did well, it was bringing people together. I still remember seeing groups of people around the marina near where I live in the weeks after the game came out, all of them trying to grab some water Pokemon. There... | Read more »

Price Scanner via MacPrices.net

10″ iPad Pros on sale for $50-$75 off MSRP, n...
B&H Photo has 10″ and #Apple #iPad Pros on sale for up to $75 off MSRP. Shipping is free, and B&H charges sales tax in NY & NJ only. Note that some sale prices are restricted to certain... Read more
Apple refurbished Mac minis available startin...
Apple has restocked Certified Refurbished Mac minis starting at $419. Apple’s one-year warranty is included with each mini, and shipping is free: – 1.4GHz Mac mini: $419 $80 off MSRP – 2.6GHz Mac... Read more
Amazon offers Silver 13″ Apple MacBook Pros f...
Amazon has new Silver 2017 13″ #Apple #MacBook Pros on sale today for up to $150 off MSRP, each including free shipping: – 13″ 2.3GHz/128GB Silver MacBook Pro (MPXR2LL/A): $1199.99 $100 off MSRP – 13... Read more
Sale: 12″ 1.3GHz MacBooks on sale for $1499,...
B&H Photo has Space Gray and Rose Gold 12″ 1.3GHz #Apple MacBooks on sale for $100 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 12″ 1.3GHz Space... Read more
Apple offers Certified Refurbished 2017 iMacs...
Apple has a full line of Certified Refurbished iMacs available for up to $350 off original MSRP. Apple’s one-year warranty is standard, and shipping is free. The following models are available: – 27... Read more
13″ MacBook Airs on sale for $120-$100 off MS...
B&H Photo has 2017 13″ 128GB MacBook Airs on sale for $120 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 13″ 1.8GHz/128GB MacBook Air (MQD32LL/A): $... Read more
15″ Touch Bar MacBook Pros on sale for up to...
Adorama has Space Gray 15″ MacBook Pros on sale for $200 off MSRP. Shipping is free, and Adorama charges sales tax in NJ and NY only: – 15″ 2.8GHz MacBook Pro Space Gray (MPTR2LL/A): $2199, $200 off... Read more
21″ 3.4GHz 4K iMac on sale for $1399, $100 of...
Adorama has the 21″ 3.4GHz 4K #Apple #iMac on sale today for $1399. Their price is $100 off MSRP. Shipping is free, and Adorama charges sales tax in NJ and NY only: – 21″ 3.4GHz 4K iMac (MNE02LL/A... Read more
B&H offering 13″ Apple MacBook Pros for u...
B&H Photo has 13″ MacBook Pros on sale for up to $75-$120 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 13-inch 2.3GHz/128GB Space Gray MacBook Pro (... Read more
B&H continues to offer clearance 2016 15″...
B&H Photo has clearance 2016 15″ #MacBook Pros available for up to $800 off original MSRP. Shipping is free, and B&H charges NY & NJ sales tax only: – 15″ 2.7GHz Touch Bar MacBook Pro... Read more

Jobs Board

Commerce Engineer, *Apple* Media Products -...
# Commerce Engineer, Apple Media Products Job Number: 113161479 Santa Clara Valley, California, United States Posted: 01-Nov-2017 Weekly Hours: 40.00 **Job Summary** Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description:SalesSpecialist - Retail Customer Service and SalesTransform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
Site Reliability Engineer, *Apple* Pay - Ap...
# Site Reliability Engineer, Apple Pay Job Number: 113356036 Santa Clara Valley, California, United States Posted: 12-Jan-2018 Weekly Hours: 40.00 **Job Summary** Read more
UI Tools and Automation Engineer, *Apple* M...
# UI Tools and Automation Engineer, Apple Media Products Job Number: 86351939 Santa Clara Valley, California, United States Posted: 11-Jan-2018 Weekly Hours: 40.00 Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.