Apple patent involves encoding video data
TweetFollow Us on Twitter

Apple patent involves encoding video data

An Apple patent (number 8018994) for selecting encoding types and predictive mode for encoding types and predictive modes for encoding video data. It's directed towards selecting encoding types and predictive modes for encoding video data.

In some embodiments, a method of determining encoding type and predictive mode(s) selections for a macroblock of a video frame is provided. In some embodiments, a general method 1) selects the encoding type (16.times.16 or 4.times.4) that is initially considered for a macroblock using an encoding type selection algorithm (based on an attribute of the macroblock that is easy to compute), 2) if the 16.times.16 encoding type is selected in step 1, consider the four 16.times.16 prediction modes that may be used on the macroblock using conventional methods or an improved 16.times.16 predictive mode search algorithm based on distortion thresholds, and 3) if the 4.times.4 encoding type is selected in step 1, select the 4.times.4 prediction mode to be used for each of the sixteen 4.times.4 blocks of the macroblock using conventional methods or an improved 4.times.4 predictive mode search algorithm based on the positional relationships between predictive modes. The inventors ate Xin Tong and Xiaocun Nie.

Here's Apple's background and summary of the invention: "A video stream is comprised of a sequence of video frames where each frame is comprised of multiple macroblocks. Each macroblock is typically a 16.times.16 array of pixels, although other sizes of macroblocks are also possible. Video codecs (COmpressor-DECompressor) are software, hardware, or combined software and hardware implementations of compression algorithms designed to encode/compress and decode/decompress video data streams to reduce the size of the streams for faster transmission and smaller storage space. While lossy, video codecs attempt to maintain video quality while compressing the binary data of a video stream. Examples of popular video codecs include WMV, RealVideo, as well as implementations of compression standards such as MPEG-2, MPEG-4, H.261, H.263, and H.264.

"Under H.264 compression standards, a macroblock of a video frame can be intra encoded as a 16.times.16 pixel array, the pixel values of the array being predicted using values calculated from previously encoded macroblocks. A 16.times.16 macroblock can also be intra encoded as sixteen 4.times.4 pixel arrays, where pixel values in each 4.times.4 array are predicted using values calculated from previously encoded 4.times.4 arrays. There are 4 possible intra prediction modes for 16.times.16 arrays (luma blocks) and 9 possible intra prediction modes for 4.times.4 arrays (luma blocks).

"As such, in encoding a macroblock, two determinations (selections) must be made: 1) whether the macroblock is to be encoded as a 16.times.16 array (referred to herein as 16.times.16 encoding) or as sixteen 4.times.4 arrays (referred to herein as 4.times.4 encoding), and 2) the predictive mode(s) to be used to encode the macroblock. For example, if it is determined that the macroblock is to be encoded as a 16.times.16 array, it must also be determined which of the four predictive modes for the 16.times.16 array is to be used.

"If it is determined that the macroblock is to be encoded as a sixteen 4.times.4 arrays, it must also be determined, for each of the sixteen 4.times.4 arrays, which of the nine predictive modes for the 4.times.4 array is to be used. Step 1 is referred to herein as encoding type selection and step 2 is referred to herein as predictive mode selection.

"Encoding type selection and predictive mode selection are made using cost functions. For example, cost functions are typically used to determine whether a macroblock is to be encoded as a 16.times.16 array or as sixteen 4.times.4 arrays where the type of encoding (16.times.16 or 4.times.4 encoding) having the lower cost is chosen. Cost is typically equal to the distortion or the weighted average of distortion plus an estimate of the number of bits produced by the prediction mode, where an increase in distortion and/or number of bits increases the cost.

"Distortion reflects the difference between original pixel values and predicted (or encoded) values and can be measured in various ways. For example, distortion can be measured as the sum of the absolute differences between the original pixel values and predicted (or encoded) values.

"An exhaustive search approach to selecting an optimal encoding type (16.times.16 or 4.times.4 encoding) and optimal predictive mode(s) for a macroblock involves determining costs of all four 16.times.16 prediction modes and all combinations of nine 4.times.4 prediction modes for sixteen 4.times.4 blocks in the macroblock, where a 16.times.16 prediction mode or a particular combination of 4.times.4 prediction modes that gives the lowest cost is selected. For each macroblock, the exhaustive search approach requires consideration of 9^16 different combinations of 4.times.4 prediction modes, rendering the exhaustive search approach practically infeasible.

"As such, the following operations are typically performed to determine the encoding type and predictive mode(s) for a macroblock: 1) Compute the cost of all four possible 16.times.16 predictive modes. 2) For each of the sixteen 4.times.4 blocks, select the predictive mode (among the 9 predictive modes) having the lowest cost, and then compute the total cost of the resulting combination (i.e., the sum cost of the sixteen determined costs). 3) Compare the cost determined at step 1 with the cost determined at step 2 and select the lowest one. This selection provides both the encoding type selection and the predictive mode(s) selection.

"The conventional approach, however, still involves determining costs for 9.times.16 different combinations of the 4.times.4 predictive modes plus the costs for the four 16.times.16 predictive modes."

-- Dennis Sellers

 
AAPL
$519.01
Apple Inc.
+1.05
MSFT
$40.40
Microsoft Corpora
+0.65
GOOG
$556.54
Google Inc.
+20.10

MacTech Search:
Community Search:

Software Updates via MacUpdate

PDFpenPro 6.2 - Advanced PDF toolkit for...
PDFpenPro allows users to edit PDF's easily. Add text, images and signatures. Fill out PDF forms. Merge or split PDF documents. Reorder and delete pages. Even correct text and edit graphics! Create... Read more
PDFpen 6.2 - Edit and annotate PDFs with...
PDFpen allows users to easily edit PDF's. Add text, images and signatures. Fill out PDF forms. Merge or split PDF documents. Reorder and delete pages. Even correct text and edit graphics! Features... Read more
Monolingual 1.5.9 - Remove unwanted OS X...
Monolingual is a program for removing unnecesary language resources from OS X, in order to reclaim several hundred megabytes of disk space. It requires a 64-bit capable Intel-based Mac and at least... Read more
Maya 2015 - Professional 3D modeling and...
Maya is an award-winning software and powerful, integrated 3D modeling, animation, visual effects, and rendering solution. Because Maya is based on an open architecture, all your work can be scripted... Read more
Starcraft II: Wings of Liberty 1.1.1.180...
Download the patch by launching the Starcraft II game and downloading it through the Battle.net connection within the app. Starcraft II: Wings of Liberty is a strategy game played in real-time. You... Read more
Sibelius 7.5.0 - Music notation solution...
Sibelius is the world's best-selling music notation software for Mac. It is as intuitive to use as a pen, yet so powerful that it does most things in less than the blink of an eye. The demo includes... Read more
Typinator 5.9 - Speedy and reliable text...
Typinator turbo-charges your typing productivity. Type a little. Typinator does the rest. We've all faced projects that require repetitive typing tasks. With Typinator, you can store commonly used... Read more
MYStuff Pro 2.0.16 - Create inventories...
MYStuff Pro is the most flexible way to create detail-rich inventories for your home or small business. Add items to MYStuff by dragging and dropping existing information, uploading new images, or... Read more
TurboTax 2013.r17.002 - Manage your 2013...
TurboTax guides you through your tax return step by step, does all the calculations, and checks your return for errors and overlooked deductions. It lets you file your return electronically to get... Read more
TrailRunner 3.8.769 - Route planning for...
Note: While the software is classified as freeware, it is actually donationware. Please consider making a donation to help support development. TrailRunner is the perfect companion for runners,... Read more

Latest Forum Discussions

See All

Fourcast Review
Fourcast Review By Jennifer Allen on April 16th, 2014 Our Rating: :: VIDEO POTENTIALiPhone App - Designed for the iPhone, compatible with the iPad Fourcast is a great idea for combining video clips, but it does lack a number of... | Read more »
Hearthstone: Heroes of Warcraft is Avail...
Hearthstone: Heroes of Warcraft is Available on the U.S. App Store Right Now – Gogogogo! Posted by Rob Rich on April 16th, 2014 [ permalink ] | Read more »
Grammar Pop HD Review
Grammar Pop HD Review By Jennifer Allen on April 16th, 2014 Our Rating: :: FUN LEARNINGiPad Only App - Designed for the iPad Learning the different parts of speech isn’t always fun, but Grammar Pop HD makes it much more... | Read more »
Groundskeeper2 Review
Groundskeeper2 Review By Nadia Oxford on April 16th, 2014 Our Rating: :: SLICE THOSE ALIEN SLIMEUniversal App - Designed for iPhone and iPad Putting aside some minor control issues, Groundskeeper2 is a fun and furious action/... | Read more »
Pinnacle Studio for iPhone (Photography...
Pinnacle Studio for iPhone 5.0 Device: iOS iPhone Category: Photography Price: $9.99, Version: 5.0 (iTunes) Description: | Read more »
Season 3 of Zombies, Run! Starts Right N...
Season 3 of Zombies, Run! | Read more »
Snupps Review
Snupps Review By Jennifer Allen on April 16th, 2014 Our Rating: :: USEFUL LISTINGUniversal App - Designed for iPhone and iPad Got a huge collection that you need to organize, or just want to share with others? Snupps has it covered... | Read more »
Toad Rider Goes Free for a Limited Time,...
Toad Rider Goes Free for a Limited Time, Starting This Week Posted by Tre Lawrence on April 16th, 2014 [ permalink ] Universal App - Designed for iPhone and iPad | Read more »
Knights of Pen & Paper is Free for a...
Knights of Pen & Paper is Free for a Limited Time – Don’t Wait for a Natural 20, Get it Now! Posted by Rob Rich on April 16th, 2014 [ permalink ] | Read more »
R.B.I. Baseball 14 Review
R.B.I. Baseball 14 Review By Blake Grundman on April 16th, 2014 Our Rating: :: RETRO REVIVEDUniversal App - Designed for iPhone and iPad What was old is new again, as the MLB attempts to taking baseball gaming back to its retro... | Read more »

Price Scanner via MacPrices.net

Microsoft Blinks – Drops Microsoft Office 365...
Microsoft has dropped the annual subscription fee for Microsoft Office 365 Personal – which is needed in order to create and edit documents in Microsoft Office for iPad. However, Apple’s iOS and OS X... Read more
New AVG Vault Apps for iOS and Android Help K...
AVG Technologies N.V. an online security company for 177 million active users, has announced the launch of its latest mobile application, AVG Vault. The free app introduces an innovative user... Read more
Free Local Carrot iPhone App Helps Find Fresh...
I love fresh vegetables. I’m not a vegan, although I was for several years in the 1980s, but fresh vegetables and other whole foods are still my dietary mainstays as a matter of taste rather than... Read more
Apple refurbished iPad Airs available startin...
Apple is now offering Certified Refurbished iPad Airs for up to $140 off MSRP. Apple’s one-year warranty is included with each model, and shipping is free. The following Airs are available today: -... Read more
21-inch 2.7GHz iMac on sale for $1179, save $...
B&H Photo has the 21″ 2.7GHz iMac on sale for $1179 including free shipping plus NY sales tax only. Their price is $120 off MSRP. Add an iMac to your shopping cart, and B&H will offer an... Read more
Download our app, iTracx, for iOS and Android
MacPrices is proud to offer readers a free iOS app (iPhones, iPads, & iPod touch) and Android app (Google Play and Amazon App Store) called iTracx, which allows you to glance at today’s lowest... Read more
Education discounts shave up to $300 off the...
Purchase a new Mac at The Apple Store for Education and take up to $300 off MSRP. All teachers, students, and staff of any educational institution qualify for the discount. Shipping is free, and all... Read more
Save $50 on Mac mini Server
B&H Photo has the 2012 Mac mini Server on sale for $949 including free shipping plus NY sales tax only. Their price is $50 off MSRP. Read more
PhatWare’s “Ultimate Writing App For iOS” Ren...
PhatWare Corp. has announced it has renamed its new WritePro word processing app for iPhone and iPad: WritePad Pro. The decision to change the app’s name to leverages the strong brand awareness and... Read more
Full Resolution Photo Editor Tint Mint 1.0 Re...
California based independent developer, Jeffrey Sun, creator of the iOS app Modern Editor, has released Tint Mint, a new photography app for editing enthusiasts. The app costs a dollar, and it packs... Read more

Jobs Board

*Apple* Retail - Manager - Holyoke - Apple I...
Job Summary Keeping an Apple Store thriving requires a diverse set of leadership skills, and as a Manager, you’re a master of them all. In the store’s fast-paced, Read more
*Apple* Retail - Manager - Apple (United Sta...
Job SummaryKeeping an Apple Store thriving requires a diverse set of leadership skills, and as a Manager, you're a master of them all. In the store's fast-paced, dynamic Read more
*Apple* Solutions Consultant (ASC) - Apple (...
**Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
*Apple* Retail - Market Leader - Cincinnati...
…challenges of developing individuals, building teams, and affecting growth across Apple Stores. You demonstrate successful leadership ability - focusing on excellence Read more
*Apple* Retail - Manager - SoHo - Apple (Uni...
Job SummaryKeeping an Apple Store thriving requires a diverse set of leadership skills, and as a Manager, you're a master of them all. In the store's fast-paced, dynamic Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.