Apple patent is for dynamic adjustment of video streams
TweetFollow Us on Twitter

Apple patent is for dynamic adjustment of video streams

An Apple patent (number 20110202674) for dynamic adjustments of video streams has appeared at the US Patent & Trademark Office. It relates to streaming video from a server to a client.

Per the patent, using both short term and long term thinning mechanisms, the server reduces its data transfer rate when bandwidth is reduced and increases its data transfer rate when bandwidth is available. In the short term mechanism, the server will dynamically adjust the transmission rate of the video or the quality of the video based on parameters returned by the client. These parameters include currently-buffered data-size, buffered-data duration, and packet loss rate.

In the long term mechanism, the server will adjust the current maximum quality level allowed depending upon the round trip times of data packets transmitted. This invention decreases client rebuffering and packet loss and increases the efficiency of available bandwidth. The inventors are George P. Su and John K. Murata.

Here's Apple's background and summary of the invention: "The use of multimedia content on computing devices has increased substantially. Multimedia content is sent from a central server as streaming video and audio files. Streaming of video from a server to a client requires a server, a client and a network. The server transmits the content, the client receives and plays the content and the network transfers the data from the server to the client.

"The server sends out data in small chunks, called data packets, through the network to a client. The client receives the data packets which are then combined together to form the video program and played.

"Different protocols are employed to send data through a network including TCP, Reliable UDP and UDP Streaming. TCP or transport control protocol creates connections between servers and clients and guarantees reliable and in-order delivery of data from the server to the client. Reliable UDP, or reliable user datagram protocol, incorporates quality of service enhancements that improve the ability of real time streaming of data and provides pseudo-guarantees of delivery.

"Reliable UDP retransmits data that has not been received by the client until it detects that the data is late for real time streaming of content. Finally, in UDP streaming, there is no guarantee that the information sent by the server is received by the client. Rather, the data is sent by the server to the client without any retransmission. However, the client will report back to the client any packet loss that has occurred.

"The client can be a variety of devices such as a desktop or laptop computer. The client can also be a mobile device, an evolving category that currently includes but is not limited to cellular telephones, personal data assistants (PDAs) and mobile gaming consoles. For mobile devices, protocols have been developed to regulate the sending and receiving of data, one of which is 3GPP (3rd Generation Partnership Project).

"When the content is streamed, the bandwidth reaching that client may fluctuate. These fluctuations are the result of natural conditions affecting the transmission of data and from congestion in the data network itself. The result of these fluctuations may be interruption of the streaming video or underutilization of available bandwidth.

"Content providers have resolved these difficulties in a number of ways. One prior approach is to make several versions of the same content with different qualities of video. For example, a content provider provides two versions of a program, one lower resolution for lower bandwidth, and one higher resolution for higher bandwidth capabilities.

"The provider initially detects what the user is capable of receiving and sends her the appropriate version, an action called stream switching. Difficulties arise if the network bandwidth changes midstream. The provider may not be able to make adjustments to the stream dynamically.

"In another prior approach, the content provider produces two independent versions of a program that is not based on resolution or bandwidths. For instance, a video program is made with one version showing the program from the point of view of the hero and the other from the point of view of the villain. The user indicates which version she wishes to view and the server sends that version to the client.

"The provider may also wish to provide more versions of a program to stream which allows for more variation of bandwidths. Different cellular telephone models exhibit different reception rates and different telephone carriers provide different transmission rates. To provide the highest quality content to the user, content providers would create a version of their programming for each carrier and telephone model. However, this results in greater expenses to create and store additional versions of the same program.

"Another prior approach is to compress the streamed multimedia content to the user as it is being transmitted. The available bandwidth can be detected and the content is compressed to a necessary size in order to ensure smooth delivery. However, this entails more computing resources each time the number of users increases. To compress and stream a program to five users would not be difficult, but the computing resources required to compress and stream to ten thousand individual users presents a challenge.

"Another prior approach in which to decrease the amount of data being sent by the server is to selectively remove frames from the video program. In this method, the program is pre-created and stored on the server. Video programs are essentially still frames being shown at a rapid rate. Because the frame rate is high, the viewer is tricked into believing there is actual motion.

"The server analyzes the video program and based on an algorithm, makes decisions that indicate which frames are more important than others. The frames which are deemed important are the 'key frames.' When the bandwidth of the network decreases and the data transmission rate must be lowered, the server selectively removes non-key frames from the video, but the audio portion of the program remains intact.

"This process is called 'thinning.' The client receives the video program with the frames removed. The video may appear jerky because of the missing frames but the user is able to view the program primarily intact. Based on quality of service considerations, the audio portion of the program is not interrupted so that the viewing experience is improved.

"Based on the foregoing, it is clearly desirable to provide a mechanism that allows content providers to dynamically change the quality and transmission rate of multimedia content based on fluctuating bandwidth. It is further desirable to provide a mechanism for allowing content providers to present their offerings in various bandwidths without creating multiple versions of the same program.

"It is also desirable to provide a mechanism for adjusting the quality of a program and making it available to many users without the use of data compression. It is also desirable to provide a mechanism for dynamically adjusting the amount of data transmitted to make the most efficient use of available bandwidth.

"The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section."

-- Dennis Sellers


Community Search:
MacTech Search:

Software Updates via MacUpdate

World of Tanks Generals guide - Tips and...
World of Tanks Generals is a brand new card game by the developer behind the World of Tanks shooter franchise. It plays like a cross between chess and your typical card game. You have to keep in consideration where you place your tanks on the board... | Read more »
TruckSimulation 16 guide: How to succeed...
Remember those strangely enjoyable truck missions in Grand Theft Auto V whereit was a disturbing amount of fun to deliver cargo? TruckSimulation 16 is reminiscent of that, and has you play the role of a truck driver who has to deliver various... | Read more »
The best GIF making apps
Animated GIFs have exploded in popularity recently which is likely thanks to a combination of Tumblr, our shorter attention spans, and the simple fact they’re a lot of fun. [Read more] | Read more »
The best remote desktop apps for iOS
We've been sifting through the App Store to find the best ways to do computer tasks on a tablet. That gave us a thought - what if we could just do computer tasks from our tablets? Here's a list of the best remote desktop apps to help you use your... | Read more »
Warhammer 40,000: Freeblade guide - How...
Warhammer 40,000: Freebladejust launched in the App Store and it lets you live your childhood dream of blowing up and slashing a bunch of enemies as a massive, hulking Space Marine. It's not easy being a Space Marine though - and particularly if... | Read more »
Gopogo guide - How to bounce like the be...
Nitrome just launched a new game and, as to be expected, it's a lot of addictive fun. It's called Gopogo, and it challenges you to hoparound a bunch of platforms, avoiding enemies and picking up shiny stuff. It's not easy though - just like the... | Read more »
Sago Mini Superhero (Education)
Sago Mini Superhero 1.0 Device: iOS Universal Category: Education Price: $2.99, Version: 1.0 (iTunes) Description: KAPOW! Jack the rabbit bursts into the sky as the Sago Mini Superhero! Fly with Jack as he lifts impossible weights,... | Read more »
Star Wars: Galaxy of Heroes guide - How...
Star Wars: Galaxy of Heroes is all about collecting heroes, powering them up, and using them together to defeat your foes. It's pretty straightforward stuff for the most part, but increasing your characters' stats can be a bit confusing because it... | Read more »
The best cooking apps (just in time for...
It’s that time of year again, where you’ll be gathering around the dinner table with your family and a huge feast in front of you. [Read more] | Read more »
Square Rave guide - How to grab those te...
Square Rave is an awesome little music-oriented puzzle game that smacks of games like Lumines, but with its own unique sense of gameplay. To help wrap your head around the game, keep the following tips and tricks in mind. [Read more] | Read more »

Price Scanner via

Cyber Monday: Apple MacBooks on sale for up t...
Apple resellers have MacBook Pros, MacBook Airs, and MacBooks on sale for up to $250 off MSRP for Cyber Monday 2015. The following is a roundup of the lowest prices available for new models from any... Read more
Cyber Monday: 15% off Apple products, and sto...
Use code CYBER15 on Cyber Monday only to take 15% on Apple products at Target, and store-wide. Choose free shipping or free local store pickup (if available). Sale prices for online orders only, in-... Read more
iPad Air 2 And iPad mini Among Top Five Black...
Adobe has released its 2015 online shopping data for Black Friday and Thanksgiving Day. The five best selling electronic products on Black Friday were Samsung 4K TVs, Apple iPad Air 2, Microsoft Xbox... Read more
All-in-one PC Shipments Projected To Drop Ove...
Digitimes’ Aaron Lee and Joseph Tsai report that all-in-one (AIO) PC shipments may drop a double-digit percentage on-year in 2015 due to weaker-than-expected demand, although second-largest AIO make... Read more
Sprint Offers iPad Pro
Sprint now offers Apple’s new iPad Pro with Wi-Fi + Cellular, featuring a 12.9-inch Retina display with 5.6 million pixels. Customers can pick up iPad Pro at select Sprint retail locations. It can... Read more
Cyber Monday: Target offers 15% discount on A...
Target has discounted Apple Watches by 15% for Cyber Monday. Choose free shipping or free local store pickup (if available). Sale prices for online orders only, in-store prices may vary: - Apple... Read more
Sunday roundup of Holiday weekend Mac sales:...
Take up to $500 off MSRP on the price of a new Mac at B&H Photo today as part of their Black Friday/Holiday weekend sale. Shipping is free, and B&H charges NY tax only. These prices are... Read more
Holiday weekend: Apple Watch on sale for $50-...
B&H Photo has the Apple Watch on sale today for $50-$100 off MSRP. Shipping is free, and B&H charges NY sales tax only: - Apple Watch Sport: $50 off - Apple Watch: $50-$100 off Read more
Holiday weekend: iPad Air 2s on sale for up t...
B&H Photo has iPad Air 2s on sale for up to $80 off MSRP including free shipping plus NY sales tax only: - 16GB iPad Air 2 WiFi: $459 $40 off - 64GB iPad Air 2 WiFi: $569 $30 off - 128GB iPad Air... Read more
Holiday weekend Mac sales roundup: B&H Ph...
B&H Photo continues to have all new Macs on sale for up to $500 off MSRP as part of their Black Friday/Holiday weekend sale. Shipping is free, and B&H charges NY tax only: - 15″ 2.2GHz Retina... Read more

Jobs Board

Technical Program Manager, Strategic Merchant...
# Technical Program Manager, Strategic Merchants - Apple Pay Job Number: 44001177 Santa Clara Valley, Califo ia, United States Posted: Oct. 30, 2015 Weekly Hours: 40.00 Read more
Frameworks Engineer, *Apple* Watch - Apple...
# Frameworks Engineer, Apple Watch Job Number: 41403122 Santa Clara Valley, Califo ia, United States Posted: Jul. 1, 2015 Weekly Hours: 40.00 **Job Summary** Join the Read more
Software Engineer - *Apple* Pay - Apple (Un...
# Software Engineer - Apple Pay Job Number: 44003246 Santa Clara Valley, Califo ia, United States Posted: Nov. 16, 2015 Weekly Hours: 40.00 **Job Summary** Apple Pay Read more
Merchant Operations Manager: *Apple* Pay -...
# Merchant Operations Manager: Apple Pay Job Number: 43593822 Santa Clara Valley, Califo ia, United States Posted: Nov. 10, 2015 Weekly Hours: 40.00 **Job Summary** The Read more
Product Design Engineer - *Apple* Watch - A...
# Product Design Engineer - Apple Watch Job Number: 41727161 Santa Clara Valley, Califo ia, United States Posted: Jul. 22, 2015 Weekly Hours: 40.00 **Job Summary** Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.