Apple investigating 3D cameras for iPhones, iPads
TweetFollow Us on Twitter

Apple investigating 3D cameras for iPhones, iPads

An Apple patent (number 20110074931) for systems and methods for an imaging system using multiple image sensors has appeared at the US Patent & Trademark Office. It shows that Apple is considering future iPhones and iPads that can take 3D photos.

Per the patent Systems and methods may employ separate image sensors for collecting different types of data. In one embodiment, separate luma, chroma and 3-D image sensors may be used. The systems and methods may involve generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. The systems and methods may involve image sensing, capture, processing, rendering and/or generating images.

For example, one embodiment may provide an imaging system, including: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance, chrominance and three-dimensional data and to generate a composite image corresponding to the scene from that data. The inventors of the patent are Brett Bilbrey and Guy Cote.

Here's Apple's background and summary of the invention: "The use of separate luma and chroma image sensors, such as cameras, to capture a high quality image is known. In particular, the use of separate luma and chroma image sensors can produce a combined higher quality image when compared to what can be achieved by a single image sensor.

"Implementing an imaging system using separate luma and chroma image sensors involves dealing with alignment and disparity issues that result from separate image sensors. Specifically, known approaches deal with epipolar geometry alignment by generating a transform that can be applied to the luma and chroma data obtained by the separate image sensors. Known approaches deal with stereo disparity compensation using a software-based approach. The software-based approach extrapolates from the image data obtained by the luma and chroma image sensors. For example, one approach is to perform edge detection in the image data to determine what disparity compensation to apply.

"The approaches described herein involve a paradigm shift from the known software-based approaches. While the art has been directed to improvements in the software-based approaches, such improvements have not altered the fundamental approach. In particular, the extrapolation from the image data employed by the software-based approaches is not deterministic. As such, situations exist in which the software approaches must guess at how to perform stereo disparity compensation.

"For example, in software-based approaches that employ edge detection, an adjustment is made to attempt to compensate for offsets between edges in the chroma image and edges in the luma image. Depending on the image data, such software-based approaches may need to guess as to which way to adjust the edges for alignment. Guesses are needed to deal with any ambiguity in the differences between the luma and chroma image data, such as regarding which edges correspond. The guesses may be made based on certain assumptions, and may introduce artifacts in the composite image obtained from combining the compensated luma and chroma image data.

"The paradigm shift described in this disclosure involves a hardware-based approach. A hardware-based approach as described herein does not involve extrapolation, guessing or making determinations on adjustment based on assumptions. Rather, a hardware-based approach as described herein involves a deterministic calculation for stereo disparity compensation, thus avoiding the problem with ambiguity in the differences between the luma and chroma image data in the known software-based approaches.

"Various embodiments described herein are directed to imaging systems and methods that employ separate luma, chroma and depth/distance sensors (generally referred to herein as three-dimensional (3-D) image sensors). As used herein, the image sensors may be cameras or any other suitable sensors, detectors, or other devices that are capable of obtaining the particular data, namely, luma data, chroma data and 3-D data.

"The systems and methods may involve or include both generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. As used herein, imaging systems and methods should be considered to encompass image sensing, capture processing, rendering and/or generating images.

"Various embodiments contemplate generating the alignment transform once to calibrate the imaging system and then using the 3-D data obtained in real time to process disparity compensation in real time (for example, once per frame). The calibration may involve feature point extraction and matching and parameter estimation for the alignment transform. In embodiments, the alignment transform may be an affine transform. In embodiments, the affine transform may be applied on every frame for real-time processing. The real-time processing of disparity compensation may be accomplished by using the real-time 3-D data obtained for each respective frame.

"In particular, some embodiments may take the form of an imaging system. The imaging system may include: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance data, the chrominance data and the three-dimensional data and to generate a composite image corresponding to the scene from the luminance data, the chrominance data and the three-dimensional data.

"Yet other embodiments may take the form of an imaging method. The imaging method may include: obtaining luminance data of a scene using a first image sensor; obtaining chrominance data of the scene using second image sensor; obtaining three-dimensional data of the scene using a third image sensor; and processing the luminance data, the chrominance data and the three-dimensional data to generate a composite image corresponding to the scene.

"Still other embodiments may take the form of a computer readable storage medium. The computer-readable storage medium may include stored instructions that, when executed by a computer, cause the computer to perform any of the various methods described herein and/or any of the functions of the systems disclosed herein.

"It should be understood that, although the description is set forth in terms of separate luma and chroma sensors, the systems and methods described herein may be applied to any multiple-sensor imaging system or method. For example, a first RGB (red-green-blue) sensor and a second RGB sensor may be employed. Further, the approaches described herein may be applied in systems that employ an array of sensors, such as an array of cameras. As such, it should be understood that the disparity compensation described herein may be extended to systems employing more than two image sensors."

-- Dennis Sellers

 
AAPL
$104.96
Apple Inc.
+0.13
MSFT
$45.86
Microsoft Corpora
+0.84
GOOG
$537.55
Google Inc.
-6.43

MacTech Search:
Community Search:

Software Updates via MacUpdate

BusyCal 2.6.3 - Powerful calendar app wi...
BusyCal is an award-winning desktop calendar that combines personal productivity features for individuals with powerful calendar sharing capabilities for families and workgroups. BusyCal's unique... Read more
calibre 2.7 - Complete e-library managem...
Calibre is a complete e-book library manager. Organize your collection, convert your books to multiple formats, and sync with all of your devices. Let Calibre be your multi-tasking digital... Read more
Skitch 2.7.3 - Take screenshots, annotat...
With Skitch, taking, annotating, and sharing screenshots or images is as fun as it is simple.Communicate and collaborate with images using Skitch and its intuitive, engaging drawing and annotating... Read more
Delicious Library 3.3.2 - Import, browse...
Delicious Library allows you to import, browse, and share all your books, movies, music, and video games with Delicious Library. Run your very own library from your home or office using our... Read more
Art Text 2.4.8 - Create high quality hea...
Art Text is an OS X application for creating high quality textual graphics, headings, logos, icons, Web site elements, and buttons. Thanks to multi-layer support, creating complex graphics is no... Read more
Live Interior 3D Pro 2.9.6 - Powerful an...
Live Interior 3D Pro is a powerful yet very intuitive interior designing application. View Video Tutorials It has every feature of Live Interior 3D Standard, plus some exclusive ones: Create multi... Read more
The Hit List 1.1.7 - Advanced reminder a...
The Hit List manages the daily chaos of your modern life. It's easy to learn - it's as easy as making lists. And it's powerful enough to let you plan, then forget, then act when the time is right.... Read more
jAlbum Pro 12.2.4 - Organize your digita...
jAlbum Pro has all the features you love in jAlbum, but comes with a commercial license. With jAlbum, you can create gorgeous custom photo galleries for the Web without writing a line of code!... Read more
jAlbum 12.2.4 - Create custom photo gall...
With jAlbum, you can create gorgeous custom photo galleries for the Web without writing a line of code! Beginner-friendly, with pro results Simply drag and drop photos into groups, choose a design... Read more
ExpanDrive 4.1.7 - Access remote files o...
ExpanDrive builds cloud storage in every application, acts just like a USB drive plugged into your Mac. With ExpanDrive, you can securely access any remote file server directly from the Finder or... Read more

Latest Forum Discussions

See All

Great Hitman GO Goes on Sale and Gets Ne...
Great Hitman GO Goes on Sale and Gets New Update – Say That Three Times Fast Posted by Jessica Fisher on October 24th, 2014 [ permalink ] | Read more »
Rival Stars Basketball Review
Rival Stars Basketball Review By Jennifer Allen on October 24th, 2014 Our Rating: :: RESTRICTIVE BUT FUNUniversal App - Designed for iPhone and iPad Rival Stars Basketball is a fun mixture of basketball and card collecting but its... | Read more »
Rubicon Development Makes Over a Dozen o...
Rubicon Development Makes Over a Dozen of Their Games Free For This Weekend Only Posted by Jessica Fisher on October 24th, 2014 [ permalink ] | Read more »
I Am Dolphin Review
I Am Dolphin Review By Jennifer Allen on October 24th, 2014 Our Rating: :: NEARLY FIN-TASTICUniversal App - Designed for iPhone and iPad Swim around and eat nearly everything that moves in I Am Dolphin, a fun Ecco-ish kind of game... | Read more »
nPlayer looks to be the ultimate choice...
Developed by Newin Inc, nPlayer may seem like your standard video player – but is aiming to be the best in its field by providing high quality video play performance and support for a huge number of video formats and codecs. User reviews include... | Read more »
Fighting Fantasy: Caverns of the Snow Wi...
Fighting Fantasy: Caverns of the Snow Witch Review By Jennifer Allen on October 24th, 2014 Our Rating: :: CLASSY STORYTELLINGUniversal App - Designed for iPhone and iPad Fighting Fantasy: Caverns of the Snow Witch is a sterling... | Read more »
A Few Days Left (Games)
A Few Days Left 1.01 Device: iOS Universal Category: Games Price: $3.99, Version: 1.01 (iTunes) Description: Screenshots are in compliance to App Store's 4+ age rating! Please see App Preview for real game play! **Important: Make... | Read more »
Toca Boo (Education)
Toca Boo 1.0.2 Device: iOS Universal Category: Education Price: $2.99, Version: 1.0.2 (iTunes) Description: BOO! Did I scare you!? My name is Bonnie and my family loves to spook! Do you want to scare them back? Follow me and I'll... | Read more »
Intuon (Games)
Intuon 1.1 Device: iOS Universal Category: Games Price: $.99, Version: 1.1 (iTunes) Description: Join the battle with your intuition in a new hardcore game Intuon! How well do you trust your intuition? Can you find a needle in a... | Read more »
Ravenous Rampage (Games)
Ravenous Rampage 1.0 Device: iOS Universal Category: Games Price: $.99, Version: 1.0 (iTunes) Description: | Read more »

Price Scanner via MacPrices.net

Nimbus Note Cross=Platform Notes Utility
Nimbus Note will make sure you never forget or lose your valuable data again. Create and edit notes, save web pages, screenshots and any other type of data – and share it all with your friends and... Read more
NewerTech’s Snuglet Makes MagSafe 2 Power Con...
NewerTech has introduced the Snuglet, a precision-manufactured ring designed to sit inside your MagSafe 2 connector port, providing a more snug fit to prevent your power cable from unintentional... Read more
Apple Planning To Sacrifice Gross Margins To...
Digitimes Research’s Jim Hsiao says its analysts believe Apple is planning to sacrifice its gross margins to save its tablet business, which has recently fallen into decline. They project that Apple’... Read more
Who’s On Now? – First Instant-Connect Search...
It’s nighttime and your car has broken down on the side of the highway. You need a tow truck right away, so you open an app on your iPhone, search for the closest tow truck and send an instant... Read more
13-inch 2.5GHz MacBook Pro on sale for $949,...
Best Buy has the 13″ 2.5GHz MacBook Pro available for $949.99 on their online store. Choose free shipping or free instant local store pickup (if available). Their price is $150 off MSRP. Price is... Read more
Save up to $125 on Retina MacBook Pros
B&H Photo has the new 2014 13″ and 15″ Retina MacBook Pros on sale for up to $125 off MSRP. Shipping is free, and B&H charges NY sales tax only. They’ll also include free copies of Parallels... Read more
Apple refurbished Time Capsules available sta...
The Apple Store has certified refurbished Time Capsules available for up to $60 off MSRP. Apple’s one-year warranty is included with each Time Capsule, and shipping is free: - 2TB Time Capsule: $255... Read more
Textilus New Word, Notes and PDF Processor fo...
Textilus is new word-crunching, notes, and PDF processor designed exclusively for the iPad. I haven’t had time to thoroughly check it out yet, but it looks great and early reviews are positive.... Read more
WD My Passport Pro Bus-Powered Thunderbolt RA...
WD’s My Passport Pro RAID solution is powered by an integrated Thunderbolt cable for true portability and speeds as high as 233 MB/s. HighlightsOverviewSpecifications Transfer, Back Up And Edit In... Read more
Save with Best Buy’s College Student Deals
Take an additional $50 off all MacBooks and iMacs at Best Buy Online with their College Students Deals Savings, valid through November 1st. Anyone with a valid .EDU email address can take advantage... Read more

Jobs Board

*Apple* Solutions Consultant - Apple Inc. (U...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
Senior Event Manager, *Apple* Retail Market...
…This senior level position is responsible for leading and imagining the Apple Retail Team's global event strategy. Delivering an overarching brand story; in-store, Read more
*Apple* Solutions Consultant (ASC) - Apple (...
**Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
Project Manager / Business Analyst, WW *Appl...
…a senior project manager / business analyst to work within our Worldwide Apple Fulfillment Operations and the Business Process Re-engineering team. This role will work Read more
*Apple* Retail - Multiple Positions (US) - A...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.