Apple investigating 3D cameras for iPhones, iPads
TweetFollow Us on Twitter

Apple investigating 3D cameras for iPhones, iPads

An Apple patent (number 20110074931) for systems and methods for an imaging system using multiple image sensors has appeared at the US Patent & Trademark Office. It shows that Apple is considering future iPhones and iPads that can take 3D photos.

Per the patent Systems and methods may employ separate image sensors for collecting different types of data. In one embodiment, separate luma, chroma and 3-D image sensors may be used. The systems and methods may involve generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. The systems and methods may involve image sensing, capture, processing, rendering and/or generating images.

For example, one embodiment may provide an imaging system, including: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance, chrominance and three-dimensional data and to generate a composite image corresponding to the scene from that data. The inventors of the patent are Brett Bilbrey and Guy Cote.

Here's Apple's background and summary of the invention: "The use of separate luma and chroma image sensors, such as cameras, to capture a high quality image is known. In particular, the use of separate luma and chroma image sensors can produce a combined higher quality image when compared to what can be achieved by a single image sensor.

"Implementing an imaging system using separate luma and chroma image sensors involves dealing with alignment and disparity issues that result from separate image sensors. Specifically, known approaches deal with epipolar geometry alignment by generating a transform that can be applied to the luma and chroma data obtained by the separate image sensors. Known approaches deal with stereo disparity compensation using a software-based approach. The software-based approach extrapolates from the image data obtained by the luma and chroma image sensors. For example, one approach is to perform edge detection in the image data to determine what disparity compensation to apply.

"The approaches described herein involve a paradigm shift from the known software-based approaches. While the art has been directed to improvements in the software-based approaches, such improvements have not altered the fundamental approach. In particular, the extrapolation from the image data employed by the software-based approaches is not deterministic. As such, situations exist in which the software approaches must guess at how to perform stereo disparity compensation.

"For example, in software-based approaches that employ edge detection, an adjustment is made to attempt to compensate for offsets between edges in the chroma image and edges in the luma image. Depending on the image data, such software-based approaches may need to guess as to which way to adjust the edges for alignment. Guesses are needed to deal with any ambiguity in the differences between the luma and chroma image data, such as regarding which edges correspond. The guesses may be made based on certain assumptions, and may introduce artifacts in the composite image obtained from combining the compensated luma and chroma image data.

"The paradigm shift described in this disclosure involves a hardware-based approach. A hardware-based approach as described herein does not involve extrapolation, guessing or making determinations on adjustment based on assumptions. Rather, a hardware-based approach as described herein involves a deterministic calculation for stereo disparity compensation, thus avoiding the problem with ambiguity in the differences between the luma and chroma image data in the known software-based approaches.

"Various embodiments described herein are directed to imaging systems and methods that employ separate luma, chroma and depth/distance sensors (generally referred to herein as three-dimensional (3-D) image sensors). As used herein, the image sensors may be cameras or any other suitable sensors, detectors, or other devices that are capable of obtaining the particular data, namely, luma data, chroma data and 3-D data.

"The systems and methods may involve or include both generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. As used herein, imaging systems and methods should be considered to encompass image sensing, capture processing, rendering and/or generating images.

"Various embodiments contemplate generating the alignment transform once to calibrate the imaging system and then using the 3-D data obtained in real time to process disparity compensation in real time (for example, once per frame). The calibration may involve feature point extraction and matching and parameter estimation for the alignment transform. In embodiments, the alignment transform may be an affine transform. In embodiments, the affine transform may be applied on every frame for real-time processing. The real-time processing of disparity compensation may be accomplished by using the real-time 3-D data obtained for each respective frame.

"In particular, some embodiments may take the form of an imaging system. The imaging system may include: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance data, the chrominance data and the three-dimensional data and to generate a composite image corresponding to the scene from the luminance data, the chrominance data and the three-dimensional data.

"Yet other embodiments may take the form of an imaging method. The imaging method may include: obtaining luminance data of a scene using a first image sensor; obtaining chrominance data of the scene using second image sensor; obtaining three-dimensional data of the scene using a third image sensor; and processing the luminance data, the chrominance data and the three-dimensional data to generate a composite image corresponding to the scene.

"Still other embodiments may take the form of a computer readable storage medium. The computer-readable storage medium may include stored instructions that, when executed by a computer, cause the computer to perform any of the various methods described herein and/or any of the functions of the systems disclosed herein.

"It should be understood that, although the description is set forth in terms of separate luma and chroma sensors, the systems and methods described herein may be applied to any multiple-sensor imaging system or method. For example, a first RGB (red-green-blue) sensor and a second RGB sensor may be employed. Further, the approaches described herein may be applied in systems that employ an array of sensors, such as an array of cameras. As such, it should be understood that the disparity compensation described herein may be extended to systems employing more than two image sensors."

-- Dennis Sellers

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

VueScan 9.5.75 - Scanner software with a...
VueScan is a scanning program that works with most high-quality flatbed and film scanners to produce scans that have excellent color fidelity and color balance. VueScan is easy to use, and has... Read more
Opera 44.0.2510.1449 - High-performance...
Opera is a fast and secure browser trusted by millions of users. With the intuitive interface, Speed Dial and visual bookmarks for organizing favorite sites, news feature with fresh, relevant content... Read more
Opera 44.0.2510.1449 - High-performance...
Opera is a fast and secure browser trusted by millions of users. With the intuitive interface, Speed Dial and visual bookmarks for organizing favorite sites, news feature with fresh, relevant content... Read more
Skim 1.4.29 - PDF reader and note-taker...
Skim is a PDF reader and note-taker for OS X. It is designed to help you read and annotate scientific papers in PDF, but is also great for viewing any PDF file. Skim includes many features and has a... Read more
FontExplorer X Pro 6.0.2 - Font manageme...
FontExplorer X Pro is optimized for professional use; it's the solution that gives you the power you need to manage all your fonts. Now you can more easily manage, activate and organize your... Read more
1Password 6.7.1 - Powerful password mana...
1Password is a password manager that uniquely brings you both security and convenience. It is the only program that provides anti-phishing protection and goes beyond password management by adding Web... Read more
Vivaldi 1.9.818.44 - An advanced browser...
Vivaldi is a browser for our friends. In 1994, two programmers started working on a web browser. Our idea was to make a really fast browser, capable of running on limited hardware, keeping in mind... Read more
Vivaldi 1.9.818.44 - An advanced browser...
Vivaldi is a browser for our friends. In 1994, two programmers started working on a web browser. Our idea was to make a really fast browser, capable of running on limited hardware, keeping in mind... Read more
Skim 1.4.29 - PDF reader and note-taker...
Skim is a PDF reader and note-taker for OS X. It is designed to help you read and annotate scientific papers in PDF, but is also great for viewing any PDF file. Skim includes many features and has a... Read more
1Password 6.7.1 - Powerful password mana...
1Password is a password manager that uniquely brings you both security and convenience. It is the only program that provides anti-phishing protection and goes beyond password management by adding Web... Read more

Latest Forum Discussions

See All

Fire Emblem Heroes event announces new m...
As reported yesterday, Nintendo was gearing up a live press event for their popular mobile game,Fire Emblem Heroes. While the stream revealed a lot of new things, the event was entirely in Japanese. Luckily we have a rundown of what was announced... | Read more »
Best games we played this week
Another week, another slate of new mobile games. Although there weren't as many big name releases as last week, there were plenty of unique video game titles that came out that's sure to keep you interested over the weekend. Everything from classic... | Read more »
Olli by Tinrocket (Photography)
Olli by Tinrocket 1.0 Device: iOS iPhone Category: Photography Price: $2.99, Version: 1.0 (iTunes) Description: Get drawn in with Olli by TinrocketOlli instantly turns your everyday moments into hand-drawn art and animations. • Watch... | Read more »
Penarium (Games)
Penarium 1.0 Device: iOS Universal Category: Games Price: $1.99, Version: 1.0 (iTunes) Description: | Read more »
Fire Emblem Heroes is way more profitabl...
Profits for Nintendo's mobile game Fire Emblem Heroes are apparently impressive enough to beat out other Nintendo titles likeSuper Mario Run, despite having 10 times fewer downloads. [Read more] | Read more »
Classic series Robot Unicorn Attack 3 no...
The classic Adult Swim browser game, Robot Unicorn Attack, branched off into a series of popular mobile games. Now, the latest entry into the series, Robot Unicorn Attack 3, is available for iOS and Android mobile devices. [Read more] | Read more »
Sudoku Sweeper (Games)
Sudoku Sweeper 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: A minimalist mashup of Minesweeper and Sudoku. Logic puzzle perfection. Every row, column and zone contains a bomb and one of... | Read more »
Under Leaves (Games)
Under Leaves 1.0.0 Device: iOS Universal Category: Games Price: $1.99, Version: 1.0.0 (iTunes) Description: Journey into the forest, the jungle or the depths of the deep blue sea. Find chestnuts for the pigs, a caterpillar for the... | Read more »
Ninja Pizza Girl (Games)
Ninja Pizza Girl 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: In the not-so-distant future, rampart traffic congestion has resulted in only one way to deliver pizzas across town in thirty... | Read more »
SCRAP (Games)
SCRAP 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: That day, for no apparent reason, SCRAP decided to wake up and run. He had to, because his activation was a mistake the "Factory" could... | Read more »

Price Scanner via MacPrices.net

13-inch 2.7GHz Retina MacBook Pro, Apple refu...
Apple has Certified Refurbished 13″ 2.7GHz/128GB Retina MacBook Pros available for $200 off MSRP. An Apple one-year warranty is included with each model, and shipping is free: - 13″ 2.7GHz/128GB... Read more
13-inch Gray 2.9GHz/512GB Touch Bar MacBook P...
Amazon has the 13″ Space Gray 2.9GHz/512GB Touch Bar MacBook Pro (model MNQF2LL/A) in stock today and on sale for $150 off MSRP. Shipping is free: - 13″ 2.9GHz/512GB Touch Bar MacBook Pro Space Gray... Read more
15-inch 2.7GHz Space Gray Touch Bar MacBook P...
B&H Photo has the 15″ 2.7GHz Space Gray Touch Bar MacBook Pro in stock today and on sale for $2599…$200 off MSRP. Shipping is free, and B&H charges NY & NJ sales tax only: - 15″ 2.7GHz... Read more
13-inch 2.9GHz/256GB Space Gray Touch Bar Mac...
B&H Photo has the 13″ 2.9GHz/256GB Space Gray Touch Bar MacBook Pro in stock today and on sale for $150 off MSRP including free shipping plus NY & NJ sales tax only: - 13″ 2.9GHz/256GB Touch... Read more
21-inch iMacs on sale for up to $151 off MSRP
B&H Photo has 21″ iMacs on sale for up to $151 off MSRP, each including free shipping plus NY sales tax only: - 21″ 3.1GHz iMac 4K: $1348 $151 off MSRP - 21″ 2.8GHz iMac: $1199.99 $100 off MSRP... Read more
Weekend deal: Up to $420 off new MacBook Pros...
Apple has Certified Refurbished 2016 15″ and 13″ MacBook Pros available for $230 to $420 off original MSRP. An Apple one-year warranty is included with each model, and shipping is free: - 15″ 2.6GHz... Read more
Price drop: 15-inch 2.2GHz Retina MacBook Pro...
Amazon has dropped their price on 15″ 2.2GHz Retina MacBook Pros (MJLQ2LL/A) to $1709.99 including free shipping. Their price is $290 off MSRP for this model. Note that stock may sell out quickly at... Read more
2.8GHz Mac mini on sale for $899, save $100
B&H Photo has the 2.8GHz Mac mini (model number MGEQ2LL/A) on sale for $899 including free shipping plus NY & NJ sales tax only. Their price is $100 off MSRP. Read more
Check Apple prices on any device with the iTr...
MacPrices is proud to offer readers a free iOS app (iPhones, iPads, & iPod touch) and Android app (Google Play and Amazon App Store) called iTracx, which allows you to glance at today’s lowest... Read more
New System Clock for macOS by B-Eng Now Avail...
Fehraltorf, Switzerland based B-Eng has announced the release and immediate availability of System Clock, the company’s new system monitor and information app developed exclusively for macOS. System... Read more

Jobs Board

*Apple* Mobile Master - Best Buy (United Sta...
**493714BR** **Job Title:** Apple Mobile Master **Location Number:** 001024-Weatherford-Store **Job Description:** **What does a Best Buy Apple Mobile Master Read more
*Apple* OS X Server Administrator (Active Se...
** Apple OS X Server Administrator \(Active Secret Clearance\)** **Description** Come be a part of a top notch team, apply today\!\! Tuva TUVA provides turnkey Read more
*Apple* Mac Computer Technician - GeekHampto...
…complex computer issues over the phone and in person? GeekHampton, Long Island's Apple Premium Service Provider, is looking for you! Come work with our crew Read more
Best Buy *Apple* Computing Master - Best Bu...
**501846BR** **Job Title:** Best Buy Apple Computing Master **Location Number:** 001126-South Bay Center-Store **Job Description:** **What does a Best Buy Apple Read more
Consultant or Sr. Consultant, *Apple* Allia...
…improve our business and your clients will be heard.Project Manager, Apple AllianceLocation:San Francisco preferred, open to other locationsLevel:Consultant or Sr. Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.