Apple investigating 3D cameras for iPhones, iPads
TweetFollow Us on Twitter

Apple investigating 3D cameras for iPhones, iPads

An Apple patent (number 20110074931) for systems and methods for an imaging system using multiple image sensors has appeared at the US Patent & Trademark Office. It shows that Apple is considering future iPhones and iPads that can take 3D photos.

Per the patent Systems and methods may employ separate image sensors for collecting different types of data. In one embodiment, separate luma, chroma and 3-D image sensors may be used. The systems and methods may involve generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. The systems and methods may involve image sensing, capture, processing, rendering and/or generating images.

For example, one embodiment may provide an imaging system, including: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance, chrominance and three-dimensional data and to generate a composite image corresponding to the scene from that data. The inventors of the patent are Brett Bilbrey and Guy Cote.

Here's Apple's background and summary of the invention: "The use of separate luma and chroma image sensors, such as cameras, to capture a high quality image is known. In particular, the use of separate luma and chroma image sensors can produce a combined higher quality image when compared to what can be achieved by a single image sensor.

"Implementing an imaging system using separate luma and chroma image sensors involves dealing with alignment and disparity issues that result from separate image sensors. Specifically, known approaches deal with epipolar geometry alignment by generating a transform that can be applied to the luma and chroma data obtained by the separate image sensors. Known approaches deal with stereo disparity compensation using a software-based approach. The software-based approach extrapolates from the image data obtained by the luma and chroma image sensors. For example, one approach is to perform edge detection in the image data to determine what disparity compensation to apply.

"The approaches described herein involve a paradigm shift from the known software-based approaches. While the art has been directed to improvements in the software-based approaches, such improvements have not altered the fundamental approach. In particular, the extrapolation from the image data employed by the software-based approaches is not deterministic. As such, situations exist in which the software approaches must guess at how to perform stereo disparity compensation.

"For example, in software-based approaches that employ edge detection, an adjustment is made to attempt to compensate for offsets between edges in the chroma image and edges in the luma image. Depending on the image data, such software-based approaches may need to guess as to which way to adjust the edges for alignment. Guesses are needed to deal with any ambiguity in the differences between the luma and chroma image data, such as regarding which edges correspond. The guesses may be made based on certain assumptions, and may introduce artifacts in the composite image obtained from combining the compensated luma and chroma image data.

"The paradigm shift described in this disclosure involves a hardware-based approach. A hardware-based approach as described herein does not involve extrapolation, guessing or making determinations on adjustment based on assumptions. Rather, a hardware-based approach as described herein involves a deterministic calculation for stereo disparity compensation, thus avoiding the problem with ambiguity in the differences between the luma and chroma image data in the known software-based approaches.

"Various embodiments described herein are directed to imaging systems and methods that employ separate luma, chroma and depth/distance sensors (generally referred to herein as three-dimensional (3-D) image sensors). As used herein, the image sensors may be cameras or any other suitable sensors, detectors, or other devices that are capable of obtaining the particular data, namely, luma data, chroma data and 3-D data.

"The systems and methods may involve or include both generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. As used herein, imaging systems and methods should be considered to encompass image sensing, capture processing, rendering and/or generating images.

"Various embodiments contemplate generating the alignment transform once to calibrate the imaging system and then using the 3-D data obtained in real time to process disparity compensation in real time (for example, once per frame). The calibration may involve feature point extraction and matching and parameter estimation for the alignment transform. In embodiments, the alignment transform may be an affine transform. In embodiments, the affine transform may be applied on every frame for real-time processing. The real-time processing of disparity compensation may be accomplished by using the real-time 3-D data obtained for each respective frame.

"In particular, some embodiments may take the form of an imaging system. The imaging system may include: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance data, the chrominance data and the three-dimensional data and to generate a composite image corresponding to the scene from the luminance data, the chrominance data and the three-dimensional data.

"Yet other embodiments may take the form of an imaging method. The imaging method may include: obtaining luminance data of a scene using a first image sensor; obtaining chrominance data of the scene using second image sensor; obtaining three-dimensional data of the scene using a third image sensor; and processing the luminance data, the chrominance data and the three-dimensional data to generate a composite image corresponding to the scene.

"Still other embodiments may take the form of a computer readable storage medium. The computer-readable storage medium may include stored instructions that, when executed by a computer, cause the computer to perform any of the various methods described herein and/or any of the functions of the systems disclosed herein.

"It should be understood that, although the description is set forth in terms of separate luma and chroma sensors, the systems and methods described herein may be applied to any multiple-sensor imaging system or method. For example, a first RGB (red-green-blue) sensor and a second RGB sensor may be employed. Further, the approaches described herein may be applied in systems that employ an array of sensors, such as an array of cameras. As such, it should be understood that the disparity compensation described herein may be extended to systems employing more than two image sensors."

-- Dennis Sellers

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

Civilization VI 1.0.6 - Next iteration o...
Sid Meier’s Civilization VI is the next entry in the popular Civilization franchise. Originally created by legendary game designer Sid Meier, Civilization is a strategy game in which you attempt to... Read more
djay Pro 2.0.1 - Transform your Mac into...
djay Pro provides a complete toolkit for performing DJs. Its unique modern interface is built around a sophisticated integration with iTunes and Spotify, giving you instant access to millions of... Read more
Microsoft OneNote 15.41 - Free digital n...
OneNote is your very own digital notebook. With OneNote, you can capture that flash of genius, that moment of inspiration, or that list of errands that's too important to forget. Whether you're at... Read more
TechTool Pro 9.6 - Hard drive and system...
TechTool Pro has long been one of the foremost utilities for keeping your Mac running smoothly and efficiently. With the release of version 9, it has become more proficient than ever. TechTool... Read more
Apple iOS 11.2.1 - The latest version of...
iOS 11 sets a new standard for what is already the world’s most advanced mobile operating system. It makes iPhone better than before. It makes iPad more capable than ever. And now it opens up both to... Read more
Things 3.3 - Elegant personal task manag...
Things is a task management solution that helps to organize your tasks in an elegant and intuitive way. Things combines powerful features with simplicity through the use of tags and its intelligent... Read more
RapidWeaver 7.5.5 - Create template-base...
RapidWeaver is a next-generation Web design application to help you easily create professional-looking Web sites in minutes. No knowledge of complex code is required, RapidWeaver will take care of... Read more
Adobe Animate CC 2018 18.0.1.115 - Anima...
Animate CC 2018 is available as part of Adobe Creative Cloud for as little as $19.99/month (or $9.99/month if you're a previous Flash Professional customer). Animate CC 2018 (was Flash CC) lets you... Read more
Postbox 5.0.22 - Powerful and flexible e...
Postbox is a new email application that helps you organize your work life and get stuff done. It has all the elegance and simplicity of Apple Mail, but with more power and flexibility to manage even... Read more
Tunnelblick 3.7.4b - GUI for OpenVPN.
Tunnelblick is a free, open source graphic user interface for OpenVPN on OS X. It provides easy control of OpenVPN client and/or server connections. It comes as a ready-to-use application with all... Read more

Latest Forum Discussions

See All

Why Guns of Boom will be big for mobile...
Earlier this week, Game Insight, the minds that brought you Guns of Boom, revealed plans for an esports mode in the popular FPS title, with big implications for the game's future. Guns of Boom has been quite popular for some time now, so it's... | Read more »
Rules of Survival guide - how to boost y...
It's not easy surviving in the "every-man-for-himself" world of Rules of Survival. You'll be facing off against many other players who might be more skilled than you, or are luckier than you. There are a lot of factors weighing against you. With... | Read more »
FEZ Pocket Edition (Games)
FEZ Pocket Edition 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: | Read more »
Amazing Katamari Damacy guide - beginner...
Amazing Katamari Damacy brings the bizarro world of the original games to mobile and shifts them into an endless format that's just as addictive as the PlayStation entries. Your goal is still to roll as much random stuff as you possibly can, though... | Read more »
Portal Knights guide - crafting tips and...
In Portal Knights, you're only as strong as the items you have at your disposal. This sandbox adventure is all about crafting and building up the next big thing. Whether you're an avid explorer or collector, crafting will likely play a large part... | Read more »
The best deals on the App Store this wee...
A new week means new discounts on the App Store. This week's deals run the gamut of action-adventure titles, puzzle games, and one of the best narrative adventure series out there. If you're looking to fill out your mobile gaming library on a... | Read more »
What you need to know about Animal Cross...
We hope you've been hard at work on collecting all of those holiday items in Animal Crossing: Pocket Camp, because you're about to get a whole new list of fun things to do as the game receives its first big update sometime soon. There are a lot of... | Read more »
Reigns: Her Majesty guide - how to use e...
Ruling a kingdom isn't easy--doubly so for a queen whose every decision is questioned by the other factions seeking a slice of power. Reigns: Her Majesty builds on the original game's swipey tactics, adding items that you can use to move the story... | Read more »
The best new games we played this week -...
Friday has crept up on us once again, so it's time to honor the best new games we've played over the past few days. This past week was a pretty exciting one, with the debut of lots of beautiful new indies and some familiar faces returning to the... | Read more »
Portal Knights guide- beginner tips and...
Portal Knights is finally making the jump to iOS and Android, and it's already climbing the ranks to become the next big MMO experience on mobile. This sprawling sandbox game will let you pursue any adventure you wish, whether you want to sling... | Read more »

Price Scanner via MacPrices.net

Beats Holiday sale at B&H, headphones and...
B&H Photo has Beats by Dr. Dre headphones, earphones, and speakers on sale for up to $80 off MSRP as part of their Holiday sale. Expedited shipping is free, and B&H charges sales tax to NY... Read more
Holiday sale: Apple resellers offer 2017 15″...
MacMall has 15″ MacBook Pros on sale for $220-$300 off MSRP, each including free shipping: – 15″ 2.8GHz MacBook Pro Space Gray (MPTR2LL/A): $2179, $220 off MSRP – 15″ 2.8GHz MacBook Pro Silver (... Read more
Holiday sale: Apple resellers offer 13″ MacBo...
B&H Photo has 13″ MacBook Pros on sale for up to $150 off MSRP. Shipping is free, and B&H charges sales tax for NY & NJ residents only: – 13-inch 2.3GHz/128GB Space Gray MacBook Pro (... Read more
Apple Watch Series 2, Certified Refurbished,...
Apple has Certified Refurbished Apple Watch Nike+ Series 2s, 42mm Space Gray Aluminum Case with Anthracite/Black Nike Sport Bands, available for $249 (38mm) or $279 (42mm). The 38mm model was out of... Read more
Apple offers Certified Refurbished 2016 12″ R...
Apple has Certified Refurbished 2016 12″ Retina MacBooks available starting at $949. Apple will include a standard one-year warranty with each MacBook, and shipping is free. The following... Read more
B&H drops price on 13″ 256GB MacBook Air...
B&H has the 13″ 1.8GHz/256GB Apple MacBook Air (MQD42LL/A) now on sale for $1079 including free shipping plus NY & NJ sales tax only. Their price is $120 off MSRP, and it’s the lowest price... Read more
Holiday sale: 9″ iPads starting at $299, take...
MacMall has 9″ WiFi iPads on sale for $30 off including free shipping: – 9″ 32GB WiFi iPad: $299 – 9″ 128GB WiFi iPad: $399 Read more
Green Monday deal: 15″ 2.8GHz MacBook Pro on...
B&H Photo has the 15″ 2.8GHz Space Gray MacBook Pro on sale for $250 off MSRP for today only as part of their Green Monday/Holiday sale. Shipping is free, and B&H charges sales tax for NY... Read more
Green Monday sale: B&H offers 12″ Apple i...
B&H Photo has 12″ iPad Pros on sale for up to $150 off MSRP as part of their Green Monday/Holiday sale. Shipping is free, and B&H charges sales tax in NY & NJ only: – 12″ 64GB WiFi iPad... Read more
Holiday deal: 21″ and 27″ Apple iMacs on sale...
MacMall has 2017 21″ and 27″ Apple iMacs on sale for up to $200 off MSRP. Shipping is free: – 21″ 2.3GHz iMac: $999 $100 off MSRP – 21″ 3.0GHz iMac: $1199 $100 off MSRP – 21″ 3.4GHz iMac: $1379 $120... Read more

Jobs Board

*Apple* Solutions Consultant - Apple (United...
# Apple Solutions Consultant Job Number: 113124408 Waterford, CT, Connecticut, United States Posted: 17-Oct-2017 Weekly Hours: 40.00 **Job Summary** Are you Read more
QA Automation Engineer, *Apple* Pay - Apple...
# QA Automation Engineer, Apple Pay Job Number: 113202642 Santa Clara Valley, California, United States Posted: 11-Dec-2017 Weekly Hours: 40.00 **Job Summary** At Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description:SalesSpecialist - Retail Customer Service and SalesTransform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description:SalesSpecialist - Retail Customer Service and SalesTransform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.