Apple investigating 3D cameras for iPhones, iPads
TweetFollow Us on Twitter

Apple investigating 3D cameras for iPhones, iPads

An Apple patent (number 20110074931) for systems and methods for an imaging system using multiple image sensors has appeared at the US Patent & Trademark Office. It shows that Apple is considering future iPhones and iPads that can take 3D photos.

Per the patent Systems and methods may employ separate image sensors for collecting different types of data. In one embodiment, separate luma, chroma and 3-D image sensors may be used. The systems and methods may involve generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. The systems and methods may involve image sensing, capture, processing, rendering and/or generating images.

For example, one embodiment may provide an imaging system, including: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance, chrominance and three-dimensional data and to generate a composite image corresponding to the scene from that data. The inventors of the patent are Brett Bilbrey and Guy Cote.

Here's Apple's background and summary of the invention: "The use of separate luma and chroma image sensors, such as cameras, to capture a high quality image is known. In particular, the use of separate luma and chroma image sensors can produce a combined higher quality image when compared to what can be achieved by a single image sensor.

"Implementing an imaging system using separate luma and chroma image sensors involves dealing with alignment and disparity issues that result from separate image sensors. Specifically, known approaches deal with epipolar geometry alignment by generating a transform that can be applied to the luma and chroma data obtained by the separate image sensors. Known approaches deal with stereo disparity compensation using a software-based approach. The software-based approach extrapolates from the image data obtained by the luma and chroma image sensors. For example, one approach is to perform edge detection in the image data to determine what disparity compensation to apply.

"The approaches described herein involve a paradigm shift from the known software-based approaches. While the art has been directed to improvements in the software-based approaches, such improvements have not altered the fundamental approach. In particular, the extrapolation from the image data employed by the software-based approaches is not deterministic. As such, situations exist in which the software approaches must guess at how to perform stereo disparity compensation.

"For example, in software-based approaches that employ edge detection, an adjustment is made to attempt to compensate for offsets between edges in the chroma image and edges in the luma image. Depending on the image data, such software-based approaches may need to guess as to which way to adjust the edges for alignment. Guesses are needed to deal with any ambiguity in the differences between the luma and chroma image data, such as regarding which edges correspond. The guesses may be made based on certain assumptions, and may introduce artifacts in the composite image obtained from combining the compensated luma and chroma image data.

"The paradigm shift described in this disclosure involves a hardware-based approach. A hardware-based approach as described herein does not involve extrapolation, guessing or making determinations on adjustment based on assumptions. Rather, a hardware-based approach as described herein involves a deterministic calculation for stereo disparity compensation, thus avoiding the problem with ambiguity in the differences between the luma and chroma image data in the known software-based approaches.

"Various embodiments described herein are directed to imaging systems and methods that employ separate luma, chroma and depth/distance sensors (generally referred to herein as three-dimensional (3-D) image sensors). As used herein, the image sensors may be cameras or any other suitable sensors, detectors, or other devices that are capable of obtaining the particular data, namely, luma data, chroma data and 3-D data.

"The systems and methods may involve or include both generating an alignment transform for the image sensors, and using the 3-D data from the 3-D image sensor to process disparity compensation. As used herein, imaging systems and methods should be considered to encompass image sensing, capture processing, rendering and/or generating images.

"Various embodiments contemplate generating the alignment transform once to calibrate the imaging system and then using the 3-D data obtained in real time to process disparity compensation in real time (for example, once per frame). The calibration may involve feature point extraction and matching and parameter estimation for the alignment transform. In embodiments, the alignment transform may be an affine transform. In embodiments, the affine transform may be applied on every frame for real-time processing. The real-time processing of disparity compensation may be accomplished by using the real-time 3-D data obtained for each respective frame.

"In particular, some embodiments may take the form of an imaging system. The imaging system may include: a first image sensor configured to obtain luminance data of a scene; a second image sensor configured to obtain chrominance data of the scene; a third image sensor configured to obtain three-dimensional data of the scene; and an image processor configured to receive the luminance data, the chrominance data and the three-dimensional data and to generate a composite image corresponding to the scene from the luminance data, the chrominance data and the three-dimensional data.

"Yet other embodiments may take the form of an imaging method. The imaging method may include: obtaining luminance data of a scene using a first image sensor; obtaining chrominance data of the scene using second image sensor; obtaining three-dimensional data of the scene using a third image sensor; and processing the luminance data, the chrominance data and the three-dimensional data to generate a composite image corresponding to the scene.

"Still other embodiments may take the form of a computer readable storage medium. The computer-readable storage medium may include stored instructions that, when executed by a computer, cause the computer to perform any of the various methods described herein and/or any of the functions of the systems disclosed herein.

"It should be understood that, although the description is set forth in terms of separate luma and chroma sensors, the systems and methods described herein may be applied to any multiple-sensor imaging system or method. For example, a first RGB (red-green-blue) sensor and a second RGB sensor may be employed. Further, the approaches described herein may be applied in systems that employ an array of sensors, such as an array of cameras. As such, it should be understood that the disparity compensation described herein may be extended to systems employing more than two image sensors."

-- Dennis Sellers

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

VirtualBox 5.1.10 - x86 virtualization s...
VirtualBox is a family of powerful x86 virtualization products for enterprise as well as home use. Not only is VirtualBox an extremely feature rich, high performance product for enterprise customers... Read more
Pixa 1.1.9 - Quickly and easily organize...
Pixa is an image-organizing application. The new app functions well, is easy to use, and helps people organize their images quickly and easily on their computers. For those who prefer not to use the... Read more
Civilization VI 1.0.1 - Next iteration o...
Sid Meier’s Civilization VI is the next entry in the popular Civilization franchise. Originally created by legendary game designer Sid Meier, Civilization is a strategy game in which you attempt to... Read more
Google Chrome 55.0.2883.75 - Modern and...
Google Chrome is a Web browser by Google, created to be a modern platform for Web pages and applications. It utilizes very fast loading of Web pages and has a V8 engine, which is a custom built... Read more
Chromium 55.0.2883.75 - Fast and stable...
Chromium is an open-source browser project that aims to build a safer, faster, and more stable way for all Internet users to experience the web. Version 55.0.2883.75: Security fixes: High CVE-2016... Read more
Luminar 1.0.2 - Powerful, adaptive, conf...
Luminar is the new full-featured image editor that adapts to the way you edit photos. Over 300 essential tools to fix, edit, and enhance your photos with comfort. The future of photo editing is here... Read more
Slack 2.3.3 - Collaborative communicatio...
Slack is a collaborative communication app that simplifies real-time messaging, archiving, and search for modern working teams. Version 2.3.3: Fixed window zoom jumping back-and-forth OS X 10.9... Read more
WhatRoute 2.0.10 - Geographically trace...
WhatRoute is designed to find the names of all the routers an IP packet passes through on its way from your Mac to a destination host. It also measures the round-trip time from your Mac to the router... Read more
Luminar 1.0.2 - Powerful, adaptive, conf...
Luminar is the new full-featured image editor that adapts to the way you edit photos. Over 300 essential tools to fix, edit, and enhance your photos with comfort. The future of photo editing is here... Read more
WhatRoute 2.0.10 - Geographically trace...
WhatRoute is designed to find the names of all the routers an IP packet passes through on its way from your Mac to a destination host. It also measures the round-trip time from your Mac to the router... Read more

Latest Forum Discussions

See All

Amateur Surgeon 4 Guide: Become the worl...
It's time to wield your trusty pizza cutter again, as Amateur Surgeon has returned with a whole fresh set of challenges (and some old, familiar ones, too). Starting anew isn't easy, especially when all you have at your disposal is a lighter, the... | Read more »
Le Parker: Sous Chef Extraordinaire (Ga...
Le Parker: Sous Chef Extraordinaire 1.0 Device: iOS Universal Category: Games Price: $2.99, Version: 1.0 (iTunes) Description: | Read more »
Telltale Games really is working on a Gu...
Telltale Games' next episodic adventure is indeed Guardians of the Galaxy. A document tied to the voice actors strike suggested that the project was in the work, but now we have direct confirmation following an announcement at the Game Awards that... | Read more »
Amateur Surgeon returns to iOS and Andro...
Amateur Surgeon and its two sequels disappeared from the App Store some time and it was sad days for all. But now, just in time for the holidays, the Adult Swim favorite makes its joyous return in the shape of Amateur Surgeon 4, a remake with... | Read more »
The best board games on mobile
Sometimes you need to ditch all of the high speed, high action games in favor of something a little more traditional. If you don't feel like parting ways from your mobile device, though, there are still plenty of ways to get that old-school fix.... | Read more »
The best Facebook Messenger Instant Game...
Facebook's new Instant Games is now here, meaning you can play games with your friends directly via Facebook. It's a fun new way to connect with friends, of course, but it's also proving to be a solid gaming experience in its own right, with a... | Read more »
You can now play game's on Facebook...
Facebook launched its new Instant Games platform in an exciting new attempt to engage its user base. As a result, you can now play a number of different games directly through Facebook Messenger. All of these games run with HTML5, meaning you play... | Read more »
Apollo Justice Ace Attorney (Games)
Apollo Justice Ace Attorney 1.00.00 Device: iOS Universal Category: Games Price: $.99, Version: 1.00.00 (iTunes) Description: Court Is Back In Session Star as rookie defense attorney, Apollo Justice, as he visits crime scenes,... | Read more »
KORG iWAVESTATION (Music)
KORG iWAVESTATION 1.0 Device: iOS Universal Category: Music Price: $19.99, Version: 1.0 (iTunes) Description: A revolutionary new world of sound.The Wave Sequence Synthesizer for iPad - KORG iWAVESTATION | Read more »
Don't Grind Guide: Tips for becomin...
Don’t Grind is a surprising, derpy little one touch game with fun hand-drawn graphics. The goal is simple -- get the high score without being chopped to bits. That can be tough when you’re not used to the game, and that’s compounded by the fact... | Read more »

Price Scanner via MacPrices.net

13-inch Silver Touch Bar MacBook Pro in stock...
Amazon has the new 2016 13″ 2.9GHz/256GB Silver Touch Bar MacBook Pro (MLVP2LL/A) in stock today and on sale for $1749 including free shipping. That’s $50 off MSRP, and it’s the lowest price... Read more
Parallels Toolbox 1.3 for Mac Offers 25 Singl...
Parallels has launched Parallels Toolbox 1.3 for Mac, an upgrade that adds five new utilities to the stand-alone application which was released in August and is available exclusively online at http... Read more
OWC Mercury Elite Pro Dual mini Ultra-Portabl...
OWC has introduced the new OWC Mercury Elite Pro Dual mini, a powerful yet ultra-portable dual-drive RAID solution. The new Mercury Elite Pro Dual mini packs phenomenal performance into a small... Read more
Clearance 13-inch Retina MacBook Pros availab...
B&H Photo has clearance 2015 13″ Retina Apple MacBook Pros available for up to $200 off original MSRP. Shipping is free, and B&H charges NY tax only: - 13″ 2.7GHz/128GB Retina MacBook Pro: $... Read more
Roundup of 2016 13-inch 2.0GHz MacBook Pro sa...
B&H has the non-Touch Bar 13″ MacBook Pros in stock today for $50-$100 off MSRP. Shipping is free, and B&H charges NY sales tax only: - 13″ 2.0GHz MacBook Pro Space Gray (MLL42LL/A): $1449 $... Read more
New 13-inch 2.0GHz Space Gray MacBook Pro in...
Adorama has the new 13″ 2.0GHz Space Gray MacBook Pro (non-Touch Bar, MLL42LL/A) in stock for $1499 including a free 3-year AppleCare Protection Plan. Shipping is free, and Adorama charges sales tax... Read more
Finnair Adopts iOS Enterprise iPad Apps from...
Finnair and IBM have announced a first-of-its-kind agreement to utilize iOS enterprise apps from IBM to support the airline’s overall digital transformation. Finnair is focused on Asia-Europe traffic... Read more
Tech21 Launches Evo Go iPhone 7 Case Availabl...
Tech21 has announced the launch of the Evo Go case for Apple iPhone 7 and iPhone 7 Plus, exclusively at T-Mobile. Available online and at participating T-Mobile stores nationwide, Evo Go cases start... Read more
Apple Turns (RED) with More Ways to Join the...
In recognition of World AIDS Day, Apple is offering more ways than ever for customers to join (RED) in its mission to create an AIDS-free generation. Apple is the worlds largest corporate contributor... Read more
Deals on new 15-inch Touch Bar MacBook Pros,...
B&H Photo has new 2016 Apple 15″ Touch Bar MacBook Pro models in stock today with some available for $50 off MSRP, each including free shipping plus NY sales tax only: - 15″ 2.7GHz Touch Bar... Read more

Jobs Board

*Apple* Brand Ambassador (Macy's) - The...
…(T-ROC), is proud of its unprecedented relationship with our partner and client, APPLE ,in bringing amazing" APPLE ADVOCATES"to "non" Apple store locations. Read more
US- *Apple* Store Leader Program - Apple (Un...
…Summary Learn and grow as you explore the art of leadership at the Apple Store. You'll master our retail business inside and out through training, hands-on Read more
*Apple* Retail - Multiple Positions- White P...
Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, you're also the Read more
Automotive Detailer - *Apple* Used Autos -...
We are currently conductinginterviews and will be accepting applications for a part-time detailer. Apple Used Autos is a great place to work andstart a career. We Read more
*Apple* Retail - Multiple Positions - Apple,...
Job Description: Sales Specialist - Retail Customer Service and Sales Transform Apple Store visitors into loyal Apple customers. When customers enter the store, Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.