TweetFollow Us on Twitter

Spring 91 - THE VETERAN NEOPHYTE

THE VETERAN NEOPHYTE

A FAMILIAR (INTER)FACE

DAVE JOHNSON

[IMAGE p70-71_Dave's_Column_htm1.GIF]

I just learned about a technique for graphically representing points in n-dimensional space, first presented in 1973 (I guess I'm a little behind) by a Harvard statistician, H. Chernoff. Representing points in two or three dimensions is pretty straightforward, but what about data points in, say, ten dimensions? Chernoff's approach was to use cartoon faces, with each dimensional parameter determining a facial feature. One parameter determines eye size, for instance; another regulates eyebrow slant, another determines the position of the mouth, and so on. I was struck dumb by the power of the idea. Humans have a built-in feature integration and recognition ability that lets us intuitively track and correlate changing facial features with no conscious effort, and Chernoff's technique elegantly capitalizes on this ability.

The possible uses for these "Chernoff faces" are many and varied. In his book Computers, Pattern, Chaos, and Beauty , Clifford Pickover talks about a number of possible applications: the elucidation of high-level statistical concepts, uses in air traffic control and aircraft piloting, educational applications, and many more. In one particularly illuminating example he uses the faces to characterize sound. He runs the sound data through an auto-correlation function (for the gory details, see his book) and then uses the first ten points of the resulting data set to control the faces. As examples heshows the faces generated by the sounds s , sh , z , and v , sounds which are very similar. The resulting faces, though, are easily and immediately distinguishable. As Pickover points out, this correlation between sounds and appearance of the faces immediately suggests the possibility of using the faces as feedback devices for helping severely hearing-impaired people to modify their vocalizations. To learn a particular sound, they would try to produce the same Chernoff face as that produced by a hearing person vocalizing the sound.

There are a few things worth noting about these faces. First of all, children respond just as well as adults to the faces. Since facial recognition capabilities develop in infancy, that's really not surprising, but it does mean that the faces have very broad application possibilities. I'd also bet that they're freer of cultural bias than many interface elements, which broadens their possible uses even more. Second, the faces probably aren't appropriate for quantitative analysis; if you need to get the exact value of a parameter, use a gauge. But they're great for high-level cognitive discrimination, especially for tracking qualitative changes in multiple variables through time. Third, because they're human faces, they could contain emotional connotations that have nothing whatever to do with the data they represent. Imagine a face used to track water levels and pump pressures in a nuclear power plant getting happier and happier as the plant approaches meltdown. Time for some facial calibration, I'd say.

Included on the Developer Essentials CD is my version of Pickover's face routine. It takes as arguments a pointer to a rect and a pointer to an array of 10 bytes, and it draws the resulting face in the current port, scaled to the rect. See the code for more details. One really cool thing is that if ten dimensions aren't enough, you can simply add more detail to the picture: hair maybe, or ears. The hardest part is coming up with meaningful 10-D data.

What's really interesting is how this technique and others like it capitalize on the kind of processing that we already do automatically: you don't have to learn to discriminate faces; you already know how, and you do it without even trying. So even while some part of your brain is busily integrating facial features, your conscious mind is still free to deal with other, higher-level tasks. All the best interfaces do this to some degree, by simulating some part of what we call reality. (For instance, everyone's favorite desktop model simulates a flat, bounded environment with overlapping two- dimensional areas, something we're very familiar with in the real world through our interactions with tabletops and paper.) A convincing simulation, or even one that captures essential parts of the reality (like the Macintosh desktop), is an incredibly powerful thing.

Human interfaces (so far humans are the predominant, market-driving users of computers) can take advantage of many things: our ability to maintain internal mental maps, our built-in image processing, our kinesthetic awareness of space, and so on. All these things have been finely tuned by a zillion years of evolution, so why not use them? Effective human interfaces are overwhelmingly visual and tactile, precisely because vision and touch are the primary senses we use to interact with the world we know so well. (For a dog I suppose a good interface would have to be heavily auditory and olfactory:

sniff a file to get info; when something you search for is found, it whines so you can locate it; system errors smell like flea shampoo.)

New interfaces are trying to capitalize even further on what we already know how to do. Xerox PARC's latest experimental interface, the Information Visualizer, uses 3-D real-time animation and represents information as directly manipulable 3-D objects. You can "pick up" a data structure and look at it from all angles, using your built-in spatial skills to help make sense of large bodies of information. PenPoint, Go Corporation's recently announced pen-based operating system, takes advantage of, among other things, our familiarity with pencils and notebooks. (I guess it's not recent anymore, is it? It's still February in here.)

The goal of an interface is to make using the computer easier and more intuitive. What more direct way than to simulate on the computer things that people already know how to work with? A really interesting question is whether simulation is a necessary part of a good interface, but it's a question without an answer yet, at least as far as I know. In the meantime, while you're programming your next whiz-bang interface, remember to occasionally look beyond the next crash or whether you remembered to unlock that handle. There are many, many things that all people are already good at: take advantage of them.

RELATED AND SEMI-RELATED READING

  • Computers, Pattern, Chaos, and Beauty by Clifford A. Pickover (St. Martin's Press, 1990).
  • A Monster Is Bigger Than 9 by Claire and Mary Ericksen (The Green Tiger Press, 1988).
  • Byte , February 1991.
  • Anything by Bruce Tognazzini.

DAVE JOHNSON, our technical buckstopper, has been with Apple for three years. Before becoming an official stopper-of- the-buck, he worked on PostScript printers in Apple's software testing group. His interest in computers dates back to his college days at Humboldt State University, where he majored in energy systems engineering, and minored in everything else he could think of (it was a seven-year stay). He's also our resident juggler, who will juggle anything or anybody--and has. Actually, Dave has always been a show-biz kind of guy; as a kid, he was into monster makeup, which led him to monster-making and puppeteering at Lucasfilm's Industrial Light and Magic. (You've seen his work in such flicks as Spaceballs , The Witches of Eastwick , and Inner Space ; he was also an On-Set Duck Mechanic for Howard the Duck .) When not buckstopping and juggling, he programs the Macintosh (screen savers, gratuitous fractal programs, artificial life simulations: nothing useful), hangs out with his wife and dogs, reads as much as possible, and pushes all available limits, both real and imagined.*

 
AAPL
$99.02
Apple Inc.
+1.35
MSFT
$43.97
Microsoft Corpora
-0.53
GOOG
$590.60
Google Inc.
+1.58

MacTech Search:
Community Search:

Software Updates via MacUpdate

OS X Yosemite Wallpaper 1.0 - Desktop im...
OS X Yosemite Wallpaper is the gorgeous new background image for Apple's upcoming OS X 10.10 Yosemite. This wallpaper is available for all screen resolutions with a source file that measures 5,418... Read more
Acorn 4.4 - Bitmap image editor. (Demo)
Acorn is a new image editor built with one goal in mind - simplicity. Fast, easy, and fluid, Acorn provides the options you'll need without any overhead. Acorn feels right, and won't drain your bank... Read more
Bartender 1.2.20 - Organize your menu ba...
Bartender lets you organize your menu bar apps. Features: Lets you tidy your menu bar apps how you want. See your menu bar apps when you want. Hide the apps you need to run, but do not need to... Read more
TotalFinder 1.6.2 - Adds tabs, hotkeys,...
TotalFinder is a universally acclaimed navigational companion for your Mac. Enhance your Mac's Finder with features so smart and convenient, you won't believe you ever lived without them. Tab-based... Read more
Vienna 3.0.0 RC 2 :be5265e: - RSS and At...
Vienna is a freeware and Open-Source RSS/Atom newsreader with article storage and management via a SQLite database, written in Objective-C and Cocoa, for the OS X operating system. It provides... Read more
VLC Media Player 2.1.5 - Popular multime...
VLC Media Player is a highly portable multimedia player for various audio and video formats (MPEG-1, MPEG-2, MPEG-4, DivX, MP3, OGG, ...) as well as DVDs, VCDs, and various streaming protocols. It... Read more
Default Folder X 4.6.7 - Enhances Open a...
Default Folder X attaches a toolbar to the right side of the Open and Save dialogs in any OS X-native application. The toolbar gives you fast access to various folders and commands. You just click... Read more
TinkerTool 5.3 - Expanded preference set...
TinkerTool is an application that gives you access to additional preference settings Apple has built into Mac OS X. This allows to activate hidden features in the operating system and in some of the... Read more
Audio Hijack Pro 2.11.0 - Record and enh...
Audio Hijack Pro drastically changes the way you use audio on your computer, giving you the freedom to listen to audio when you want and how you want. Record and enhance any audio with Audio Hijack... Read more
Intermission 1.1.1 - Pause and rewind li...
Intermission allows you to pause and rewind live audio from any application on your Mac. Intermission will buffer up to 3 hours of audio, allowing users to skip through any assortment of audio... Read more

Latest Forum Discussions

See All

Traps n’ Gemstones Review
Traps n’ Gemstones Review By Campbell Bird on July 28th, 2014 Our Rating: :: CASTLEVANIA JONESUniversal App - Designed for iPhone and iPad Fight mummies, dig tunnels, and ride a runaway minecart to discover ancient secrets in this... | Read more »
The Phantom PI Mission Apparition Review
The Phantom PI Mission Apparition Review By Jordan Minor on July 28th, 2014 Our Rating: :: GHOSTS BUSTEDUniversal App - Designed for iPhone and iPad The Phantom PI is an exceedingly clever and well-crafted adventure game.   | Read more »
More Stubies Are Coming Your Way in a Ne...
More Stubies Are Coming Your Way in a New Update Posted by Jessica Fisher on July 28th, 2014 [ permalink ] Universal App - Designed for iPhone and iPad | Read more »
The Great Prank War Review
The Great Prank War Review By Nadia Oxford on July 28th, 2014 Our Rating: :: PRANKING IS SERIOUS BUSINESSUniversal App - Designed for iPhone and iPad Though short, The Great Prank War offers an interesting and fun mix of action and... | Read more »
Marvel Contest of Champions Announced at...
Marvel Contest of Champions Announced at Comic-Con Posted by Jennifer Allen on July 28th, 2014 [ permalink ] Announced over the weekend at San Diego Comic-Con was the fairly exciting looking Marvel Contest of Champions. | Read more »
Teenage Mutant Ninja Turtles Review
Teenage Mutant Ninja Turtles Review By Jennifer Allen on July 28th, 2014 Our Rating: :: DULL SWIPINGUniversal App - Designed for iPhone and iPad The pizza power is weak when it comes to this Teenage Mutant Ninja Turtles game.   | Read more »
Exploration Focused Puzzle Game Beatbudd...
Exploration Focused Puzzle Game Beatbuddy Set to Make Transition from PC to iOS this September Posted by Jennifer Allen on July 28th, 2014 [ permalink ] | Read more »
PlanetHD
PlanetHD By Nadia Oxford on July 28th, 2014 Our Rating: :: SPACE MADNESSUniversal App - Designed for iPhone and iPad PlanetHD will keep players busy for a while, though its unpredictable physics are a handful to deal with.   | Read more »
This Week at 148Apps: July 21-25, 2014
Another Week of Expert App Reviews   At 148Apps, we help you sort through the great ocean of apps to find the ones we think you’ll like and the ones you’ll need. Our top picks become Editor’s Choice, our stamp of approval for apps with that little... | Read more »
Reddme for iPhone - The Reddit Client (...
Reddme for iPhone - The Reddit Client 1.0 Device: iOS iPhone Category: News Price: $.99, Version: 1.0 (iTunes) Description: Reddme for iPhone is an iOS 7-optimized Reddit client that offers a refreshing new way to experience Reddit... | Read more »

Price Scanner via MacPrices.net

13-inch 2.5GHz MacBook Pro on sale for $1099,...
Best Buy has the 13″ 2.5GHz MacBook Pro available for $1099.99 on their online store. Choose free shipping or free instant local store pickup (if available). Their price is $100 off MSRP. Price is... Read more
Roundup of Apple refurbished MacBook Pros, th...
The Apple Store has Apple Certified Refurbished 13″ and 15″ MacBook Pros available for up to $400 off the cost of new models. Apple’s one-year warranty is standard, and shipping is free. Their prices... Read more
Record Mac Shipments In Q2/14 Confound Analys...
A Seeking Alpha Trefis commentary notes that Apple’s fiscal Q3 2014 results released July 22, beat market predictions on earnings, although revenues were slightly lower than anticipated. Apple’s Mac’... Read more
Intel To Launch Core M Silicon For Use In Not...
Digitimes’ Monica Chen and Joseph Tsai, report that Intel will launch 14nm-based Core M series processors specifically for use in fanless notebook/tablet 2-in-1 models in Q4 2014, with many models to... Read more
Apple’s 2014 Back to School promotion: $100 g...
 Apple’s 2014 Back to School promotion includes a free $100 App Store Gift Card with the purchase of any new Mac (Mac mini excluded), or a $50 Gift Card with the purchase of an iPad or iPhone,... Read more
iMacs on sale for $150 off MSRP, $250 off for...
Best Buy has iMacs on sale for up to $160 off MSRP for a limited time. Choose free home shipping or free instant local store pickup (if available). Prices are valid for online orders only, in-store... Read more
Mac minis on sale for $100 off MSRP, starting...
Best Buy has Mac minis on sale for $100 off MSRP. Choose free shipping or free instant local store pickup. Prices are for online orders only, in-store prices may vary: 2.5GHz Mac mini: $499.99 2.3GHz... Read more
Global Tablet Market Grows 11% in Q2/14 Notwi...
Worldwide tablet sales grew 11.0 percent year over year in the second quarter of 2014, with shipments reaching 49.3 million units according to preliminary data from the International Data Corporation... Read more
New iPhone 6 Models to Have Staggered Release...
Digitimes’ Cage Chao and Steve Shen report that according to unnamed sources in Apple’s upstream iPhone supply chain, the new 5.5-inch iPhone will be released several months later than the new 4.7-... Read more
New iOS App Helps People Feel Good About thei...
Mobile shoppers looking for big savings at their favorite stores can turn to the Goodshop app, a new iOS app with the latest coupons and deals at more than 5,000 online stores. In addition to being a... Read more

Jobs Board

Sr Software Lead Engineer, *Apple* Online S...
Sr Software Lead Engineer, Apple Online Store Publishing Systems Keywords: Company: Apple Job Code: E3PCAK8MgYYkw Location (City or ZIP): Santa Clara Status: Full Read more
*Apple* Solutions Consultant (ASC) - Apple (...
**Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
Sr. Product Leader, *Apple* Store Apps - Ap...
**Job Summary** Imagine what you could do here. At Apple , great ideas have a way of becoming great products, services, and customer experiences very quickly. Bring Read more
*Apple* Solutions Consultant (ASC) - Apple (...
**Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
*Apple* Solutions Consultant (ASC) - Apple (...
**Job Summary** The ASC is an Apple employee who serves as an Apple brand ambassador and influencer in a Reseller's store. The ASC's role is to grow Apple Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.