TweetFollow Us on Twitter

Spring 91 - THE VETERAN NEOPHYTE

THE VETERAN NEOPHYTE

A FAMILIAR (INTER)FACE

DAVE JOHNSON

[IMAGE p70-71_Dave's_Column_htm1.GIF]

I just learned about a technique for graphically representing points in n-dimensional space, first presented in 1973 (I guess I'm a little behind) by a Harvard statistician, H. Chernoff. Representing points in two or three dimensions is pretty straightforward, but what about data points in, say, ten dimensions? Chernoff's approach was to use cartoon faces, with each dimensional parameter determining a facial feature. One parameter determines eye size, for instance; another regulates eyebrow slant, another determines the position of the mouth, and so on. I was struck dumb by the power of the idea. Humans have a built-in feature integration and recognition ability that lets us intuitively track and correlate changing facial features with no conscious effort, and Chernoff's technique elegantly capitalizes on this ability.

The possible uses for these "Chernoff faces" are many and varied. In his book Computers, Pattern, Chaos, and Beauty , Clifford Pickover talks about a number of possible applications: the elucidation of high-level statistical concepts, uses in air traffic control and aircraft piloting, educational applications, and many more. In one particularly illuminating example he uses the faces to characterize sound. He runs the sound data through an auto-correlation function (for the gory details, see his book) and then uses the first ten points of the resulting data set to control the faces. As examples heshows the faces generated by the sounds s , sh , z , and v , sounds which are very similar. The resulting faces, though, are easily and immediately distinguishable. As Pickover points out, this correlation between sounds and appearance of the faces immediately suggests the possibility of using the faces as feedback devices for helping severely hearing-impaired people to modify their vocalizations. To learn a particular sound, they would try to produce the same Chernoff face as that produced by a hearing person vocalizing the sound.

There are a few things worth noting about these faces. First of all, children respond just as well as adults to the faces. Since facial recognition capabilities develop in infancy, that's really not surprising, but it does mean that the faces have very broad application possibilities. I'd also bet that they're freer of cultural bias than many interface elements, which broadens their possible uses even more. Second, the faces probably aren't appropriate for quantitative analysis; if you need to get the exact value of a parameter, use a gauge. But they're great for high-level cognitive discrimination, especially for tracking qualitative changes in multiple variables through time. Third, because they're human faces, they could contain emotional connotations that have nothing whatever to do with the data they represent. Imagine a face used to track water levels and pump pressures in a nuclear power plant getting happier and happier as the plant approaches meltdown. Time for some facial calibration, I'd say.

Included on the Developer Essentials CD is my version of Pickover's face routine. It takes as arguments a pointer to a rect and a pointer to an array of 10 bytes, and it draws the resulting face in the current port, scaled to the rect. See the code for more details. One really cool thing is that if ten dimensions aren't enough, you can simply add more detail to the picture: hair maybe, or ears. The hardest part is coming up with meaningful 10-D data.

What's really interesting is how this technique and others like it capitalize on the kind of processing that we already do automatically: you don't have to learn to discriminate faces; you already know how, and you do it without even trying. So even while some part of your brain is busily integrating facial features, your conscious mind is still free to deal with other, higher-level tasks. All the best interfaces do this to some degree, by simulating some part of what we call reality. (For instance, everyone's favorite desktop model simulates a flat, bounded environment with overlapping two- dimensional areas, something we're very familiar with in the real world through our interactions with tabletops and paper.) A convincing simulation, or even one that captures essential parts of the reality (like the Macintosh desktop), is an incredibly powerful thing.

Human interfaces (so far humans are the predominant, market-driving users of computers) can take advantage of many things: our ability to maintain internal mental maps, our built-in image processing, our kinesthetic awareness of space, and so on. All these things have been finely tuned by a zillion years of evolution, so why not use them? Effective human interfaces are overwhelmingly visual and tactile, precisely because vision and touch are the primary senses we use to interact with the world we know so well. (For a dog I suppose a good interface would have to be heavily auditory and olfactory:

sniff a file to get info; when something you search for is found, it whines so you can locate it; system errors smell like flea shampoo.)

New interfaces are trying to capitalize even further on what we already know how to do. Xerox PARC's latest experimental interface, the Information Visualizer, uses 3-D real-time animation and represents information as directly manipulable 3-D objects. You can "pick up" a data structure and look at it from all angles, using your built-in spatial skills to help make sense of large bodies of information. PenPoint, Go Corporation's recently announced pen-based operating system, takes advantage of, among other things, our familiarity with pencils and notebooks. (I guess it's not recent anymore, is it? It's still February in here.)

The goal of an interface is to make using the computer easier and more intuitive. What more direct way than to simulate on the computer things that people already know how to work with? A really interesting question is whether simulation is a necessary part of a good interface, but it's a question without an answer yet, at least as far as I know. In the meantime, while you're programming your next whiz-bang interface, remember to occasionally look beyond the next crash or whether you remembered to unlock that handle. There are many, many things that all people are already good at: take advantage of them.

RELATED AND SEMI-RELATED READING

  • Computers, Pattern, Chaos, and Beauty by Clifford A. Pickover (St. Martin's Press, 1990).
  • A Monster Is Bigger Than 9 by Claire and Mary Ericksen (The Green Tiger Press, 1988).
  • Byte , February 1991.
  • Anything by Bruce Tognazzini.

DAVE JOHNSON, our technical buckstopper, has been with Apple for three years. Before becoming an official stopper-of- the-buck, he worked on PostScript printers in Apple's software testing group. His interest in computers dates back to his college days at Humboldt State University, where he majored in energy systems engineering, and minored in everything else he could think of (it was a seven-year stay). He's also our resident juggler, who will juggle anything or anybody--and has. Actually, Dave has always been a show-biz kind of guy; as a kid, he was into monster makeup, which led him to monster-making and puppeteering at Lucasfilm's Industrial Light and Magic. (You've seen his work in such flicks as Spaceballs , The Witches of Eastwick , and Inner Space ; he was also an On-Set Duck Mechanic for Howard the Duck .) When not buckstopping and juggling, he programs the Macintosh (screen savers, gratuitous fractal programs, artificial life simulations: nothing useful), hangs out with his wife and dogs, reads as much as possible, and pushes all available limits, both real and imagined.*

 

Community Search:
MacTech Search:

Software Updates via MacUpdate

Is there cross-platform play in slither....
So you've sunken plenty of hours into crawling around in slither.io on your iPhone or iPad. You've got your stories of tragedy and triumph, the times you coiled four snakes at one time balanced out by the others when you had a length of more than... | Read more »
Rodeo Stampede guide to running a better...
In Rodeo Stampede, honing your skills so you can jump from animal to animal and outrun the herd as long as possible is only half the fun. Once you've tamed a few animals, you can bring them home with you. [Read more] | Read more »
VoxSyn (Music)
VoxSyn 1.0 Device: iOS Universal Category: Music Price: $6.99, Version: 1.0 (iTunes) Description: VoxSyn turns your voice into the most flexible vocal sound generator ever. Instantly following even subtle modulations of pitch and... | Read more »
Catch Battleplans on Google Play from Ju...
Real-time strategy title Battleplans is due for release on Google Play on June 30th, following its release for iOS systems last month. With its simple interface and pretty graphics, the crowd-pleaser brings a formerly overlooked genre out for the... | Read more »
iDoyle: The interactive Adventures of Sh...
iDoyle: The interactive Adventures of Sherlock Holmes - A Scandal in Bohemia 1.0 Device: iOS Universal Category: Books Price: $1.99, Version: 1.0 (iTunes) Description: Special Release Price $1.99 (Normally $3.99) | Read more »
Five popular free apps to help you slim...
Thanks to retail and advertising, we're used to thinking one season ahead. Here we are just a week into the summer and we're conditioned to start thinking about the fall. [Read more] | Read more »
How to ride longer and tame more animals...
It's hard to accurately describe Rodeo Stampede to people who haven't seen it yet. It's like if someone took Crossy Roadand Disco Zoo and put them in a blender, yet with a unique game mechanic that's still simple and fun for anyone. [Read more] | Read more »
Teeny Titans - A Teen Titans Go! Figure...
Teeny Titans - A Teen Titans Go! Figure Battling Game 1.0.0 Device: iOS Universal Category: Games Price: $3.99, Version: 1.0.0 (iTunes) Description: Teeny Titans, GO! Join Robin for a figure battling RPG of epic proportions! TEENY... | Read more »
NinjAwesome: Tips and tricks to be a mor...
Sorry about that headline, but I'm going to go ahead and assume that GameResort would not have named its game NinjAwesome without expecting some of that. It is, in fact, pretty awesome the way it combines an endless runner and old school arcade... | Read more »
Into Mirror (Games)
Into Mirror 1.0 Device: iOS Universal Category: Games Price: $1.99, Version: 1.0 (iTunes) Description: "Is all that we see or seem, but a dream within a dream?"- Edgar Allan Poe New game by Lemon Jam Studio, the team behind Pursuit... | Read more »

Price Scanner via MacPrices.net

15-inch Retina MacBook Pros on sale for $200-...
B&H Photo has 15″ Retina MacBook Pros on sale for up to $210 off MSRP. Shipping is free, and B&H charges NY tax only: - 15″ 2.2GHz Retina MacBook Pro: $1799.99 $200 off MSRP - 15″ 2.5GHz... Read more
Mac minis on sale for up to $100 off MSRP
B&H Photo has Mac minis on sale for up to $100 off MSRP including free shipping plus NY sales tax only: - 1.4GHz Mac mini: $449 $50 off MSRP - 2.6GHz Mac mini: $649 $50 off MSRP - 2.8GHz Mac mini... Read more
Clearance 2015 13-inch MacBook Airs available...
B&H Photo has clearance 2015 13″ MacBook Airs available for $300 off original MSRP. Shipping is free, and B&H charges NY sales tax only: - 13″ 1.6GHz/4GB/128GB MacBook Air (MJVE2LL/A): $799.... Read more
Apple refurbished Mac minis available for up...
Apple has Certified Refurbished Mac minis available starting at $419. Apple’s one-year warranty is included with each mini, and shipping is free: - 1.4GHz Mac mini: $419 $80 off MSRP - 2.6GHz Mac... Read more
ABBYY TextGrabber: 1,000,000 Installs in 5 Da...
ABBYY, an international OCR technologies provider, has announced that their image-to-text application TextGrabber, got installed 1,000,000 times in just five days while being featured by the App... Read more
New SkinIt Waterproof Case For iPhone 6
With its impact and waterproof design, the Skinit Waterproof case provides security and protection to guarantee your phone will get you through even the most demanding outdoor conditions. The impact-... Read more
iMacs on sale for up to $150 off MSRP
B&H Photo has 21″ and 27″ iMacs on sale for up to $150 off MSRP including free shipping plus NY sales tax only: - 27″ 3.3GHz iMac 5K: $2181.11 $118 off MSRP - 27″ 3.2GHz/1TB Fusion iMac 5K: $1949... Read more
12-inch 1.1GHz Retina MacBooks on sale for $5...
B&H Photo has 2016 12″ 1.1GHz/256GB Retina MacBooks on sale for up to $50 off MSRP. Shipping is free, and B&H charges NY tax only: - 12″ 1.1GHz Space Gray Retina MacBook: $1249 $50 off MSRP... Read more
WWDC Announcements Revisited Still Underwhelm...
I was disappointed that no new MacBook hardware was announced at this year’s all-software World Wide Developer’s Conference. Not even a hint about what’s in the development pipeline. Of course, we... Read more
Twelve South Compass 2 iPad Stand Now Availab...
Twelve South has updated its most popular iPad stand, Compass 2, with the introduction of two new colors — Gold and Rose Gold. These new color options n perfectly complement the new Rose Gold iPad... Read more

Jobs Board

*Apple* iPhone 6s and New Products Tester Ne...
…we therefore look forward to put out products to quality test for durability. Apple leads the digital music revolution with its iPods and iTunes online store, Read more
Music Marketing Lead, iTunes & *Apple*...
…Music Marketing Lead is responsible for developing robust marketing campaigns and programs for Apple Music and iTunes across the whole of Apple ecosystem. This Read more
*Apple* Valley Medical Clinic is Hiring - AP...
Apple Valley Medical Clinic is Hiring! Apple Valley Medical Clinic is an independently owned practice operating a Family Medicine Clinic, a 24/7 Urgent Care, Read more
*Apple* New Products Testers Needed - Apple...
…we therefore look forward to put out products to quality test for durability. Apple leads the digital music revolution with its iPods and iTunes online store, Read more
*Apple* Solutions Consultant - APPLE (United...
Job Summary As an Apple Solutions Consultant, you'll be the link between our future customers and our products. You'll showcase your entrepreneurial spirit as you Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.