TweetFollow Us on Twitter

Spring 91 - THE VETERAN NEOPHYTE

THE VETERAN NEOPHYTE

A FAMILIAR (INTER)FACE

DAVE JOHNSON

[IMAGE p70-71_Dave's_Column_htm1.GIF]

I just learned about a technique for graphically representing points in n-dimensional space, first presented in 1973 (I guess I'm a little behind) by a Harvard statistician, H. Chernoff. Representing points in two or three dimensions is pretty straightforward, but what about data points in, say, ten dimensions? Chernoff's approach was to use cartoon faces, with each dimensional parameter determining a facial feature. One parameter determines eye size, for instance; another regulates eyebrow slant, another determines the position of the mouth, and so on. I was struck dumb by the power of the idea. Humans have a built-in feature integration and recognition ability that lets us intuitively track and correlate changing facial features with no conscious effort, and Chernoff's technique elegantly capitalizes on this ability.

The possible uses for these "Chernoff faces" are many and varied. In his book Computers, Pattern, Chaos, and Beauty , Clifford Pickover talks about a number of possible applications: the elucidation of high-level statistical concepts, uses in air traffic control and aircraft piloting, educational applications, and many more. In one particularly illuminating example he uses the faces to characterize sound. He runs the sound data through an auto-correlation function (for the gory details, see his book) and then uses the first ten points of the resulting data set to control the faces. As examples heshows the faces generated by the sounds s , sh , z , and v , sounds which are very similar. The resulting faces, though, are easily and immediately distinguishable. As Pickover points out, this correlation between sounds and appearance of the faces immediately suggests the possibility of using the faces as feedback devices for helping severely hearing-impaired people to modify their vocalizations. To learn a particular sound, they would try to produce the same Chernoff face as that produced by a hearing person vocalizing the sound.

There are a few things worth noting about these faces. First of all, children respond just as well as adults to the faces. Since facial recognition capabilities develop in infancy, that's really not surprising, but it does mean that the faces have very broad application possibilities. I'd also bet that they're freer of cultural bias than many interface elements, which broadens their possible uses even more. Second, the faces probably aren't appropriate for quantitative analysis; if you need to get the exact value of a parameter, use a gauge. But they're great for high-level cognitive discrimination, especially for tracking qualitative changes in multiple variables through time. Third, because they're human faces, they could contain emotional connotations that have nothing whatever to do with the data they represent. Imagine a face used to track water levels and pump pressures in a nuclear power plant getting happier and happier as the plant approaches meltdown. Time for some facial calibration, I'd say.

Included on the Developer Essentials CD is my version of Pickover's face routine. It takes as arguments a pointer to a rect and a pointer to an array of 10 bytes, and it draws the resulting face in the current port, scaled to the rect. See the code for more details. One really cool thing is that if ten dimensions aren't enough, you can simply add more detail to the picture: hair maybe, or ears. The hardest part is coming up with meaningful 10-D data.

What's really interesting is how this technique and others like it capitalize on the kind of processing that we already do automatically: you don't have to learn to discriminate faces; you already know how, and you do it without even trying. So even while some part of your brain is busily integrating facial features, your conscious mind is still free to deal with other, higher-level tasks. All the best interfaces do this to some degree, by simulating some part of what we call reality. (For instance, everyone's favorite desktop model simulates a flat, bounded environment with overlapping two- dimensional areas, something we're very familiar with in the real world through our interactions with tabletops and paper.) A convincing simulation, or even one that captures essential parts of the reality (like the Macintosh desktop), is an incredibly powerful thing.

Human interfaces (so far humans are the predominant, market-driving users of computers) can take advantage of many things: our ability to maintain internal mental maps, our built-in image processing, our kinesthetic awareness of space, and so on. All these things have been finely tuned by a zillion years of evolution, so why not use them? Effective human interfaces are overwhelmingly visual and tactile, precisely because vision and touch are the primary senses we use to interact with the world we know so well. (For a dog I suppose a good interface would have to be heavily auditory and olfactory:

sniff a file to get info; when something you search for is found, it whines so you can locate it; system errors smell like flea shampoo.)

New interfaces are trying to capitalize even further on what we already know how to do. Xerox PARC's latest experimental interface, the Information Visualizer, uses 3-D real-time animation and represents information as directly manipulable 3-D objects. You can "pick up" a data structure and look at it from all angles, using your built-in spatial skills to help make sense of large bodies of information. PenPoint, Go Corporation's recently announced pen-based operating system, takes advantage of, among other things, our familiarity with pencils and notebooks. (I guess it's not recent anymore, is it? It's still February in here.)

The goal of an interface is to make using the computer easier and more intuitive. What more direct way than to simulate on the computer things that people already know how to work with? A really interesting question is whether simulation is a necessary part of a good interface, but it's a question without an answer yet, at least as far as I know. In the meantime, while you're programming your next whiz-bang interface, remember to occasionally look beyond the next crash or whether you remembered to unlock that handle. There are many, many things that all people are already good at: take advantage of them.

RELATED AND SEMI-RELATED READING

  • Computers, Pattern, Chaos, and Beauty by Clifford A. Pickover (St. Martin's Press, 1990).
  • A Monster Is Bigger Than 9 by Claire and Mary Ericksen (The Green Tiger Press, 1988).
  • Byte , February 1991.
  • Anything by Bruce Tognazzini.

DAVE JOHNSON, our technical buckstopper, has been with Apple for three years. Before becoming an official stopper-of- the-buck, he worked on PostScript printers in Apple's software testing group. His interest in computers dates back to his college days at Humboldt State University, where he majored in energy systems engineering, and minored in everything else he could think of (it was a seven-year stay). He's also our resident juggler, who will juggle anything or anybody--and has. Actually, Dave has always been a show-biz kind of guy; as a kid, he was into monster makeup, which led him to monster-making and puppeteering at Lucasfilm's Industrial Light and Magic. (You've seen his work in such flicks as Spaceballs , The Witches of Eastwick , and Inner Space ; he was also an On-Set Duck Mechanic for Howard the Duck .) When not buckstopping and juggling, he programs the Macintosh (screen savers, gratuitous fractal programs, artificial life simulations: nothing useful), hangs out with his wife and dogs, reads as much as possible, and pushes all available limits, both real and imagined.*

 
AAPL
$107.62
Apple Inc.
+0.64
MSFT
$46.73
Microsoft Corpora
+0.68
GOOG
$557.33
Google Inc.
+7.02

MacTech Search:
Community Search:

Software Updates via MacUpdate

Vitamin-R 2.20b1 - Personal productivity...
Vitamin-R creates the optimal conditions for your brain to work at its best by structuring your work into short bursts of distraction-free, highly focused activity alternating with opportunities for... Read more
Dropbox 2.10.44 - Cloud synchronization...
Dropbox is an application that creates a special Finder folder that automatically syncs online and between your computers. It allows you to both backup files and keep them up-to-date between systems... Read more
Sandvox 2.9.2 - Easily build eye-catchin...
Sandvox is for Mac users who want to create a professional looking website quickly and easily. With Sandvox, you don't need to be a Web genius to build a stylish, feature-rich, standards-compliant... Read more
Cocktail 8.0.1 - General maintenance and...
Cocktail is a general purpose utility for OS X that lets you clean, repair and optimize your Mac. It is a powerful digital toolset that helps hundreds of thousands of Mac users around the world get... Read more
LibreOffice 4.3.3.2 - Free Open Source o...
LibreOffice is an office suite (word processor, spreadsheet, presentations, drawing tool) compatible with other major office suites. The Document Foundation is coordinating development and... Read more
VMware Fusion 7.0.1 - Run Windows apps a...
VMware Fusion allows you to create a Virtual Machine on your Mac and run Windows (including Windows 8.1) and Windows software on your Mac. Run your favorite Windows applications alongside Mac... Read more
OneNote 15.3.2 - Free digital notebook f...
OneNote is your very own digital notebook. With OneNote, you can capture that flash of genius, that moment of inspiration, or that list of errands that's too important to forget. Whether you're at... Read more
Audio Hijack Pro 2.11.4 - Record and enh...
Audio Hijack Pro drastically changes the way you use audio on your computer, giving you the freedom to listen to audio when you want and how you want. Record and enhance any audio with Audio Hijack... Read more
Iridient Developer 3.0.0 beta 3 - Powerf...
Iridient Developer (was RAW Developer) is a powerful image conversion application designed specifically for OS X. Iridient Developer gives advanced photographers total control over every aspect of... Read more
TextWrangler 4.5.11 - Free general purpo...
TextWrangler is the powerful general purpose text editor, and Unix and server administrator's tool. Oh, and also, like the best things in life, it's free. TextWrangler is the "little brother" to... Read more

Latest Forum Discussions

See All

Retry Review
Retry Review By Rob Thomas on October 31st, 2014 Our Rating: :: SOARING HIGHUniversal App - Designed for iPhone and iPad Flappy who? Let Retry wash all those bad bird-related memories away on a cool retro-flavored flight… right... | Read more »
Dementia: Book of the Dead Review
Dementia: Book of the Dead Review By Lee Hamlet on October 31st, 2014 Our Rating: :: A TOUGH READUniversal App - Designed for iPhone and iPad A witch hunter is sent after a demonic book in the spooky but short-lived Dementia: Book... | Read more »
Card Dungeon, the Semi-Board Game Roguel...
Card Dungeon, the Semi-Board Game Roguelike, Has Been Renovated Posted by Jessica Fisher on October 31st, 2014 [ permalink ] | Read more »
Logitech Protection + Power iPhone5/5S C...
Made by: Logitech Price: $99.99 Hardware/iOS Integration Rating: 3 out of 5 stars Usability Rating: 0.5 out of 5 stars Reuse Value Rating: 0.75 out of 5 stars Build Quality Rating: 0.75 out of 5 stars Overall Rating: 1.25 out of 5 stars | Read more »
This Is Not a Test Goes Free, Permanentl...
This Is Not a Test Goes Free, Permanently Posted by Jessica Fisher on October 31st, 2014 [ permalink ] Universal App - Designed for iPhone and iPad | Read more »
Swap Heroes Review
Swap Heroes Review By Campbell Bird on October 31st, 2014 Our Rating: :: STRATEGIC SWAPPINGUniversal App - Designed for iPhone and iPad Rotate a cast of heroes to fend of waves of monsters in this difficult, puzzle rpg.   | Read more »
Night Sky Pro™ (Reference)
Night Sky Pro™ 3.0.1 Device: iOS Universal Category: Reference Price: $2.99, Version: 3.0.1 (iTunes) Description: Night Sky Pro™Wonder No More™ Night Sky Pro™ is the ultimate stargazing experience. From the creators of the original... | Read more »
Audio Defence : Zombie Arena (Games)
Audio Defence : Zombie Arena 1.0 Device: iOS Universal Category: Games Price: $4.99, Version: 1.0 (iTunes) Description: A zombie shooter audio game. Made from gut-wrenching 3D binaural sound, for a new kind of weird immersion. You... | Read more »
RPG Asdivine Hearts (Games)
RPG Asdivine Hearts 1.1.0 Device: iOS Universal Category: Games Price: $3.99, Version: 1.1.0 (iTunes) Description: SPECIAL PRICE50% OFF (USD 7.99 -> USD 3.99)!!! Travel alongside four companions and a cat in the adventure of a... | Read more »
Haunt the House: Terrortown (Games)
Haunt the House: Terrortown 1.0.1 Device: iOS Universal Category: Games Price: $.99, Version: 1.0.1 (iTunes) Description: 66.6% OFF! SPECIAL SPOOKY HALLOWEEN LAUNCH PRICE! 66.6% OFF! ...What was that sound? Is somebody there? | Read more »

Price Scanner via MacPrices.net

Apple now offering refurbished 2014 13-inch R...
The Apple Store is now offering Apple Certified Refurbished 2014 13″ Retina MacBook Pros for up to $270 off the cost of new models. An Apple one-year warranty is included with each model, and... Read more
Apple Regains Momentum As Windows Stutters An...
The latest smartphone sales data from Kantar Worldpanel ComTech, for the three months to March 2014, shows Apple performing strongly in the first quarter of the year, with sales bouncing back in... Read more
Worldwide Smartphone Shipments Increase 25.2%...
New smartphone releases and an increased emphasis on emerging markets drove global smartphone shipments above 300 million units for the second consecutive quarter, according to preliminary data from... Read more
Apple now offering refurbished 2014 15-inch M...
The Apple Store is now offering Apple Certified Refurbished 2014 15″ Retina MacBook Pros for up to $400 off the cost of new models. An Apple one-year warranty is included with each model, and... Read more
Apple drops prices on refurbished 2013 Retina...
The Apple Store has dropped prices on 2013 Apple Certified Refurbished 13″ and 15″ Retina MacBook Pros, with Retina models now available starting at $999. Apple’s one-year warranty is standard, and... Read more
New 2.8GHz Mac mini on sale for $949, save $5...
Abt Electronics has the new 2.8GHz Mac mini in stock and on sale for $949.05 including free shipping. Their price is $50 off MSRP, and it’s the lowest price available for this model from any reseller... Read more
Sale! 3.7GHz Quad Core Mac Pro available for...
 B&H Photo has the 3.7GHz Quad Core Mac Pro on sale for $2649 including free shipping plus NY sales tax only. Their price is $350 off MSRP, and it’s the lowest price for this model from any... Read more
Mujjo Steps Up The Game With Refined Touchscr...
Netherlands based Mujjo have just launched their Refined Touchscreen Gloves, stepping up their game. The gloves feature a updated elegant design that takes these knitted gloves to the next level. A... Read more
Sale! Preorder the new 27-inch 5K iMac for $2...
 Abt Electronics has the new 27″ 3.5GHz 5K iMac on sale and available for preorder for $2374.05 including free shipping. Their price is $125 off MSRP, and it’s the lowest price available for this... Read more
Simplex Solutions Inc. Brings Secure Web Surf...
New York based Simplex Solutions Inc. has announced the release and immediate availability of Private Browser 1.0, its revolutionary new secure web browser developed for iPhone, iPad and iPod touch... Read more

Jobs Board

Position Opening at *Apple* - Apple (United...
**Job Summary** Every day, business customers come to the Apple Store to discover what powerful, easy-to-use Apple products can do for them. As a Business Leader, Read more
Sr. Manager, *Apple* Deployment Programs fo...
**Job Summary** Apple is seeking candidates for a new position on the Education Content and Technology team. iPad and Mac is in the hands of millions of teachers and Read more
*Apple* Solutions Consultant (ASC) - Apple I...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
*Apple* Solutions Consultant (ASC) - Apple I...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
*Apple* Solutions Consultant (ASC) - Apple I...
…important role that the ASC serves is that of providing an excellent Apple Customer Experience. Responsibilities include: * Promoting Apple products and solutions Read more
All contents are Copyright 1984-2011 by Xplain Corporation. All rights reserved. Theme designed by Icreon.