You Can't Hide Your Feelings

You can try to hide your feeling, but it won't work...

Your emotions are now an open book to anyone with facial-recognition software, such as from Emotient, Affectiva, and Eyeris.

This video from Emotient shows examples of Dr. Marion Bartlett demonstrating very well how the system is able to pick up on her expressions of joy, sadness, surprise, anger, fear, disgust, and contempt. 

From broad displays of emotion to subtle spontaneous, natural displays, to micro, fast and involuntary expressions, the system detects and clearly displays it. 

Described in the Wall Street Journal, the software, in real time, successfully uses "algorithms to analyze people's faces" and is based on the work of Dr. Paul Ekman, who pioneered the study of facial expressions creating a catalog in the 1970s with "more than 5,000 muscle movements" linked to how they reveal your emotions. 

A single frame of a person's face can be used to extract 90,000 data points from "abstract patterns of light to tiny muscle movements, which get sorted by emotional categories."

With databases of billions of expressions from millions of faces in scores of countries around the world, the software works across ethnically diverse groups. 

Emotion-detection has a myriad of applications from national security surveillance and interrogation to in-store product marketing and generally gauging advertising effectiveness, to helping professionals from teachers to motivational speakers, executives, and even politicians hold people's attention and improve their messaging.

Then imagine very personal uses such as the software being used to evaluate job applicants or to tell if a spouse is lying about an affair...where does it end?

Of course, there are serious privacy issues in reading people's faces unbeknownst to or unwanted by them as well as possibilities for false positives, so that people's feelings are wrongly pegged or interpreted. 

In the end, unless you wear a physical mask or can spiritually transcend yourself above it all, we can see you and soon we will know not just what you are feeling, but also what you are thinking as well...it's coming. ;-)

You Can't Hide Your Feelings

Crooked x 2

First, some beautiful flowers from Washington, D.C. 

Thought these were awesome, even though the gardner did a little bit of a crooked job here. 

And when it comes to crooked, I overheard a funny story in the locker room the other day.

These school students were talking about getting caught stealing something in a local store.

One says that he got spotted on the surveillance cameras and that they even have facial recognition now, but he's okay on that because he was wearing a cap. 

Another kid in the group says "why didn't you just tell them you didn't know you couldn't take it!" 

Some very sophisticated crooks we got here. ;-)

(Source Photo: Andy Blumenthal)

Crooked x 2

Hiding Yourself In Plain Sight

I remember hearing that sometimes the best way to hide is in plain sight--just where no one would think to look.

Now there is a new clothing line being introduced by Adam Harvey for Stealth Wear that hides you using your own clothes. 

According to Slate (11 January 2013), the clothing line is envisioned to have:

- Anti-drone hoodies and scarfs:  These will be made with special metalized material that can shield you from things like drone thermal imaging technology, and I would imagine could also help against facial recognition along the lines of a prior project CVDazzle that uses face-painting and hair styling for concealment. 

- XX-shirts: These cover your upper body and can shield you from x-rays. I wonder how this will impact TSA scanning at airports?

- Pocket-blocks: A cell phone pouch made from "signal attenuating material" to prevent tracking and interception. 

Don't confuse this stealth wear clothing line with a Canadian company called StealthWear that makes a different type of protective clothing--padding for jackets, forearms, shoulders, torso, and so on for those working in "aggressive educational environments."

The new Stealth Wear, however, is a concept for a high-tech fashion line designed to provide counter surveillance and more personal privacy--in this sense, it's really the anti Big Brother. 

With more and more cameras, imaging machines, facial recognition, drones, and other surveillance tools out there--I suppose it is not surprising to see a cultural backlash in terms of everyday surveillance protection clothing coming to the fore. ;-)

(Source Photo: Andy Blumenthal)

Hiding Yourself In Plain Sight

Choke Points to Checkpoints

This is some promising biometric technology from AOptix. 

Enrolling in the system is the first step and means just seconds of standing in the capture field of the slender tower, and the device scans both iris and face of the person. 

The scanning captures images within seconds and the software converts the images into binary code. 

It then subsequently scans and matches the person's biometrics against the database for positive identification. 

The beauty of this system is that it is simple and fast and can be used for passenger screening, immigration, or any other access control for entry/egress for a building, location, or even to a computer computer system and it's information.

According to Bloomberg Businessweek, the Insight Duo Towers sells for $40,000 each.

Eighty of these are currently in use at all air, land, and sea borders in Qatar.  Further, Dubai International Airport has been piloting this at a terminal that handles 40 million people per year, and it has cut immigration waiting times from 49 minutes to 22 seconds. 

This technology has obvious important applications for military, law enforcement, and homeland security, as well as even more generalized security use in the private sector.

And while very impressive, here are some concerns about it that should be addressed:

1) Enrollment of Biometrics and Personal Identification--registering for the system may only take a few seconds for the actual scan, but then verifying who you are (i.e. who those biometrics really belong to) is another step in the process not shown.  How do we know that those iris and face prints belong to Joe Schmo the average citizen who should be allowed through the eGate and not to a known terrorist on the watch list?  The biometrics need to be associated with a name, address, social security, date of birth and other personal information.

2) Rights versus Recognitions--rights to access and recognition are two different things. Just because there is iris and facial recognition, doesn't mean that this is someone who should be given access rights to a place, system or organization.  So the devil is in the details of implementation in specifying who should have access and who should not. 

3) Faking Out The System--no system is perfect and when something is advertised as accurate, the question to me is how accurate and where are the system vulnerabilities. For example, can the system be hacked and false biometrics or personal identification information changed?  Can a terrorist cell, criminal syndicate, or nations state create really good fake iris and facial masks for impersonating an enrollee and fooling the system into thinking that a bad good is really a good guy. 

4) Privacy of Personally Identifiable Information (PII)--not specific to AOptix, but to this biometric solutions overall--how do we ensure privacy of the data, so it is not stolen or misused such as for identity theft.  I understand that AOptix has PKI encryption, but how strong is the encryption,who long does it take to break, and what are the policies and procedures within organizations to safeguard this privacy data.

5) Big Brother Society--biometrics recognition may provide for opportunities for safe and secure access and transit, but what are the larger implications for this to become a "big brother" society where people are identified and tracked wherever they go and whatever they do. Where are the safeguards for democracy and human rights.

Even with these said, I believe that this is the wave of the future for access control--as AOptix's says, for changing choke points to checkpoints--we need a simple, fast, secure, and cost-effective way to identify friends and foe and this is it, for the masses, in the near-term.

Choke Points to Checkpoints

Facial Recognition Goes Mainstream

Facial recognition applications are no longer just for the military and law enforcement to identify hostiles or criminals, but rather is going mainstream.

The Wall Street Journal (5 August 2011) reports from the bar scene to the television and from vampire gaming to celebrity match-ups, facial recognition software is now part of our everyday technology mix.

Facial recognition is "at a tipping point where some of these face-recognition technologies are not just gimicks, but are becoming useful." Moreover, the technology has become quite good with "frontal face images, the error rate of rejecting a legitimate claim--when the face image and name match-decreased to 0.29% in 2010 from a rate of 79% in 1993."

So here are some examples of how facial recognition is being used:

- SceneTap: Free app for iPhone and Droid "displays real time stats on the local bar scene...shows the number of people at the bar, the male-to-female ratio, and the average age of the patron"--all from facial recognition--this is not bad except for the bartender on a slow night.

- TVs with Viewdle: TV set-top boxes with facial recongition can "identify who is sitting in front of the TV then customize programming accordingly...displaying most recently watched or recorded shows"--can anyone say America's Got Talent!

- Third Eye: Facebook game that based on facial recognition identifies people as either vampires or slayers. Even without the app, I'd bet I'm one of the slayers :-)

- FaceR Celebrity: This iPhone app uses a picture and facial recognition software to determine which celebrities you most closely resemble. For me, it's Sylvester Stallone, all the way--I'm sure of it.

A lot of people are concerned about the privacy implications of facial recognition--collecting and storing images of faces and using it for surveillance and tracking and getting into your business...like knowing what bars or whereever else you are going to.

But apps like SceneTap say they don't collect personal information, nobody sees the video feed, and they don't match the images to photos on the web or Facebook to identify exactly who is entering the bar. This is sounding a little like TSA and the body imaging scanners they use--i.e. don't worry nobody sees your privates! :-)

But perhaps, whether or not they do or don't isn't the point, they could and that is a privacy concern.

Facial recognition technology, even though it is used in gaming, it is not kid's play, and it should be regulated to avoid a society where Internet "big brother" has virtually unlimited capability to track and match each and every facial you!

(Source Photo: here)

Facial Recognition Goes Mainstream

Seeing things Differently with Augmented Reality

One of the most exciting emerging technologies out there is Augmented Reality (AR). While the term has been around since approximately 1990, the technology is only really beginning to take off now for consumer uses.

In augmented reality, you layer computer-generated information over real world physical environment. This computer generated imagery is seen through special eye wear such as contacts, glasses, monocles, or perhaps even projected as a 3-D image display in front off you.

With the overlay of computer information, important context can be added to everyday content that you are sensing. This takes place when names and other information are layered over people, places, and things to give them meaning and greater value to us.

Augmented reality is really a form of mashups, where information is combined (i.e. content aggregration) from multiple sources to create a higher order of information with enhanced end-user value.

In AR, multiple layers of information can be available and users can switch between them easily at the press of a button, swipe of a screen, or even a verbal command.

Fast Company, November 2009, provides some modern day examples of how this AR technology is being used:

Yelp’s iPhone App—“Let’s viewers point there phone down a street and get Yelp star ratings for merchants.”

Trulia for Android—“The real-estate search site user Layar’s Reality Browser to overlay listings on top of a Google phone’s camera view. Scan a neighborhood’s available properties and even connect to realtors.”

TAT’s Augmented ID— “Point your Android phone at a long-lost acquaintance for his Facebook, Twitter, and YouTube activity.”

Michael Zollner, an AR researcher, puts it this way: “We have a vast amount of data on the Web, but today we see it on a flat screen. It’s only a small step to see all of it superimposed on our lives.”

Maarteen Lens-FitzGerald, a cofounder of Layar, said: “As the technology improves, AR apps will be able to recognize faces and physical objects [i.e. facial and object recognition] and render detailed 3-D animation sequences.”

According to Fast Company, it will be like having “Terminator eyes,” that see everything, but with all the information about it in real time running over or alongside the image.

AR has been in use for fighter pilots and museum exhibits and trade shows for a number of years, but with the explosive growth of the data available on the Internet, mobile communication devices, and wireless technology, we now have a much greater capability to superimpose data on everything, everywhere.

The need to “get online” and “look things up” will soon be supplanted by the real time linkage of information and imagery. We will soon be walking around in a combined real and virtual reality, rather than coming home from the real world and sitting down at a computer to enter a virtual world. The demarcation will disappear to a great extent.

Augmented reality will bring us to a new level of efficiency and effectiveness in using information to act faster, smarter, and more decisively in all our daily activities personally and professionally and in matters of commerce and war.

With AR, we will never see things the same way again!

Seeing things Differently with Augmented Reality