Group items tagged

The Lab’s first game went live this week, called Ball Invasion (here’s a link on iTunes). It’s a shooter in which the world around you becomes a canvas for playing: hold your iPad 2 in front of you, and it becomes a window on a world that fills with targets that you can chase and shoot. The game’s fun enough, but really the excitement is all about the technology. While you’ve no doubt seen augmented reality before, the difference here is 13th Lab is using a complex computer vision technique known as SLAM — that’s Simultaneous Localization and Mapping. This is a system developed in part by NASA for use in robotics, which allows an object (like, say, a drone) to look around, build up a picture of the world and then understand where it is.

When it comes to mobile Augmented Reality technology, Qualcomm is the top dog. The San Diego company has the biggest AR R&D unit in the world and the message from its recent Uplinq conference in California was clear - it thinks that AR is going to play a significant role in shaping the mobile media horizon.

Qualcomm's senior director of business development Jay Wright

"For Qualcomm, we think the technology is interesting, we follow it closely but it's not on our near to mid-term horizon. This is beyond the five to eight year window," he said.

Augmented reality has been touted as the "next big thing" for a while, yet mainstream success has proved elusive. So what can be done to turn it from a gimmick into a commercial necessity?Imagine being able to watch miniature versions of Kings of Leon or Lady Gaga play on a table right in front of your eyes.

One company - String, in partnership with tech firm Digicave - has developed and demonstrated a system that creates the impression of a 3D figure mapped onto, for example, a book shelf. Such technology opens up the possibility of having a pop star appear in your bedroom, performing as if they were on-stage.

The idea of augmented reality was first mooted as far back as in 1965, with Ivan Sutherland's now famous essay Augmented Reality: The Ultimate Display. In it, he said that "with appropriate programming… a display could literally be the Wonderland into which Alice walked," stating that digital handcuffs would be able to actually restrain users, and those shot by digital characters would be killed in real life.

Third Eye, a new free Android game from Viewdle, uses a combination of augmented reality and facial recognition technology to make a whole new kind of mobile game.

Basically, everybody is either a Vampire or a Slayer and this "relic"--the Third Eye--can tell you which category you fall into by reading your "faceprint." You might be familiar with Viewdle's other Android app, SocialCamera, which uses facial recognition to automatically tag photos of your friends. The objective of the first part of Third Eye is to build your army and establish alliances. The second and third parts, which will come out later this year, pits your assembled clans against one another in all-out war.

Next, you'll want to start recruiting people for your army. Third Eye uses the same facial algorithm on your friends (or random strangers, if you're bold) to identify if they are a vampire or a slayer. You simply hold your phone up toward their face and the app will scan it to determine their fate. If they're a slayer and you're a vampire, you can either "Feed" aka suck their blood or "Ghoulify" and make them join your army.

For example, way back in 1961, cinematographer Morton Heilig patented his Sensorama machine, an immersive multi-sensory device that looked like a giant arcade game, except it emitted aromas, environmental elements such as wind and it also vibrated and played stereo sounds. Whilst some have referred to this as the earliest example of augmented reality, it probably leans more towards the virtual reality world.

Other key advances that helped blur the boundaries between the physical and digital worlds include American Computer scientist Ivan Sutherland’s development of the first head-mounted display (HMD) in 1968. It was primitive and bulky, but it was a sign of things to come:

Moving forward, computer artist Myron Krueger built what was called an ‘artificial reality’ laboratory called the Videoplace, in 1974. The Videoplace combined projectors, video cameras and special purpose hardware, and onscreen silhouettes of the users, placing them within an interactive environment.

Boring conversation? Accessories that decipher emotional cues could save your social life – or reveal that you're a jerk

The glasses can send me this information thanks to a built-in camera linked to software that analyses Picard's facial expressions. They're just one example of a number of "social X-ray specs" that are set to transform how we interact with each other. By sensing emotions that we would otherwise miss, these technologies can thwart disastrous social gaffes and help us understand each other better. Some companies are already wiring up their employees with the technology, to help them improve how they communicate with customers. Our emotional intelligence is about to be boosted, but are we ready to broadcast feelings we might rather keep private?

In a 10-day experiment in 2008, Japanese and American college students were given the task of building a complex contraption while wearing the next generation of jerk-o-meter - which by that time had been more diplomatically renamed a "sociometric badge". As well as audio, their badge measured proximity to other people.

"It's a novel user interface that's got everyone interested," said Jay Wright, a senior director for Qualcomm focused on augmented reality.

The compass-based mapping feature you see now represents only the beginning of augmented reality's promise, Wright said. In an interview, he said the next generation of augmented reality will better integrate superimposed images with reality and work with a broader set of applications. He believes it represents an elegant way of marrying the tangibility of the physical world with information available in the digital world.

There are still technical hurdles to surpass. More phones are starting to use a 1-gigahertz processor or faster, which is recommended to handle such tasks. The computer vision, he said, needs to be improved to it can scan three-dimensional objects rather than just flat images, which he expects is the catalyst to opening up the feature.

Last week, video eyewear maker Vuzix announced (pdf) that it has partnered with cell phone maker Nokia to produce the next generation of see-through near-eye display (NED) glasses. The glasses will use Exit Pupil Expanding (EPE) optics technology developed by both Vuzix and Nokia.Vuzix, which has been developing display technologies for the military since 1997, credits itself with creating the consumer video eyewear market, which it did in 2005 with the release of the V920 glasses. 

Nokia-enhanced NED glasses

NEC has launched a wearable computer, the NEC TeleScouter, intended to allow fieldworkers to consult a virtual 16-inch transparent display projected in front of them while they go about their business. Consisting of a Brother AirScouter wearable display and a compact 500MHz ARM-based computer packing WiFi a/b/g and Bluetooth, the system currently targets industrial augmented reality (AR) applications, but NEC sees the future being far broader.

In fact, the target is AR that can remind you of the identity of acquaintances when you bump into them at parties, pull up information on products you’ve bought but haven’t kept the user guide to hand, and other more personal applications. NEC is also working on the potential input and control methods, such as sensors which would allow you to tap your arm in different ways to trigger functionality.

Computer-maker NEC calls them the latest in eyewear for the linguistically challenged. The TeleScouter integrates spectacle frames with a personal mini-computer and a head-mounted display unit. The result is a portable language translator. TeleScouter allows two or more people with no language in common, to hold a conversation. One user will begin the conversation in their native language and, with the press of a button send the recorded words to a remote server where they are analyzed and translated. The server then sends the translation to the receiving user who can read the words in their own language on the head-mounted display unit. While the technology is still in its developmental stages, NEC says a faster unit is on the horizon and that the hope is to break down language barriers. [Kotaro Nagahama, NEC Manager]: "With this you don't have to think about having to translate yourself your own words. All you have to do is speak in your own words and that gets communicated to the other person and you don't have to do any thinking. You just have you use your own language. " But TeleScouter will not be cheap. When it reaches the market it'll sell for around $83,000 although the price will come down over time. If all goes according to plan, NEC says foreign tourists will one day, with great confidence be able to tell their hosts "I see what you're saying."

A recent video released by Hidden Creative has caused some discussion over augmented reality among netizens. The video explains that augmented reality technology is the way of the future. Users are able to use their cellphones or digital device to scan their surrounding and find out live information on the spot. The video also demonstrates how augmented reality can also overlay objects in a real-life space to help users with renovations by virtually rearranging furniture or configuring the colors virtually. Nevertheless, although most reactions to the video have been quite positive and enthusiastic, some bloggers are little bit more skeptical as to whether augmented reality is here to stay. Comments from Digital Urban included: “We maybe wrong but waving your phone around simply does not feel like the future to us”, “Augmented reality often just seems to be cool rather than actually good enough to be useful” and also “The way AR is presented here is not a step forward, it’s a step backward actually”.

By providing an open platform for the creation of augmented-reality layers, these apps have democratised the AR industry - and made possible flights of fancy such as Unseen Sculptures, in which new-media artist Warren Armstrong and nearly two dozen others collaborated to populate central Melbourne and Sydney with a range of virtual artworks that "appeared" when smartphones running the Layar app were pointed at particular parts of the city."I'm fascinated by mobile devices and their ubiquity," says Armstrong, who has spearheaded the project's expansion - including planned engagements with the Sydney Fringe Festival, Cairns Festival and other projects. "It's very immersive: you can go to a location, put on headphones and do amazing things with sounds. Layar takes care of the fiddly back-end stuff for people who aren't au fait with PHP or MySQL programming. The whole thing is in its infancy, and there's a lot of scope for creating new things."

A new Kinect hack places virtual objects anywhere in the real world and lets you interact with them as if they were actually there.Most Kinect hacks just use a single version of the sensor, but a team at Microsoft Research has used four ceiling-mounted Kinects to map an entire room and the objects inside it in full 3D. A handheld projector acts as a flashlight that lets you peer into this virtual version of the world to reveal hidden images or draw in 3D space.This close link between the real and virtual world allows for some impressive interactions, such as creating virtual copies of real objects or generating a stream of virtual particles on a desk and watching them roll inside a real-life drawer.The project is unlikely to become a commercial product any time soon, but it's easy to imagine how a more polished version could lead to a holodeck-like environment in the comfort of your own living room.