VR Hackathon 2014

I had a lot of fun helping to judge several dozen lively entries in the SF VR Hackathon this Sunday. I guess I’m at a point in my career where I’m qualified to judge but don’t have enough time to actually create fun projects (outside of work).

For “only” three days of work, there were some amazing entries. A number of them won prizes. I wish we’d had more categories and prizes to give out to some of the other notable efforts, like a mind-bending recursive/immersive zombie game from one of the sponsor teams and a really interesting virtual world built entirely in a pixel shader.

The grand prize went to a ghostbusters riff that did an amazing job solving (for narrow use cases) user input in VR, which I think is still one of the biggest unsolved challenges. Here’s some video of their experience. The controller had great haptic feedback, and the weak cardboard backbone connecting the two pieces actually added more value than it took away.

via Who You Gonna Call – VR Hackathon 2014 – YouTube.

No Comments

Miku

Nicely done, but I can’t figure out how to embed properly:

http://ak.c.ooyala.com/h4OTd4azoOLRlJhJ1B55LxeICRMbb3rU/DOcJ-FxaFrRg4gtDMwOjFpaDowODE7X4

No Comments

VR and Hollywood

Move over 3D movies, here comes virtual reality – The Washington Post.

The only real conclusion one can draw from this article is that marketers are really excited about VR’s ability to attract attention. Here are 7 reasons to think harder:

1. “Movie theaters” full of HMDs are unlikely (even ignoring hygiene & robustness issues).  The economics don’t make sense for the equivalent of having 300 people watch the same thing on one expensive big screen.

Even factoring in the cost of a new PC or console, we’d more likely see the equivalent of “internet/game cafes” for those who can’t afford their own VR setup at home (plus rentable airline equivalents), more as a niche and trailing edge.

2. Hollywood + VR movies already exist. They’re called games. Now, game developers generally put substantial effort into making their cinematic intros and cut scenes. But even with higher production values, most people watch these a few times and then skip right to the gameplay. The gameplay must be better than the intro movie or the investment will only succeed on YouTube, if at all.

Take-away: interactivity is key.

3. Physical interactivity in VR is not yet ready for prime time. Reason being: the closer you get to the human body for sensing our movement, the more proprioceptive skill we have and the less tolerant we are of noise and other errors.

So in the short-term, the level of interactivity will range from “almost none” to the equivalent of a gaming controller. Designers have to work around those limitations. A good example is to skip touch entirely and use voice to control things.

4. In UX research, we found that people’s levels of comprehension of things like story and character in VR were very poor, probably due to information overload and not knowing where to look for cues. Movies solve this by leading the horse to the water, so to speak, with expert cinematography and more. So the chances of a subtle cinematic narrative are slim until we develop those muscles in VR over many years.

Think more “TV Soap Opera” than “Gosford Park.” And in terms of Presence, think more “Saving Private Ryan” than “The Man from Earth.”

5. Movies are an inherently social experience, esp. going to the theater (which we said isn’t helped by VR). Perfect, you say, because Face/Rift is a social network. Actually, FB today is more a social experience of last resort. It is most social when you don’t have a better way to interact. Just imagine a group of six friends hanging out, noses down, all browsing FB on their so-called smartphones. I know it happens a lot, and they certainly think they’re being social, but who believes it? It’s at its best when it’s connecting people who won’t otherwise see each other.

6. VR movies will initially be more of solo experience that we can talk about and retroactively construct the social element, like talking about the latest episode of “Lost” or “Game of Thrones” the next day. We can feel like we watched them together for some “social backfill.” I’m guessing that the more presence we feel in the VR experience, the harder it is to later backfill in those missing friends, but the more we’ll want to try, leading to more of the feeling that we’re losing real human connections by going so virtual. Prediction.

7. Someone will therefore add avatars to these immersive VR movies to solve this. Good thinking. If captured with high fidelity, this will be a little closer to the quality of being together in person, and there’s always the cool new immersive milieu to explore together.

But here’s the dilemma. If your movie is interactive, you have to solve the holy grail of immersive interactive 3D storytelling, which the fictional Holodeck didn’t even get right. Tony and Tina’s wedding (the interactive play) is probably our best model, but that’s all about the actors making it work.

If your movie is not so interactive but you still add friends and family to the scene, the greater degree of presence ironically makes it more awkward to see them unless they’re transformed into the story, a stark reminder that you’re not actually there. It’d be good for Jurassic time travel, but not so great for Star Wars, where seeing my mother standing next to Darth Vader would change the experience a bit.

Not surprisingly, VR will likely work better for participants who are more physically remote than in the same room — exactly like FB does today. It adds to social interactions where distance makes it harder, but caps it where real proximity would make it easier. It’s no wonder FB likes this view of the future.

For Hollywood, it’s about the business of monetizing attention on one level, and the art of storytelling on another. On second thought, maybe they’re not that different after all.

No Comments

Why I Re-joined Amazon

I just got outed on Techcrunch. So I’ll come clean. :)

I’ve recently (April 2014) rejoined Amazon as a manager and developer on the Prime Air team.

We’ve set up a new team in downtown SF to focus on some interesting aspects of the project. We’re growing rapidly. If you’re interested in the project and love the Bay Area, feel free to reach out or apply directly via the Amazon website (here or here)

So why did I re-join Amazon?

The simplest answer is that I really admire this team, this project, and this company. I’m not one to gush or blush — if anything I excel at finding fault. But this job is really fun. We have trained professionals who love to do the stuff I don’t.

The project doesn’t need any more hype from me. JeffB already talked about it on 60 minutes. You may have heard me talk about various superpowers in another context… This is a similar level of game-changer IMO.

Speaking personally, this project meets a number of important requirements for me:

First, it needs to be fairly green-field. I did early AR/VR in the 90s. We built an entire Earth in 2000. I worked on massive multiplayer worlds and avatars after that. I moved onto robotic parachutes in 2004, designed geo-social-mobile apps in 2008, then telepresence and more stuff I can’t talk about after that.

I like to learn fast, often by making mistakes, with a whole lot of guessing and path-finding until the way is clear. By the time 100,000 people are working on something, there are up to 100,000 people who are potentially way smarter than me, plus ample documentation on the right and wrong ways to do anything.

Second, I want to work on projects that use new technology in the most positive ways, sometimes as an antidote to the other negative ones out there. I’ve left companies on that principle alone…

I’ve both given and received some criticism over this – even been called a “hippie.” But I didn’t inhale that sort of sentiment. I just moved on. At the end of the day, I always try to do the right thing and help people wherever I can.

That’s based on what I like to think of as “principles.” Many of the reasons I like Amazon as a company are due to its principles.

At Amazon, I saw these principles come up almost every day on the job and I was suitably impressed. Naturally, they’re used as a kind of lens for job candidates, esp. as a way to efficiently discuss their leadership skills. But these concepts are used and reinforced almost daily for things like professional feedback and taking responsibility, above and beyond our job specs.

I’ve seen senior leaders uphold the “vocally self critical” principle in meetings, where at other companies such behavior might be called a “career-limiting” move. This principle alone meant that even in my earliest interviews, I could be blunt about learning from my past mistakes without worrying if I should say things like “my biggest fault is that I work too hard.” What a relief.

The first Amazon value on the list is, of course, “customer obsession.” There’s no other value that rises above this, not expedience or profit. And in my opinion it shows.

Companies that stick to their principles tend to be consistent and well-trusted. Having clear and understandable principles, reinforcing them and even working through when they seem to be in internal conflict leads to making better decisions overall and avoiding really bad ones.

That’s especially true when you don’t have the luxury of seeing the full repercussions of your choices in advance. These principles are there for when the choices are hard or unclear, not just when they’re easy.

I believe that companies that get this, and especially those that put their customers first, are the ones that will succeed.

 

BTW, there’s still some perception out there that “the FAA nixed Prime Air.” Here are a few articles that addressed that question directly.

3 Comments

The LEGO Movie

I have to admit, even with 25+ years experience with computer graphics, on first viewing I thought The Lego Movie was mostly done with stop action photography.

I figured maybe 80% physical and 20% virtual. Turns out it was closer to 99% CGI with some real legos thrown in for good measure. Other than the live action scenes, I couldn’t tell you where the real legos sat.

There were some things, like the water, explosions and more, that looked way too procedural to be done by hand. But still the rendering, shading and animation were so close to perfect, so physically correct down to sub-surface scattering and extreme depth of field, that it was almost impossible to tell.

Amazing job. And especially impressive given how well they could tell the story without relying on the usual tricks of animation and CG, staying true to only what real legos can do.

The real tip-off about the CGI was in the lighting, which allowed for certain legos to emit light or light to come from no actual source. That would be pretty hard to do in reality without a really complex effects pipeline on top.

Here’s a longer video that explains how it was done:

via: fxguidetv #186: The LEGO Movie | fxguide.

No Comments

World Under Water

This is a brilliant idea and  striking demonstration of the effects of rising sea levels.

World Under Water.

It has only one small problem. It doesn’t take altitude into account. It shows the same nicely rendered water level no matter where you go.

I don’t think it would be hard to do a lookup of the altitude of any address and move the water level up or down. But given the very rough depth map from Street View and the apparent lack of an “up” vector, it might be hard to properly intersect the water with the scene.

 

Here’s a more accurate example, without the nice immersive visuals: http://geology.com/sea-level-rise/

Still better than trying to depict a 1000ft water level near the top of the Oakland Hills. If that happens, we’d be long gone.

No Comments

Why I donated to MayOne.us

If Money equals Speech, as the Supreme Court believes, then Money trumps Votes, in terms of sheer influence and power.

Except… there are more of us that can vote with our wallets than all the vested moneyed interests can muster.

First, we have to be united to combat money in politics. That means us collectively spending enough to turn the ship.

It doesn’t matter what you believe in, left or right. If you ever want it to count, then make yourself count here.

No Comments

See-through Tank

For at least 20 years, I’ve been telling this to anyone who might conceivably take this idea and run with it as a business. Form a real-time sphere (or cubemap) of video around an airplane using an array of cameras. Give anyone who wants one a VR HMD and index their chosen POV into said sphere of video. Viola. Invisible airplane, at least to those wearing the HMDs. It would be a much better way to pass several hours in flight than watching movies IMO.

Anyway, alas, if I want to do this today, I’d need to drive a tank. Tak, Norway.

Norway’s VR test helps soldiers see through armored vehicles.

 

2 Comments

Verizon is either very dumb or they think you are

[as always, my personal technical opinions here]

Verizon Wireless sells out customers with creepy new tactic – latimes.com.

The LA Times author laments helplessly for most of the linked article. First, he claims Verizon is more evil than Google or Yahoo (who also effectively sell your data) because Verizon charges more up front. Well, I do agree companies that make money off our personal data should give us a cut or a discount, assuming we opt-in at all. It’s our data, right?

But the issue isn’t how badly Verizon is ripping us off relative to other companies. That’s a whole other box of lame.

Here the author gets closer:

Customers may be hard-pressed to understand fully what’s going on with the “enhanced” program. The Verizon Wireless notice is decidedly short on details.

Again, none of the companies listed in this post do a good job of “informed consent” IMO. If what Verizon is doing is not so bad, then people should be able to come to that conclusion given the honest facts, explained in terms they can understand, and then agree.

Were you aware of this? Probably not. Did you agree? Probably not.

But it gets better:

Debra Lewis, a Verizon Wireless spokeswoman, explained to me that when a customer registers on the company’s “My Verizon” website to see a bill or watch TV online, a “cookie,” or tracking software, is downloaded onto the customer’s home computer.

Most cookies are benign, allowing websites to provide better service to frequent visitors.

Verizon Wireless’ cookie allows a data-collection company working on Verizon’s behalf — Lewis declined to name which one — to gather information on which sites you visit after you leave “My Verizon.”

Hint: it could be any of these trackers, found by visiting the offending site with Ghostery installed.

  • Acxiom
  • Adobe Test & Target
  • Bazaarvoice
  • BlueKai
  • DoubleClick Floodlight
  • ForeSee
  • Gomez
  • Monetate
  • Omniture (Adobe Analytics)

You may want to install Ghostery and start blocking almost everything like this. These trackers do you no good, and you can put the few exceptions you need in the settings. You will be surprised to see how many tracking turds are quietly slipped into your pocket. The worst part is, if I go to Verizon’s site to find out how to opt out of this bullshit, I apparently get tracked for it…

Here’s the actual opt-out information, btw. FWIW, I collected the above list of trackers after ensuring I was opted out on the site. I guess they promise, on behalf of these random third party trackers, the data won’t be shared…

Sure.

But it gets even crazier:

That information is “anonymized,” Lewis said, to mask the Verizon customer’s identity and is then shared with marketers, which can use the info to provide ads on the customer’s Verizon Wireless device that match his or her home-computer interests.

What makes this all potentially class-action-worthy IMO (IANAL) is that Verizon claims that by simply replacing your name with a unique ID, the service is anonymous and therefore safe.

“In addition to the customer information that’s currently part of the program, we will soon use an anonymous, unique identifier we create when you register on our websites.”

Does anyone else remember when AOL put their carefully anonymized search logs out on the internet…

It took almost no time for someone to figure out a lot of who was who despite the obfuscation, because the same “anonymous” IDs were used for each search by the same person, over and over, and could therefore be accumulated and cross-referenced. Simple deduction, Watson.

How hard will it be for a 3rd party marketer, given a list of your most frequent locations and your “double secret anonymous” ID, to look up the address of said frequent locations, and a few ownership records of your most frequent location (where you spend roughly half your life) and forever associate your real name and secret ID?

When combined with other websites that you may sign into, how hard would it be to discover your other usernames, some already tied to your real name, and tie them all together into a single linked identity and activity file you never get to see?

Not at all. It’s already common.

There is an actual body of research behind anonymizing people and GPS coordinates that Verizon seems to be [negligently, IMO] ignoring. There are viable techniques to present targeted ads (based only on what Verizon knows about you) without leaking that data to any third party.

Any claims of effective anonymity after sharing this kind of data with third parties are IMO false and misleading. They’re counting on everyone being dumb. Don’t be.

 

No Comments

Scoble Tempers Glass

Scoble’s love affair for Google Glass could apparently only last so long. This underscores some of the problems with developing a product out in public, or at least half-way out. Long-lead technical challenges (battery, size, cost) are still hidden below the core design and marketing issues (utility, fashion, desire).

Google at least did a good job of starting the conversation, even if they haven’t yet figured out how to finish it.

Robert Scoble – Last night before Skrillex at Coachella….

Down in the comments, he elaborates on why he doesn’t like them any more and what he thinks Google did wrong:

1. They launched it with WAY too much fanfare that the product simply can’t live up to. Jumping out of a blimp and doing live video on the way down (along with a ton of really well produced videos that promised it would be a great assistant as you walked around) set expectations VERY high and the product hasn’t gotten to that fit and finish yet, even two years later. The product, for instance, still doesn’t do live video (at least not by itself).

2. The team started out very public, with very nice collaborative team members. Then they turned secretive and can’t tell us what’s coming. It’s almost like someone told the team “turn Apple.” That secrecy made developers and influencers feel like they were no longer part of the process of developing this into a real product, which it still is not.

3. Because it was launched at a developer conference (Google IO) expectations were set that this would be mostly for developers, and that a great API would come soon. The API did come, but 18 months later. There still is no real store. The UI is way too simplistic to handle dozens or hundreds of apps. Google refused to answer questions about sensors at the next Google IO.

4. Two years ago the price was announced as $1,500. Today the price is still $1,500. How many tech products stay the same price for two years? Not many. The pricing is now at the point where it seems just wrong. The team even admits it’s artificially high to ensure “only people who really want one get one.” That creates weird distortions in belief about the product too.

5. When people got theirs a year ago we expected a ton of REAL updates to both UI and functionality. The updates we’ve gotten just haven’t met expectations. Compare my drone, which lets me take a photo, see it on my iPhone, AND post it to Facebook and Instagram WHILE IT IS FLYING to Glass. I still can’t post photos to Facebook or Instagram without plugging the Glass in and putting them elsewhere (er, Google+) first. 

6. We expected new designs by now and updated electronics. I’m holding out hope that we’ll see a much better design (battery life sucks, it cuts my ears, it is starting to look quite dated, video is poorly compressed, etc etc) by now.

When I say this was launched poorly Google set way too many expectations on this product and it has failed to meet them. It should have launched much quieter and set expectations that it was only for vertical markets. Then as those showed up, they could have expanded expectations. If Google had done that then the early adopters could have said “hey, these are designed for use in very specific places, like surgery rooms.” That would have kept people from freaking out.

The other thing that sucks is that many of the explorer program members I’ve talked with are tired of being asked to demonstrate them. Google is getting US to pay to test, provide PR, AND demonstrate them to the public. THAT is NOT empathetic at all and is actually quite arrogant on Google’s behalf (a company that makes billions of dollars every year).

It’s not shocking to me that most Google employees I know that have them aren’t wearing them around anymore and that many in the community are grumbling behind the scenes (most won’t write about their concerns because they need to have good relationships with Google).

No Comments