Entries Tagged as 'News'

Towards Better 3D Image Capture

Focus images instantly with Adobe’s computational photography

Now here’s a camera I’d love to buy. It’s certainly not the first in the field of computational photography. But it’s nice to see companies start supporting this at the application level too.

Now, there are lots of ways to get 3D images via digital photography. You can shoot lasers or IR signals out from your camera to measure distance per pixel based on return trip time. You can take stereo pairs and infer depth. But this method goes much farther — it takes many similar pictures from slightly different angles and can compute the whole field of images from any point nearby.

In other words, it’s as close to real-time digital holography as we current can get. And the result is a photograph that not only knows the distance to each pixel, but can also tilt the image in 3D to see around objects, as well as modify the focal plane across the image.

And when companies start using cameras like these and computational photography techniques to compute novel viewing positions (i.e., positions that might sit between or outside of actual sample), we’ll have a truly 3D photographic world to explore.

Google + Multiverse Announcement: Analysis

Google tools to power virtual worlds | CNET News.com

The announcement is straightforward. Google Geo (Maps + Earth) has given Multiverse Networks an easy path to exporting 3D content, models, terrain, imagery (I imagine) into the Multiverse framework. So there’s now apparently a button to extract a small section of the Earth.

What’s great about this is that there’s now a button to extract a small section of the Earth. Before this, one could use the OpenGLExtractor to grab whatever 3D geometry was in view. But doing so would probably violate the terms of use of Google Earth. And it would really grab everything as you see it, which would mean viewing the same content in another app from any other POV would have the hi-res detail left in the wrong place.

What was notably absent from the article, and we’ll see if the official announcement has more details, is any mention of licensing the GE rendering/streaming engine. That’s significant, because without that engine (or something equivalent), you can’t handle more than a small area of the Earth. Small areas are all the article talks about, so I’m not expecting any bigger news just yet.

Here’s the technical aside: level of detail management is critical to being able to handle more than a small swath of land. Without it, your graphics card would be quickly overwhelmed with the sheer amount of data it has to draw for no real benefit (see How Google Earth Works for more, at least w.r.t. imagery). The other technical note is that one of the reasons Google Earth would have trouble being a metaverse, allowing you to walk around at ground level, is that doing so requires some heavy duty "occlusion culling," meaning the software has to effectively remove everything that’s hidden from view (e.g., behind something else, e.g., behind a wall when you’re inside a room) or else your graphics card would be quickly overwhelmed with the sheer amount of data it has to draw for no real benefit.

Do you see a common thread there? Rendering fully-detailed planets with the ability to go anywhere  and also go inside buildings is considered a hard problem in 3D engine design. Do not try this at home.

Anyway, the biggest beneficiaries of this announcement will not be what you expect. The biggest winners will be the 3D real estate companies who so far have had a hard time pushing their 3D walkthroughs into Google Earth due to some of the above constraints, not to mention that GE has no concept of walking on a floor, which makes a two story house kind of hard to navigate.

These companies will now flock to Multiverse’s free development system (they get their money on the back end, as do real estate companies — see the synergy?) to enable 3D walkthroughs of their real-estate with some added Google Earth content. It’s still not quite as good as doing a real walkthrough in GE, which has over 250 million downloads and can show you important things like school districts and supermarkets. But this will be better for at least one aspect of the real estate sell, plus it adds the ability to offer better interactive content via scripting, which GE lacks. The only downside is the state of the real estate market.

What I’m really waiting for is the announcement of the first 3D game or world that actually licenses GE’s engine, or at least key parts of it, for a new flavor of EarthViewer that’s not strictly limited to the real world. John Hanke has in the past said it’s on the table, though I have no idea what the licensing terms would be.

Virtual Earth, on the other hand, seems more geared towards embedding VE’s world in other people’s products, even going so far as to offer a free API. This welcome announcement may be a sign that Google Earth is finally opening up to more mashups than we can possibly imagine.

Real 3D DVDs on Your Current Home TV?

IT Broadcast and Digital Cinema: TRIDIX Brings 3-D to DVDs (via VRoot.org)

TRIDIX claims to offer a solution to taking a 3D movie (not necessarily an older movie that might have 3D added as an afterthought), encoding it onto a DVD, and playing it on your standard CRT, LCD, plasma, or other monitor or TV. They do this with cheap disposable glasses that come with the DVD.

So how can they possibly pull this off? Well, there’s a modern twist on those red/green cellophane glasses we remember from the old crop of 3D movies. The reason that old trick works is that the red and green color channels are separable — you can create a single pixel with independent red and green intensity values, rendered simultaneously with one projector, and use the red/green filters over your eyes to separate the two bits of information out for each eye to see a slightly different picture. The problem, of course, is that one eye is seeing only red+blue and the other is seeing only green+blue, and that’s disconcerting, especially if either eye is visually dominant.

The modern trick says, lets use more sophisticated color filters such that we still give each eye an independent color, but let’s split up the color spectrum more evenly. Imagine the red and green channels are divided into 10 zones, with each eye’s filter doing the even or odd sections. The result, with some required pre-filtering of the images to offset the resulting errors, is stereo viewing with much better color rendition to each eye, better combination of both in 3D, and no gaps or flicker, like you’d get with active stereo methods (which use spatial or temporal multiplexing for half the resolution in space or time). The color method is essentially multiplexing in color-space, which should be less noticeable. (here’s a powerpoint presentation that explains Infitec passive and active if you want to understand it better.)

The problem is, until now, this method of complex color combination using passive (cheap, simple, non-flickering) glasses has required two projectors shining on a single screen, which obviously wouldn’t work on your old TV. It’ll be interesting to see how TRIDX can encode a single pixel with enough information to supply two different full RGB colors to each eye.

 

Microsoft’s Virtual World?

Virtual Worlds Conference and Expo - October 10-11, 2007 - San Jose Convention Center

I’ve been waiting for the big Microsoft Virtual World announcement — you know the one to compete with Sony’s Home and possibly Second Life – for a while now. I’m somewhat surprised by the venue, but it looks like it might just come next week at the Virtual Worlds conference.

[Read more →]

The Word on Snow Crash and Google Earth

If you read RealityPrime, you probably already have a good idea of the actual connection between Snow Crash and Google Earth. But if you read any of the other blog entries about the intriguing Arizona State University beta test without also coming here, you might have been lead astray on at least one key point.

So I’d like to be as clear as possible about the role Snow Crash played for Google Earth. I’ve also modified the old post on my personal blog to reflect this added clarity for anyone who wanders by.

[Read more →]

A Social Network for Google Earth?

(via A Social Network for Google Earth? · GoogleSystem Blog)

Arizona State University students (well, at least one) have received a web questionnaire that strongly hints at a new Google social network using avatars, modeling, and so on. It’s called "My World" and also hints at something large-scale, as in the oft-rumored Google Earth / Second Life hybrid.

Arizona State University has a very close relation with Google: it’s one of the first large universities in the US that uses Google Apps, the site search is powered by Google Search Appliance, the university uses Google Maps and the ASU campuses already have 3D models in… Google Earth. But there’s actually more than this: the university offered photos for the Google Mars project, Google employees serve as guest speakers or adjunct lecturers at ASU and Google has an office on the Tempe campus of Arizona State University.

As always, I don’t know Google’s plans — my former colleagues from Keyhole are not returning my emails lately (possibly because I blog stuff like this*), which has effectively put the kabosh on my "How Google Earth Works" series for now… But I do know that their CTO has publicly stated that Google Earth will remain true to the real world. In other words, it won’t turn into Second Life with new islands, fictional fantastic places, furries, and so on.

He didn’t rule out avatars at some level, and I do think they’re likely at some point — specifically, when GE offers the ability to walk down the street and enter virtual stores. Once you can do that, it makes sense to be able to do that with friends, or just meet on a street corner in virtual Paris and go sightseeing. Street View is a step in that direction. The same data could be used to make 3D models at street level. And there’s an effort paying people to digitize the insides of stores in major cities, at least in 2D. I’d give it two years or less for the technology issues to be worked out and for this to be possible.

However, I still don’t expect that to be a full-blown social network. The next generation of 3D social networks will have the concept of your "home" in the virtual world in the same way that MySpace offers you a home on the web (or at least a bedroom, messy as it may be). You need some kind of anchor point to tie all of your social links together and form a big social space (a graph without nodes is just a bunch of lines). And making a virtual home for yourself is most likely to be a highly creative (read: fictional) activity, not in GE’s main mission to represent the real world.

That’s not to say a "Social GE" is a bad idea, even without the element of role-play and fiction. Imagine the world’s biggest spatial matchmaking service, linked to cell phones and personal profiles (interests, etc..), and you can see at least one 3D social application that’s more or less grounded in the real world. That’s possible, even likely to come from Google or others. But that’s not really what this questionnaire is hinting at.

There were rumors of a number of distinct teams at Google, all working in or near this space. And the wording of the questionnaire, and the target audience, indicates something much more creatively and socially focused, like a 3D MySpace, that pretty much everyone (except maybe MySpace itself) is trying to build this year. This could easily be a ground up effort. Or there could be a new version of the old GE technology that’s rigged for a separate, purely fictional world — a new world, its users get to define. That would fit with the theme of Google Earth, Mars, Moon, and Sky. It’s just one more set of data to visualize (sort of, see below).

Imagine it more concretely: repurpose the GE sidebar for social networking functions, "friendmarks" instead of (or adding to) placemarks, "stuff to do" instead of (or adding to) layers to view. And then let people populate and build this new fictional world however they wish, using SketchUp as the main modeling tool.

I’ve talked before about the issues, mashing up Google Earth and Second Life conceptually, so I won’t repeat all of that here. To sum it up, Second Life would need literally billions of simulators (or a new approach) to cover the area of the real earth. Google Earth would need to support much more dynamic content than it currently does, and deal with the inevitable fictionalization of the world. There’s also the real danger of a million avatars crowding into a virtual Times Square, sending your PC into neverland (even NYC slows down my PC with 3D buildings alone). Plus, letting people build in SketchUp and import into a world is generally fine for adding 3D buildings. But when it comes to inhabiting your virtual living room with your custom avatar, you really want simple in-world editing tools that let you move your couch an inch to the left. They’re not quite there yet, nor does it really fit with the GE user interface as it is currently defined.

And while it would be very interesting to see the GE platform turn into a more generalized 2D/3D content editor and browser (that was something I strongly pushed for, way back when, and John was always keen to pull in full HTML rendering in one way or another), it’s not quite ready to replace your old browser just yet. Someday, maybe. And if any application has the potential to stealthily come in and become your browser of choice for Web 3D, that’s what I’d pick as a starting point.

For this ASU student beta, I’m leaning towards something web-based, 3D in the [current] browser, using Flash or Java with a significant portion in 2D. And the reason is simple: social interactions happen at the scale of people, not planets; living rooms and coffee shops, not continents. While it’s cool to imagine an earth-sized virtual world, capable of pulling in 10 billion people, it’s not yet necessary to make one that big. We’re still at the "city" scale of social virtual worlds — and if you’ve ever lived in New York, that may be plenty big enough to keep people busy solving technical and usability problems.

However, with 100 250 million downloads, I don’t underestimate the Google Earth team or ever rule them out.

 

________

* for the record, I don’t even ask Google employees about Google’s internal projects. All my speculation is based on my own experience in the field, public tidbits, and industry veterans I’ve talked to outside of Google. In fact, my friends know the best way to get me to not blog about their project is to tell me all about it. It effectively ties my hands until they announce.

Dr. Randy Pausch’s Last Lesson

CMU professor gives his last lesson on life

 

That’s just a highlights video.

Here’s a link to the the complete media stream from the event (about 1hr, plus).

I’m posting this on the professional site because Randy has made some great contributions to the field of virtual reality, science, and education — and everyone should know about it.

I’m also posting it because I know Randy. I worked with him when I was at Disney. And I can attest that he’s not putting on a show or brave face. That’s exactly how he is in person: positive, smart, and genuine.

He doesn’t want pity or sadness. He’s achieved his childhood dreams. So I’m not sad for him, but for his family, friends, and, in fact, the rest of the world, who will miss him, whether they all know it or not.

More on Google, Security, and Michael Gianaris

If you’ve read my other blog, you saw that I’d commented on a local (to me) NY state assemblyman’s efforts to urge Google to censor sensitive sites. I’d also emailed him a few weeks prior to that post, and perhaps thanks to some wider coverage, I’ve finally gotten a response — an email (printed below), which I followed up with a phone call* to further discuss the issues and confirm that he doesn’t mind my publishing his email.
[Read more →]

Major Website Changes

I have now converted RealityPrime to a blog format to make it easier to post articles and receive comments.

It remains a work-related site, so I’ve brought over only those posts from BrownianEmotion that have some bearing on technology and specifically VR and 3D (though not exclusively).

Politics and other topics will remain on the personal blog at www.brownianemotion.org. I’ll work to ensure that this feed remains strictly centered on work-related issues. So feel free to syndicate.

Skyline patent infringement suit against Google Earth dismissed

Ogle Earth: Skyline patent infringement suit agains Google Earth dismissed s , direct AP story link

Stefan scooped me on catching this. I thought I had a news alert set up…

Anyway, this is very good news, not just for Google, but for any game developers out there who want to stream 3D content over a network. The patent is just too broad, IMO. I’d prefer if it was invalidated completely, but this is good enough for now.