Photosynth + Second Life yields beautiful but awkward results

2008-08-27

I was impressed by the earlier Photosynth demos, which showed how 100s, even 1,000s of 2D pictures could be mapped for 3D navigation, with the process of doing so resembling wandering through an electronic dream: shards of imagery appearing all around, points of light denoting matches between pictures.

After Chaos Mohr let me know about his experiment following Photosynth's public unveiling, I gave it a go for myself with the same pictures used for the Here panorama. Alas, results are mixed: as you can see from the grid view above, it didn't recognize 15 images out of a set of 50, and thus, only 35 are part of a cohesive, 3D set. That's awkward and annoying, considering my panoramic software stitched those together just fine.

But the future does hold promise, particularly for showing slices (literally) of Second Life to those who aren't yet Residents and want to get more of a spatial sense of what's happening. Current Second Life "synths" are sparse, but there'll be more to come — of particular fun is MaimedLeech's "Beholder", which has an impressive vantage of a D&D-like monster with a bent-backwards damsel in its jaws.

He took enough photos, so that if you get up close to the beast, a circular ring appears you can drag around to get the 360-degree experience.

Perhaps that's what I should do next: take photos all around a subject, or take snapshots on a walkthrough, as if I were a tourist — maybe that's better suited for this tool than a "conventional" panorama.

Inevitable: I'm already seeing some spammers on Photosynth (search obvious keywords and ye shall find). It's dubious what valuable imagery they'll be adding, it's both a celebration and deploration of the technology.

Historical credz must go to Kri Ayakashi, who gave the Second Life + Photosynth notion a nod over a year ago:

what if you would take all those screen shots taken in Second Life and run them through Photosynth.

We know now! Have you synthed?

{ 11 comments… read them below or add one }

thaumata 2008-08-27 at 12:48 PM UTC

I was reading about this on um… tech crunch? /. ? wired? Brain is fried. But I remember thinking it looked cool and wondering if it'd work with any of the panoramics I've been taking. I have tons of them and would love to do it, but they don't support OSX, unsurprisingly.

Nanci Barthelmess 2008-08-27 at 12:55 PM UTC

"Photosynth does not support this OS."

That's what Linux users can get. I hope Mac users get something better. Honestly it's one more way I see Microsoft trying to clock down as much of the web as they can. (see also Silverlight, another Microsoft technology that can't be used by Linux users. Yet.)

Bamboo Zimring 2008-08-27 at 12:58 PM UTC

I know this is off topic. it is about an earlier discussion, Walking and talking at the same time. i have tried using bandana like structures made for people who are diseased,armless, ect. as you may know, they are able to play games like "Invaders" and racing games purely by the power of Thought. The father of a friend of mine assists in the creation of them. I tried using it. with some practice, it can become easy. Could similar devices be made to work in Second life? not just for moving while you type, but for visa versa! is it possible? no mouse, no keyboard? just a screen? I will investigate further! sorry for the off topic comment. is there a place for general comments?

Sahoni Tigerpaw 2008-08-27 at 2:51 PM UTC

Does not support OSX… sorry Torley I couldn't see your creations :(

Brandy 2008-08-27 at 8:08 PM UTC

Note: Photosynth does not support Mac users also.

:(

Patchouli Woollahra 2008-08-27 at 10:55 PM UTC

I think part of the cause for the Here panorama failing in parts is because Second Life tends to have a lack of the texture found in RL surfaces.

It's been noted in the guide that Photosynth needs textures that are repeated across multiple photographs in order to tie them together in a synth.

This problem should lessen with more photographs taken as well as when more detailed surfaces / objects are photgraphed. Also, bear in mind that Microsoft isn't exactly a veteran in handling the creation of panoramas. This is a first version and hopefully they can find a way to detect similarities in photos more tightly before it goes gold.

Vlad Bjornson 2008-08-28 at 2:20 AM UTC

Spiffy. I couldn't resist trying my own synth thingamabob. Maybe should have started with a simpler one, tho. I fed it 340 images and it has been calculating for several hours already – and it appears to be only about 15% done. :) Oh well, maybe it'll be done when I wake up.

Photosynth is a pretty neat effect, but the interface does get in the way a bit. Lots of flashing squares and overlaid doohickeys. I like the Point view a lot (the p key). Pretty neat to see the 3D shapes created from just photos.

Amphithetre Andalso 2008-08-28 at 7:34 AM UTC

I had a nice comment writ up, but I got a database error, so I'll sum it up.

It would be interesting to see SL and Photosynth crossover!

Yakumo Fujin 2008-08-28 at 11:18 AM UTC

I did two synths, possibly I'll do even more, if I can get some new ideas…
Here the links:
http://twurl.nl/xv4hr0 <-Me, in the Straylight Sim (119 pictures, 100% synthy),
http://twurl.nl/nm3yl7 <-Me, in the Kenroku Sim (133 pictures, 98% synthy).

Vlad Bjornson 2008-08-28 at 2:43 PM UTC

Hey, my synth finally finished rendering – like 12 hours later :D Turned out pretty well. It seems kind of tough to get a smooth 360 view of an object, but maybe I can get better results with some more experimentation. Check it out if ya like:

http://photosynth.net/view.aspx?cid=3F5556D7-0EF3-489E-B24B-40A15D60042A

Torley 2008-09-03 at 8:17 AM UTC

It doth suck how Photosynth isn't more platform-friendly yet. I even saw a screenshot saying something to the effect of it not being "cool" enough for some browsers. :p

@Bamboo: There are brainwave controllers for Second Life arising! See: http://wiki.secondlife.com/wiki/Accessibility

@Patch: It still seems Photosynth is less able than panoramic software like AutoPano to recognize those textures, and I do hope for improvements to come. I think more submitted Second Life panoramas will help increase awareness. =)

@Amphithetre: Ugh, sorry about the missing comment — that might've been my Disqus woes earlier.

@Vlad: Holy moly, sounds like you have an epic. *checks it out* You achieved 100% Synthy! Looks great. I didn't know about the "p" key earlier, either.

Leave a Comment