Experimental Compositing Techniques

Only Post Amazing Reels and Commercials

Experimental Compositing Techniques

Postby Ixus_Maig on 11/13/2011, 10:41 pm

This looks very promising. Could be the next acquisition for Adobe to integrate into After effects. Just a thought.

Read the paper by Kevin Karsch, Varsha Hedau, David Forsyth, & Derek Hoiem at http://kevinkarsch.com/publications/sa11-lowres.pdf.
Ixus_Maig
 
Posts: 109
Joined: 08/28/2008, 7:11 pm
Location: Earth

Re: Experimental Compositing Techniques

Postby bigdanny123 on 11/13/2011, 11:23 pm

Looks interesting, I doubt adobe would have anything to do with it, this is for 3D packages. Adobe doesn't have an application that can create and render 3D models yet so this isn't going to happen for them for a looong time.
bigdanny123
 
Posts: 102
Joined: 07/20/2010, 6:08 pm
Location: Scunthorpe, UK
System Specs: N,MVBJG FTGJ FG T TF FT FYT YH

Re: Experimental Compositing Techniques

Postby tony on 11/14/2011, 12:24 am

This looks exactly like that 3D tracking video that came out a while ago, same text same titles and similar narrative style. That 3D tracking thing later became warp stabilizer!

So adobe can def pick this up :)
I make pixels twerk.
http://www.AntonioRodriguez.co
tony
 
Posts: 3372
Joined: 09/1/2008, 12:36 am

Re: Experimental Compositing Techniques

Postby Ixus_Maig on 11/14/2011, 8:02 pm

@tony: that was my thought as well. I know it is dealing with 3D stuff, but the techniques they are using could be adapted to work somehow with After Effects.
Ixus_Maig
 
Posts: 109
Joined: 08/28/2008, 7:11 pm
Location: Earth

Re: Experimental Compositing Techniques

Postby tony on 11/14/2011, 8:26 pm

Ixus_Maig wrote:@tony: that was my thought as well. I know it is dealing with 3D stuff, but the techniques they are using could be adapted to work somehow with After Effects.


Oh absolutely, this is not for a 3D program. 3D programs have: GI, ambient occlusion, and real physical lights and stuff like that. They don't need this. AE on the the other hand can definitively use this. In fact VCP up coming plug-in Element could make use of this technology also.
I make pixels twerk.
http://www.AntonioRodriguez.co
tony
 
Posts: 3372
Joined: 09/1/2008, 12:36 am

Re: Experimental Compositing Techniques

Postby tony on 11/14/2011, 8:30 pm

My first idea of easy integration in to a composting program, could be a light warp application.

You take your green-screened footage, you drop a picture in the background you dictate where the light sources are, the program can generate a bump map based of the green-screened footage and lightly apply highlights and shadows around the keyed footage, perhaps generate light-rays and things of the sort.

A bigger application could be to bring in 3D geometry and re-light it quickly
I make pixels twerk.
http://www.AntonioRodriguez.co
tony
 
Posts: 3372
Joined: 09/1/2008, 12:36 am

Experimental Compositing Techniques

Postby Ixus_Maig on 11/14/2011, 9:41 pm

A similar idea to the lighting plugin (http://www.videocopilot.net/tutorials/scene_re-lighting/) which uses normal map for pre-rendered 3D images, but a more robust and realistic approach. I can see a lot of potential. Can't wait to see where it goes. After Effects or not, whatever this becomes or whatever application integrates this will be that much more versatile.
Ixus_Maig
 
Posts: 109
Joined: 08/28/2008, 7:11 pm
Location: Earth

Re: Experimental Compositing Techniques

Postby Faust on 10/26/2014, 2:44 pm

I usually don't like to revive dead threads (though I've done it several times by accident in the past), but I thought this was really fun and very relevant. If you watched any of the demonstrations from this year's Adobe MAX conference, you may have seen this already. If not, check it out:



It's cool finding these little things years before they are widely known. Just like the stabilization demo that tony mentioned. Here we are three years later and, just as predicted by you guys, Adobe has found a way to use it!

Now we can also all be hipsters and say "I knew about this automatic 3D scene reconstruction tool before it was cool." ;)
I have dual citizenship with the United States and Florida.


http://chariotdrive.com/
Faust
 
Posts: 1845
Joined: 07/29/2009, 12:56 pm
Location: Los Angeles CA
Twitter: https://twitter.com/Zeke_Faust
System Specs: Intel Core i9-7980X
GIGABYTE X299 DESIGNARE EX
Samsung 960 PRO Series 512GB OS + 2TB cache
128GB DDR4 3000
2 x TitanXp GPU

Re: Experimental Compositing Techniques

Postby Farmfield on 10/27/2014, 2:35 am

Faust wrote:Now we can also all be hipsters and say "I knew about this automatic 3D scene reconstruction tool before it was cool." ;)

I remember this one and cool follow up video too. Absolutely something that would be immensly helpful in compositing.

Here's another tech demo from last year that totally blew my mind. If this one doesn't make you go "W H A T ? ?", I don't know what's wrong with you... :D

*** Demos, RnD & tests: www.vimeo.com/farmfield ***
Farmfield
 
Posts: 2285
Joined: 06/8/2014, 1:44 pm
Location: Sweden

Re: Experimental Compositing Techniques

Postby anel_77 on 10/27/2014, 9:19 am

Farmfield wrote:
Faust wrote:Now we can also all be hipsters and say "I knew about this automatic 3D scene reconstruction tool before it was cool." ;)

I remember this one and cool follow up video too. Absolutely something that would be immensly helpful in compositing.

Here's another tech demo from last year that totally blew my mind. If this one doesn't make you go "W H A T ? ?", I don't know what's wrong with you... :D



Woow that video is amazing! Is this technology downloadable or usable?
anel_77
 
Posts: 140
Joined: 02/7/2011, 4:59 am

Re: Experimental Compositing Techniques

Postby Farmfield on 10/27/2014, 7:25 pm

anel_77 wrote:
Farmfield wrote:
Faust wrote:Now we can also all be hipsters and say "I knew about this automatic 3D scene reconstruction tool before it was cool." ;)

I remember this one and cool follow up video too. Absolutely something that would be immensly helpful in compositing.

Here's another tech demo from last year that totally blew my mind. If this one doesn't make you go "W H A T ? ?", I don't know what's wrong with you... :D



Woow that video is amazing! Is this technology downloadable or usable?

Noops. Like all this type of tech, this crap is seriously valuable, thus it usually gets sucked up into military or industrial applications or into the in-house tools on some VFX bureau...
*** Demos, RnD & tests: www.vimeo.com/farmfield ***
Farmfield
 
Posts: 2285
Joined: 06/8/2014, 1:44 pm
Location: Sweden

Re: Experimental Compositing Techniques

Postby Faust on 10/27/2014, 7:35 pm

I think you can actually go on the RSOLP site and try out the reconstruction for yourself. Unless they removed it, that is.
I have dual citizenship with the United States and Florida.


http://chariotdrive.com/
Faust
 
Posts: 1845
Joined: 07/29/2009, 12:56 pm
Location: Los Angeles CA
Twitter: https://twitter.com/Zeke_Faust
System Specs: Intel Core i9-7980X
GIGABYTE X299 DESIGNARE EX
Samsung 960 PRO Series 512GB OS + 2TB cache
128GB DDR4 3000
2 x TitanXp GPU

Re: Experimental Compositing Techniques

Postby Farmfield on 10/27/2014, 7:50 pm

Faust wrote:I think you can actually go on the RSOLP site and try out the reconstruction for yourself. Unless they removed it, that is.

Oh, the lighting probe stuff from Kevin Harsch is available, I think he meant the 3D extraction software.
*** Demos, RnD & tests: www.vimeo.com/farmfield ***
Farmfield
 
Posts: 2285
Joined: 06/8/2014, 1:44 pm
Location: Sweden

Re: Experimental Compositing Techniques

Postby anel_77 on 10/28/2014, 1:37 am

Both Both i was wondering if you could download them and try them. Imagine having that technology in AE. That would be amazing!
anel_77
 
Posts: 140
Joined: 02/7/2011, 4:59 am

Re: Experimental Compositing Techniques

Postby Farmfield on 10/28/2014, 10:12 am

anel_77 wrote:Both Both i was wondering if you could download them and try them. Imagine having that technology in AE. That would be amazing!

As I said, software with shape predictive abilities are likely to end up in the nosecone of a Tomahawk missile than After Effects, sadly - though I might be wrong, of course. About the automated light probe extraction thingie, that would be very cool to have implemented in a plugin for any compositing app... Just imagine having Element 3D calculate the illumination/environment map automatically from and or all layers of the current comp, what an amazing feature that would be. :)
*** Demos, RnD & tests: www.vimeo.com/farmfield ***
Farmfield
 
Posts: 2285
Joined: 06/8/2014, 1:44 pm
Location: Sweden


Return to Inspirational Stuff