Content-Aware Fill Sneak Peek

httpvh://www.youtube.com/watch?v=NH0aEp1oDOI
Update: The Real Uqbar has a post discussing GIMP resynthesis and how it makes this particular feature completely possible. Via Kevchenko

This is absolutely insane. In the video, Photoshop product manager Bryan O’neil Hughes walks us through a new feature they’re working on: “Content-Aware Fill Sneak Peek”. I can’t tell you how much time this would have saved me. To be honest I thought this might be an early April Fools joke (a’la Google’s hoaxes) but this appears to be legit.

Bryan doesn’t say when/if this new feature will show up in the product, but judging from it’s performance in the video I wouldn’t be surprised if it shows up in CS5 at some point (coming April 12th, 2010). Let’s just hope it works as well in the real world as it does in the lab because that’s downright incredible.

Video Link

52 Comments

  1. This is the coolest thing I have ever seen. Seriously, amazing.

  2. Jeff Tovar says:

    Unbelievable! Such a time saver, I can’t wait until this feature is available!

  3. dave tuttle says:

    holy…will adobe be able to “Content-Aware Fill” my empty wallet with cash too?!

  4. Guto says:

    WOW. Its really really seems to be fake! Unbelievable…

  5. julian k. says:

    i can only say WOW! this is a truly amazing feature and i can’t wait to test it out!

  6. Danielus says:

    This is joke, right ?

  7. Nicklas Pape says:

    This must be fake. The last example where “Content-Aware” is creating freaking mountains in the sides. I don’t think that it’s that much aware. 🙂 I guess we will see about that. I might look a bit stupid in april.

  8. That is so amazing it’s almost silly. Cant wait!

  9. Catalin says:

    The last one is soooo clearly fake. If you look at the “filled” areas, there’s stuff there that can’t possibly come from other areas of the image. No way!

  10. overshadowed says:

    I love how we’ve got to this point where we now have ‘shopped photoshop demos.

  11. Scott says:

    Not fake according to this: http://bit.ly/9MT99G
    via Kevchenko

  12. Alphonse says:

    I’m with the conspiracy theorists on this one. Having done a lot of retouching work, this seems far too good to be true. I’d love to be proven wrong though.

    Here’s hoping the rest of the programs in the suite get worthwhile upgrades too.

  13. overshadowed says:

    Thanks for clearing that up Scott! Now I can stop being a skeptic and go back to being a fan boy 🙂

  14. Okay, if that is for real, then Holy Crap! It makes me wonder what else they’re working on if that was only a “sneak peek”!

  15. Peter Ellis says:

    >Not fake according to this: http://bit.ly/9MT99G

    OK, so not only can GIMP resynthesize do the same magic trick, it also makes up the exact same freaking bit of imaginary desert to fill in the deleted road? Pull the other one. The original video’s fake, and so is the claimed resynthesize page.

  16. Vilhelm says:

    I’m also having a hard time wrapping my head around how this can be possibe. One click ‘remove road, insert desert here’. They must have perfected the ‘CSI Zoom in on crappy security cam footage and ID the bad guy filter’ if they’re already developing this kinda wizardry. It’s a very cool concept tho. If it is possible, my job is gonna get a lot easier.

    I want to believe.

  17. SZ says:

    Unbelievable! I can’t wait.

  18. rent says:

    Damn…things just got a whole lot easier.

  19. WH says:

    It’s real, your computer just has to sell its cybersoul to the devil before you can use it.

  20. Christof says:

    I don’t see anything that leads to definitively conclude that the above content-aware fill preview is a fake. Even in the zoomed out view that we have in the video, you can see that there are subtle flaws (i.e. the tool is not perfect and, in my opinion, very believable). I have to disagree with the comment that identical results were produced with the GIMP-resynthesize plugin. The desert fill produced by the photoshop plugin preview appeared to have much more shrubbery than the GIMP-resynthesize desert fill, and in fact looked quite different when compared side-to-side.

    I’m still marvelling at CS4’s merge-to-panorama function and it’s ability seamlessly stitch images taken without a tripod, on auto-exposure and with intense varying lens flares! I imagine that content-aware fill is well within Adobe’s abilities. If only they would release this amazing tool as a CS4 update!

  21. Rudolph Pokorny says:

    If it works as poorly at content-aware scaling, count me out.

  22. Chris says:

    I’m sorry but I can’t take this seriously. I would rather be pleasantly surprised that I’m wrong when CS5 comes out, but I’m going to go with and April fools joke on this one.

    If this is true then I’ll spend $50 on Scott’s merch if I’m proven wrong. How bout them apples, you can hold me to it.

  23. Kyle says:

    This is futuristic. Amazing.

  24. Chad says:

    If this is an April fools joke it is a cruel one. This could help a lot of people and lead to some AMAZING art!

  25. That is crazy cool. But I think I’m going to have to side with Jason Santa Maria on this one. I’d rather have more stable tools, that run faster, than these new fancy gimmicks. At the end of the day, that is what makes our day to day work-life better.

  26. Scott says:

    Daniel-
    I share that philosophy on software in general, but Photoshop CS4 runs rock solid on Windows 7, I’ve never crashed it once. So I say bring on the bells and whistles at this point. Although I have a few functionality enhancements I’d like to see (multi-layer masking channels tops that list), I think a feature like this will have a more widespread effect on Photoshop users as a whole.

    All that, if this isn’t bs. I sure hope not and as Christof said, there’s nothing specific here to dissuade me at this point. The results are seemingly incredible but are definitely based on currently existing technologies, it’s only an incremental extension of their previous applications.

    And if the Uqbar story is true (I don’t have Linux/GIMP to verify) then this whole thing is certainly well within the realm of feasibility.

  27. James says:

    Look at the last iamge, top left corner; there is a bird in the sky. Where did the bird come from? Fake.

  28. T. says:

    Maaaan. Yeah I saw this on another site somewhere and just sat in my chair in disbelief, repeating “wtf” over and over. And damn I didn’t think of it being an April fools joke. If it’s fake, I got totally got. If not, then WOW. Still can’t wrap my head around how it even works, and how, in a way, almost feels like cheating. We’ll see though.

  29. Xismo says:

    Ok just so you guys know the content aware fill is on the official CS5 launch website. So stop saying it’s a fake.

    Here’s a link:

    http://cs5launch.adobe.com/

  30. I believe it. Why else would Principal Product Manager on Adobe Photoshop be posting it? Another feature that I’m really REALLY looking forward to, is the natural media implementation on the brushes. It’s SO cool to be able to blend colors Corel Painter style! CS5 now please!

  31. adam says:

    I saw this video the other day too. The new feature looks really helpful and will save a huge amount of time for retouching. Can’t Wait..

  32. Christof says:

    Haha the bird thing is hillarious! And it really does look like a bird (however, at such a low resolution it could be many things). If you look carefully in the “bird” area at about 4:10 into the video, however, you’ll find that the “bird” form is much more likely to be the mouse cursor. Many other viewers out there seem to agree with this observation.

  33. Tyler says:

    Scott, why not just download Gimp and install the Resynthesizer extension to get a test drive of the technology. Gimp is really quite user intuitive and in many ways similar to Photoshop. I’ve been a strong Gimp user on Windows 7 for a while now. I’ll be trying this out myself soon when I get a chance. Thanks for the update!

  34. mp says:

    I saw this video and thought – wow, that’s almost like magic… and how people think retouching works… well, it appears like it will soon. However it’s not something that I do regularly in my workflow. I use photoshop primarily for web design work.

    The second thing I thought was, wow – I purchased CS4 Design Premium to the tune of $2000+ and Adobe hasn’t bothered to do a SINGLE update to photoshop since its release. No bugfix, no patch release, nothing! This is infuriating! When I use photoshop CS4 for a full day, working on large projects, it will crash (poof) at least once for no reason. I’m on a macbook pro OSX 10.5.8.

    I’ve been using photoshop for about 13 years now, and this is probably the worst version of Photoshop to date. Because of this utter lack of concern for the consumer, I’ve sworn that CS4 is the last Adobe product I buy.

  35. Chris says:

    So I can believe the first two examples, but not the third. That one is crazy.

  36. For-W-Art says:

    Almost too good to be true. Not gonna go into the whoe true or false discussion. I’ll wait for the release of it, but it looks insane.

  37. fr says:

    I’m I the only one who thinks those weren’t particularly challenging retouching examples? He went on and on about removing that tree, but it wasn’t even touching anything else. It was just sitting against flat blue sky. He could have copied a big chunk of the sky on the right, pasted it on top, and feathered out the edges with the eraser in about 30 seconds. I’m hoping this is actually useful, but I have a sneaking suspicion that it will end up in the ever growing list of gimmicky photoshop features that I never use.

  38. Rich says:

    Agree with ‘fr’ … and as for the third example … looks like it’s just generating a fairly random cloud pattern for the sky, while regards the foreground, it’s so dark you can’t really see anything. Bet it looks crap close-up!

    I’d have been more impressed if the demo had said ‘we took this desert road scene and were asked to adapt the image to show a hotel complex (logo to be designed and placed within image) with adjoining golf course, pool complex, helcopter landing on a helipad, limo drawing up at front of hotel with a couple being greeted by the doorman … at sunset … all to blend in convincingly with the existing desert image so that the original location is still apparent. … We simply selected ‘Content Aware Fill and …… 😉

  39. Rich says:

    Seriously though, … the damage is being done … the message being sent out is that professional retouching is easy and can be done in a few minutes … in fact anyone can do it! Consequently, it becomes of little value, … certainly nobody’s going to be earning a decent living from doing this kind of work.

    Assuming this is for real, I’d say it’s a great shame Adobe have gone for mass appeal gimmickry, … ultimately I think they’re cannibalising their own professional market.

  40. Nicklas Pape says:

    Alright – I pull back my earlier sceptic comment. This video shows that the tool is not fake. Amazing!

    http://www.youtube.com/watch?v=3ScWu7pG7r0&feature=player_embedded

  41. Rich says:

    Has anybody actually taken a closer look at the demo sample? I just zoomed in on the ‘retouched’ desert road … my eye was immediately drawn to the same sampled clump of bushes which I could see appearing at least three times adjacent to the original sample.
    I can see other multiple repeats in there too! From this, I’m not that impressed, it’s way too obvious as to what has been worked on the image.
    … It sure is amazing! 😉

  42. If this tool is real, they have not only killed their main *paying* customers line of business.. they have basically killed the stock photography websites and any other website that depends on watermarks to protect their images..

    An amazing technology.. but hasn’t been well thought out in terms of consequences.

    – paul

  43. Rich says:

    @Paul Pichugin You’re spot on with your comments about the effect on the pro business … it’s just a shame that from what I can see at the moment it’s all gimmick and no substance! It’s actually not doing a particularly good job! Think of it as a glorified clone tool but with Photoshop this time trying to convince us that the software has the ability to think about what it’s doing … which of course it hasn’t!
    When I look at an image, I don’t expect to even see subtle repeats in pixel data let alone blatantly obvious ones where quite large areas have been duped … to me it looks like a pattern fill … might be good enough for the masses though … who wouldn’t know good work from bad!

  44. Slim says:

    is a tragically cool desk with its ridiculous price tag..

    I would buy it in a second if I had that kinda loot. 🙂

  45. Slim says:

    wrong thread lol!

  46. Awareness says:

    This effect is used for year now from GIMP Resynthesizer plugin and its open source.

    try visit this:

    http://o3.tumblr.com/post/470608946/photoshops-caf-content-aware-fill-unbelievable

    and

    http://news.ycombinator.com/item?id=1222285

  47. zach heinbockel says:

    thats downright incredible

  48. Bryan says:

    According to the official preview today, this is real and shipping with CS5. http://cs5launch.adobe.com/

  49. ZeitiH says:

    @James

    That´s no bird.
    That´s the cursor (look exactly)
    lol

Comments are closed.