How to apply a Vignette CIFilter to a live camera feed in iOS?

by

Your step 2 is way too slow to support real-time rendering… and it looks like you’re missing a couple of steps. For your purpose, you would typically:

Setup:

  1. create a pool of CVPixelBuffer – using CVPixelBufferPoolCreate
  2. create a pool of metal textures using CVMetalTextureCacheCreate

For each frame:

  1. convert CMSampleBuffer > CVPixelBuffer > CIImage
  2. Pass that CIImage through your filter pipeline
  3. render the output image into a CVPixelBuffer from the pool created in step 1
  4. use CVMetalTextureCacheCreateTextureFromImage to create a metal texture with your filtered CVPixelBuffer

If setup correctly, all these steps will make sure your image data stays on the GPU, as opposed to travelling from GPU to CPU and back to GPU for display.

The good news is all this is demoed in the AVCamPhotoFilter sample code from Apple https://developer.apple.com/library/archive/samplecode/AVCamPhotoFilter/Introduction/Intro.html#//apple_ref/doc/uid/TP40017556. In particular see the RosyCIRenderer class and its superclass FilterRenderer.

More Related Contents:

  1. Why can’t I invert my image back to original with CIFilter in my Swift iOS app
  2. CIFilter output image nil
  3. How do I export UIImage array as a movie?
  4. How to play video with AVPlayerViewController (AVKit) in Swift
  5. Making the iPhone vibrate
  6. UIWebView: HTML5 audio pauses in iOS 6 when app enters background
  7. Looping a video with AVFoundation AVPlayer?
  8. How to play a sound using Swift?
  9. How to use AVCapturePhotoOutput
  10. iOS background audio not playing
  11. How to turn a CVPixelBuffer into a UIImage?
  12. Add custom header field in request of AVPlayer
  13. How to do Slow Motion video in IOS
  14. AVCaptureSession with multiple previews
  15. iPhone Read UIimage (frames) from video with AVFoundation
  16. Screenshot for AVPlayer and Video
  17. ios overlaying alpha channel video on another video
  18. AVFoundation, how to turn off the shutter sound when captureStillImageAsynchronouslyFromConnection?
  19. How do I use AVFoundation to crop a video
  20. Check play state of AVPlayer
  21. Maintaining good scroll performance when using AVPlayer
  22. iOS AVFoundation: Setting Orientation of Video
  23. AVPlayer stops playing and doesn’t resume again
  24. How can I generate a barcode from a string in Swift?
  25. AVSpeechSynthesizer in background mode
  26. Swift Merge audio and video files into one video
  27. AVFoundation Image orientation off by 90 degrees in the preview but fine in Camera roll
  28. How can I know users click fast forward and fast rewind buttons on the playback controls in iPhone
  29. create movie from [UIImage], Swift
  30. Using existing system sounds in iOS App [swift|

Leave a Comment