ICML icon

Deep Edge-Aware Filters

Li Xu§   Jimmy SJ Ren§   Qiong Yan§   Renjie Liao   Jiaya Jia

§SensetTime Group Limited       The Chinese Univeristy of Hong Kong


paper overview

Fig. A unified learning pipeline for various edge-aware filtering techniques. The main building blocks are a 3-layer deep convolutional neural network and an optimized image reconstruction process


There are many edge-aware filters varying in their construction forms and filtering properties. It seems impossible to uniformly represent and accelerate them in a single framework. We made the attempt to learn a big and important family of edge-aware operators from data. Our method is based on a deep convolutional neural network with a gradient domain training procedure, which gives rise to a powerful tool to approximate various filters without knowing the original models and implementation details. The only difference among these operators in our system becomes merely the learned parameters. Our system enables fast approximation for complex edge-aware filters and achieves up to 200x acceleration, regardless of their originally very different implementation. Fast speed can also be achieved when creating new effects using spatially varying filter or filter combination, bearing out the effectiveness of our deep edge-aware filters.



Optimized in Color vs. Gradient Domain

Input Result in color domain Result in gradient domain Ground truth filter

Image Smoothing Examples

Input L0 filter Ours
Input Bilateral filter Ours

Image Enhancement Examples

Input Sharpened by shock filter Ours
Input Detail enhanced by local Laplacian filter Ours

Video Result



Snapshot for paper"Deep Edge-Aware Filters"
Li Xu, Jimmy SJ Ren, Qiong Yan, Renjie Liao, Jiaya Jia
The 32nd International Conference on Machine Learning (ICML 2015)
  [Paper (3.3MB)]   [Poster (7.0MB)]

  [Matlab Code]