Hierarchical properties of multi-resolution optical flow computation
Pages 576 - 585
Abstract
Most of the methods to compute optical flows are variational-technique-based methods, which assume that image functions have spatiotemporal continuities and appearance motions are small. In the viewpoint of the discrete errors of spatial- and time-differentials, the appropriate resolution for optical flow depends on both the resolution and the frame rate of images since there is a problem with the accuracy of the discrete approximations of derivatives. Therefore, for low frame-rate images, the appropriate resolution for optical flow should be lower than the resolution of the images. However, many traditional methods estimate optical flow with the same resolution as the images. Therefore, if the resolution of images is too high, down-sampling the images is effective for the variational-technique-based methods. In this paper, we analyze the appropriate resolutions for optical flows estimated by variational optical-flow computations from the viewpoint of the error analysis of optical flows. To analyze the appropriate resolutions, we use hierarchical structures constructed from the multi-resolutions of images. Numerical results show that decreasing image resolutions is effective for computing optical flows by variational optical-flow computations in low frame-rate sequences.
References
[1]
Kameda, Y., Imiya, A.: Classification of Optical Flow by Constraints. In: Kropatsch, W.G., Kampel, M., Hanbury, A. (eds.) CAIP 2007. LNCS, vol. 4673, pp. 61-68. Springer, Heidelberg (2007).
[2]
Kameda, Y., Imiya, A., Sakai, T.: Adaptive estimation of Lagrange Multiplier functions of constraint terms for variational computation of optical flow. The Transactions of the Institute of Electronics, Information and Communication Engineers D J95-D, 1644-1653 (2012) (Japanese).
[3]
Ohnishi, N., Imiya, A.: Featureless robot navigation using optical flow. Connection Science 17, 23-46 (2005).
[4]
Klette, R., Kruger, N., Vaudrey, T., Pauwels, K., van Hulle, M., Morales, S., Kandil, F.I., Haeusler, R., Pugeault, N., Rabe, C., Lappe, M.: Performance of Correspondence Algorithms in Vision-Based Driver Assistance Using an Online Image Sequence Database. IEEE Transactions on Vehicular Technology 60, 2012-2026 (2011).
[5]
Jagadeesh, V., Karthikeyan, S., Manjunath, B.S.: Spatio-temporal optical flow statistics (STOFS) for activity classification. In: Proceedings of the Seventh Indian Conference on Computer Vision, Graphics and Image Processing, ICVGIP 2010, pp. 178-182. ACM, New York (2010).
[6]
Horn, B.K., Schunck, B.G.: Determining optical flow. Artificial Intelligence 17, 185-203 (1981).
[7]
Nagel, H.H., Enkelmann, W.: An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences. IEEE Transaction on Pattern Analysis and Machine Intelligence 8, 565-593 (1986).
[8]
Weickert, J., Schnörr, C.: A theoretical framework for convex regularizers in PDE-based computation of image motion. International Journal of Computer Vision 45, 245-264 (2001).
[9]
Zimmer, H., Bruhn, A., Weickert, J.: Optic Flow in Harmony. International Journal of Computer Vision 93, 368-388 (2011).
[10]
Pock, T., Unger, M., Cremers, D., Bischof, H.: Fast and exact solution of Total Variation models on the GPU. In: CVPR Workshop on Visual Computer Vision on GPU's, pp. 1-8 (2008).
[11]
Vaudrey, T., Rabe, C., Klette, R., Milburn, J.: Differences between stereo and motion behaviour on synthetic and real-world stereo sequences. In: 2008 23rd International Conference Image and Vision Computing, New Zealand, pp. 1-6. IEEE (2008).
[12]
Baker, S., Scharstien, D., Lewis, J.P., Roth, S., Black, M.J., Szeliski, R., Scharstein, D.: A Database and Evaluation Methodology for Optical Flow. International Journal of Computer Vision 92, 1-31 (2010).
[13]
Barron, J.L., Fleet, D.J., Beauchemin, S.S., Burkitt, T.A.: Performance of optical flow techniques. International Journal of Computer Vision 12, 43-77 (1994).
- Hierarchical properties of multi-resolution optical flow computation
Recommendations
Variational method for super-resolution optical flow
The motion fields in an image sequence observed by a car-mounted imaging system depend on the positions in the imaging plane. Since the motion displacements in the regions close to the camera centre are small, for accurate optical flow computation in ...
Video super-resolution network using detail component extraction and optical flow enhancement algorithm
AbstractThe video super-resolution (SR) task refers to the use of corresponding low-resolution (LR) frames and multiple neighboring frames to generate high-resolution (HR) frames. Existing deep learning-based approaches usually utilize LR optical flow for ...
M3Cam: Extreme Super-resolution via Multi-Modal Optical Flow for Mobile Cameras
SenSys '24: Proceedings of the 22nd ACM Conference on Embedded Networked Sensor SystemsThe demand for ultra-high-resolution imaging in mobile phone photography is continuously increasing. However, the image resolution of mobile devices is typically constrained by the size of the CMOS sensor. Although deep learning-based super-resolution (...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Sponsors
- Adobe
- TOYOTA: TOYOTA
- Google Inc.
- IBMR: IBM Research
- Microsoft Reasearch: Microsoft Reasearch
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 07 October 2012
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 04 Jan 2025