Abstract
Two representative multimedia applications—AAC and H.264/AVC decoders on the parallel architecture core (PAC) SoC are introduced in the second part of the two introductory papers. The applications have been programmed on the PACDSP core and the PAC SoC to demonstrate the high-performance, low-power DSP computations and the effectiveness of the dynamic voltage and frequency scaling (DVFS) capability on the heterogeneous multicore SoC. First, techniques to exploit data- and instruction-level parallelisms existing in the application kernels are described for performance optimizations on the clustered VLIW architecture of PACDSP with the distributed register organization. Next, two variation techniques of asymmetric programming model are introduced by examples of decoders. Then, the energy efficiency of the programmable multimedia SoC is demonstrated using an innovative power-aware H.264/AVC decoder. Finally, a DVFS-aware framework for soft real-time video playback is provided by extending the power-aware decoding scheme. The work provides practical references of realizing multimedia applications on PAC SoC suitable for rich-function and resource constraint portable devices.
Similar content being viewed by others
References
Shahbahrami, A., Juurlink, B. H. H., Vassiliadis, S. (2004). A Comparison between processor architectures for multimedia applications. Proceedings of the 15th Annual Workshop on Circuits, Systems and Signal Processing, ProRisc, Veldhoven, The Netherlands, November 2004, pp. 138–152.
Dasu, A., & Panchanathan, S. (2002). A survey of media processing approaches. IEEE Transactions on Circuits and Systems for Video Technology, 12(8), 633–645.
Mahajan, R., Nair, R., Wakharkar, V., Swan, J., Tang, J., & Vandentop, G. (2002). Emerging directions for packaging technologies. Intel Technology Journal, 6(2), 61–76.
Song, J., Shepherd, T., Minh, C., Huq, A., Syed, L., Roy, S., et al. (2003). A low power open multimedia application platform for 3G wireless. Proceedings of IEEE International SoC Conference, 17–20 Sept. 2003, pp. 377–380.
Knight, W. (2005). Two heads are better than one [dual-core processors]. IEE Review, 51(9), 32–35.
Teng, Z., Liu, P., & Lai, L. (2005). Physical design of dual-core system-on-chip. Proceedings of IEEE International Workshop on VLSI Design and Video Technology, May 2005, pp. 36–39.
Texas Instruments Inc., “SmartReflex™ power and performance management technologies—reduced power consumption, optimized performance,” White paper at http://focus.ti.com/pdfs/wtbu/smartreflex_whitepaper.pdf (accessed Sept. 2005).
Chang, C.-W., Lin, T.-J., Wu, C.-J., Lee, J.-K., Chu, Y.-H., & Wu, A.-Y. Parallel Architecture Core (PAC)—the first MulticoreApplication processor SoC in Taiwan part I: Hardware architecture & software development tools. Journal of Signal Processing Systems. doi:10.1007/s11265-010-0470-0
Advanced Video Coding for Generic Audiovisual Services, ITU-T Recommendation H.264, Mar. 2005.
Wiegand, T., Sullivan, G. J., Bjntegaard, G., & Luthra, A. (2003). Overview of the H.264/AVC video coding standard, IEEE Transactions on Circuits and Systems for Video Technology, 12(7), 560–576.
Sullivan, G. J., Topiwala, P., & Luthra, A. (2004). The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions. SPIE Conference on Applications of Digital Image Processing, 5558(part 1), 454–474.
Horowitz, M., Joch, A., Kossentini, F., & Hallapuro, A. (2003). H.264/AVC baseline profile decoder complexity analysis. IEEE Transactions on Circuits and Systems for Video Technology, 13(7), 704–716.
Ostermann, J., Bormans, J., List, P., Marpe, D., Narroschke, M., Pereira, F., et al. (2004). Video Coding with H.264/AVC: tools, performance, and complexity. IEEE Circuit and Systems Magazine, Q1, 7–28.
Kalva, H., & Furht, B. (2005). Complexity estimation of the H.264 coded video bitstreams. The Computer Journal, 48, 504–513.
Nurvitadhi, E., Lee, B., Yu, C., & Kim, M. (2003). A comparative study of dynamic voltage scaling techniques for low-power video decoding. International Conference on Embedded Systems and Applications, June 2003, pp. 23–26.
Choi, K., Soma, R., & Pedram, M. (2004). Off-chip latency-driven dynamic voltage and frequency scaling for an MPEG decoding. Proceedings of the 41st Annual Conference on Design Automation, June 2004, pp. 7–11.
Lee, S. (2005). Low-power video decoding on variable voltage processor for mobile multimedia applications. ETRI Journal, 27(5), 504–510.
Z. V. Mesarovic, Rao, R., Dokic, M. V., & Deo, S. (2001). Selecting an optimal Huffman decoder for AAC AES Convention Paper 5436, Sep. 2001.
Tsai, T.-H., & Yen, C.-C. (2002). A high quality re-quantization/quantization method for MP3 and MPEG-4 AAC audio coding. IEEE International Symposium on Circuits and Systems, 3, 851–854.
Duhamel, P., Mahieux, Y., & Petit, J. P. (1991). A fast algorithm for the implementation of filter banks based on `time domain aliasing cancellation’. International Conference on Acoustics, Speech, and Signal Processing, 3, 2209–2212.
Tseng, S. -Y., & Hsieh, T. -W. (2006). A pattern-search method for H.264/AVC CAVLC decoding. IEEE International Conference on Multimedia and Expo, July 2006, pp. 1073–1076.
Hashemian, R. (1994). Design and hardware implementation of a memory efficient huffman decoding. IEEE Transactions on Consumer Electronics, 40(3), 345–352.
Pouwelse, J., Langendoen K., Lagendijk, R., & Sips, H. (2001). Power aware video decoding. Proc. Picture Coding Symposium, pp. 303–306.
Choi, K., Dantu, K., Cheng, W., & Pedram, M. (2002). Frame-based dynamic voltage and frequency scaling for a MPEG decoder. Proc. Intl Conf. Computer-Aided Design, pp. 732–737.
Bavier, A. C., Montz, A. B., & Peterson, L. L. (1998). Predicting MPEG execution times. Proceedings of ACM SIGMETRICS ‘98, pp. 131–140.
BDTI solution benchmark results for H.264 decoders on the TI TMS320DM6446 DaVinci SoC at http://www.bdti.com/bdtimark/sc_dm6446.htm.
BDTI solution benchmark results for H.264 decoders on the ARC AV 401V Video Subsystem at http://www.bdti.com/bdtimark/sc_arc.htm
ARM, “ARM MPEG-4 AAC LC decoder technical specification,” June. 2003.
Audio encoder and decoder for DSP, http://www.kanecomputing.co.uk/pdfs/mpeg4_aac_ds.pdf.
Chung, E.-Y., Benini, L., Bogliolo, A., Lu, Y.-H., & De Micheli, G. (2002). Dynamic power management for nonstationary service requests. IEEE Transactions on Computers, 51(11), 1345–1361.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, JM., Liu, CN., Yang, JK. et al. Parallel Architecture Core (PAC)—the First Multicore Application Processor SoC in Taiwan Part II: Application Programming. J Sign Process Syst 62, 383–402 (2011). https://doi.org/10.1007/s11265-010-0471-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11265-010-0471-z