Designing energy-efficient and high-performance arithmetic hardware remains a major challenge for modern computing systems, particularly for the multipliers and compressors that dominate multiply–accumulate (MAC) workloads. This paper presents an efficient approximate compressor architecture designed to achieve balanced error accumulation in MAC units used for error-tolerant applications such as image processing and machine learning (ML). The proposed architecture selectively simplifies the compressor stages that reduce partial products of least numerical significance, while preserving exact computation for the bits that dominate accuracy, so that approximation error accumulates in a controlled and balanced manner rather than growing unpredictably across operand widths. Building on this compressor, a configurable multiply–accumulate (MAC) unit for ML hardware is developed, capable of switching between an exact mode and 2-bit and 4-bit approximate compression modes at runtime according to instantaneous power and accuracy requirements. A modified, error-compensated activation function is further proposed to offset the systematic bias introduced by the approximate compressor at the neuron output. The proposed architecture is implemented in SystemVerilog and synthesized with Synopsys Design Compiler for UMC 90 nm CMOS technology, with functional validation on FPGA platforms. A Gaussian blur filter is used to evaluate the compressor in an image-processing pipeline, while a multilayer perceptron (MLP) trained on standard ML datasets evaluates the configurable MAC unit and the compensated activation function. Experimental results show that the proposed approximate compressor architecture achieves substantial reductions in power, area, and energy per operation relative to an exact Wallace-tree baseline, while keeping error metrics such as NMED, MRED, and ER low and well balanced across configurations, making it a strong candidate for energy-constrained, error-tolerant computing systems.
Introduction
This paper presents a configurable approximate compressor architecture for energy-efficient multiplication in machine learning (ML) and edge computing systems. Unlike conventional approximate arithmetic circuits with fixed accuracy, the proposed design dynamically switches between exact, 2-bit approximate, and 4-bit approximate compressor modes to balance power consumption and computational accuracy based on available energy. The architecture targets multiplier compressor trees, where reducing switching activity and hardware complexity significantly lowers power, delay, and silicon area while maintaining acceptable accuracy for error-tolerant applications such as image processing and neural network inference.
The proposed architecture is implemented using SystemVerilog and evaluated with Xilinx Vivado and Synopsys Design Compiler in UMC 90 nm CMOS technology. It uses a configurable Wallace-tree multiplier, a configurable MAC unit, and a modified activation function that compensates for approximation errors using a compensation factor derived from the Normalized Mean Error Distance (NMED). Instead of duplicating hardware, the design reuses the same adder cells across different operating modes, requiring only minimal additional control logic.
Experimental results show that the 4-bit approximate compressor achieves significant reductions in power, area, latency, and energy consumption while introducing only small, balanced errors. Tests on image processing and neural network applications demonstrate minimal degradation in image quality and classification accuracy. Compared with previous approximate multiplier and compressor designs, the proposed architecture provides higher energy savings with lower and more predictable error, making it well suited for resource-constrained AI accelerators, edge devices, and energy-harvesting systems where runtime adaptability and efficiency are essential.
Conclusion
This work has presented an efficient approximate compressor architecture for balanced error accumulation in MAC units, targeting energy-constrained, error-tolerant applications. Approximate computing offers design techniques at many abstraction levels for building on-chip systems that are efficient in both energy and performance, and approximate compressors — a key subfield of approximate arithmetic — have drawn considerable attention in the literature. The central contribution of this work is a configurable compressor structure whose approximation level can be tuned on the fly through logic-compression control, so that a single set of adder cells serves the exact mode as well as multiple approximate compression modes. An energy-aware configuration strategy selects the appropriate compressor mode based on available energy, and the results show that the design executes reliably at runtime even under highly variable energy conditions, while reusing the same adder cells across configurations saves silicon area and leakage energy.
Building on the proposed compressor, a configurable MAC unit was designed for power-adaptive ML hardware, and its configuration is optimized at runtime using the same energy-aware strategy. The resulting MAC unit was deployed within neuron modules of an ML system, and a model-driven, power-adaptive neuron architecture was constructed around it. Despite significant reductions in energy use and area, the resulting drop in output quality was minimal. Finally, a customizable, error-compensated activation function was proposed to further reduce the impact of the approximate compressor on prediction accuracy. Together, these three contributions — the approximate compressor, the configurable MAC unit, and the compensated activation function — allow energy-adaptive neural-network hardware to realize substantial power and area savings with negligible degradation in output quality.
Future work will extend the proposed approximate compressor architecture to larger operand sizes, such as 16×16 and 32×32 multipliers, and integrate the resulting MAC units into more complex deep-learning accelerators. Another promising direction is to co-optimize the approximate compressor hardware with quantization-aware training so that the neural network can explicitly adapt its weights to the characteristics of the underlying arithmetic units. Finally, implementing and validating the architecture on more advanced technology nodes and additional FPGA platforms will provide further insight into its scalability and practical deployment in real-world edge-AI systems.
References
[1] Venkatachalam, S., & Ko, S.-B. (2017). Design of power and area efficient approximate multipliers. IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 25(5), 1782–1786.
[2] Liang, J., Han, J., & Lombardi, F. (2013). New metrics for the reliability of approximate and probabilistic adders. IEEE Transactions on Computers, 62(9), 1760–1771.
[3] Chang, C., Gu, J., & Zhang, M. (2004). Ultra low-voltage low-power CMOS 4-2 and 5-2 compressors for fast arithmetic circuits. IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing, 51(10), 1985–1997.
[4] Pei, H., Yi, X., Zhou, H., & He, Y. (2021). Design of ultra-low power consumption approximate 4-2 compressors based on the compensation characteristic. IEEE Transactions on Circuits and Systems II: Express Briefs, 68(1), 461–465.
[5] Jiang, H. L., Liu, C., Liu, L. B., Lombardi, F., & Han, J. (2017). A review, classification, and comparative evaluation of approximate arithmetic circuits. ACM Journal on Emerging Technologies in Computing Systems, 13(4), Article 60.
[6] Nambi, S., Kumar, U. A., Radhakrishnan, K., Venkatesan, M., & DeBAM, A. S. (2021). Decoder-based approximate multiplier for low power applications. IEEE Embedded Systems Letters, 13, 174–177.
[7] Yang, Z., Han, J., & Lombardi, F. (2015). Approximate compressors for error resilient multiplier design. In Proceedings of the IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems (DFTS) (pp. 183–186).
[8] Lau, M. S. K., Ling, K. V., & Chu, Y. C. (2009). Energy-aware probabilistic multiplier: Design and analysis. In Proceedings of the International Conference on Compilers, Architecture, and Synthesis for Embedded Systems (pp. 281–290). Grenoble, France.
[9] Di Meo, G., Saggese, G., Strollo, A. G. M., & De Caro, D. (2023). Design of generalized enhanced static segment multiplier with minimum mean square error for uniform and nonuniform input distributions. Electronics, 12, 1–21. https://doi.org/10.3390/electronics12010234
[10] Hwang, S., Seok, H., & Kim, Y. (2024). Design of an approximate 4-2 compressor with error recovery for efficient approximate multiplication. Journal of Semiconductor Technology and Science, 24(4), 305–315.
[11] Han, J., & Orshansky, M. (2013). Approximate computing: An emerging paradigm for energy-efficient design. In Proceedings of the 18th IEEE European Test Symposium (ETS). IEEE.
[12] Pashaeifar, M., et al. (2018). Approximate reverse carry propagate adder for energy-efficient DSP applications. IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 26(11), 2530–2541.
[13] Ye, R., et al. (2013). On reconfiguration-oriented approximate adder design and its application. In Proceedings of the IEEE/ACM International Conference on Computer-Aided Design (ICCAD). IEEE.
[14] Di Meo, G., et al. (2023). Approximate MAC unit using static segmentation. IEEE Transactions on Emerging Topics in Computing, 12(4), 968–979.