Towards Program Optimization through Automated Analysis of Numerical Precision

Proc CGO. 2010 Apr:2010:230-237. doi: 10.1145/1772954.1772987.

Abstract

Reducing the arithmetic precision of a computation has real performance implications, including increased speed, decreased power consumption, and a smaller memory footprint. For some architectures, e.g., GPUs, there can be such a large performance difference that using reduced precision is effectively a requirement. The tradeoff is that the accuracy of the computation will be compromised. In this paper we describe a proof assistant and associated static analysis techniques for efficiently bounding numerical and precision-related errors. The programmer/compiler can use these bounds to numerically verify and optimize an application for different input and machine configurations. We present several case study applications that demonstrate the effectiveness of these techniques and the performance benefits that can be achieved with rigorous precision analysis.

Keywords: D.2.4 [Software Engineering]: Program Verification–Validation; D.3.4 [Programming Languages]: Processors–Optimization; Design; Fixed-Point Numbers; Floating-Point Numbers; G.1.0 [Mathematics of Computing]: Numerical Analysis–Computer Arithmetic; Numerical Precision; Performance; Static Error Analysis; Verification.