Skip to main content
Seminar | Mathematics and Computer Science

Half Precision Wave Simulations

CS Seminar

Abstract: In recent years, we have witnessed new developments in floating point formats driven by new computational demands. In this talk, we will review the floating point number system, round-off errors, and their impact on basic operations with connections to modern hardware and software practices. Then, we will investigate the impact of round-off errors in a more complicated situation, namely, time dependent wave simulation in half precision (fp16). Specifically, we will illustrate the issue of degradation in simulation quality and provide remedy accordingly.