H. Takahashi et al., ON THE CORRECTION OF THE DIFFERENTIAL NONLINEARITY ARISING FROM DISCRETE VALUES FOR A DIGITAL SIGNAL-PROCESSING SYSTEM, Nuclear instruments & methods in physics research. Section A, Accelerators, spectrometers, detectors and associated equipment, 373(1), 1996, pp. 119-123
The differential non-linearity arising from digital signal operations
has been examined. Serious degradation of the differential linearity i
s observed when a series of discrete integer data is processed by a di
gital system. Two practical correction methods have been proposed: one
is to utilize random numbers for converting the discrete integer data
into floating point data. The other method is to consider each intege
r number with its width in order to cover the number line until the ne
ighboring discrete value. Experimental results show great improvements
of the differential linearity for both of the two methods, however, t
he latter method gives a better result.