CHANNEL SIMULATION AND CODING WITH SIDE INFORMATION

Citation
Y. Steinberg et S. Verdu, CHANNEL SIMULATION AND CODING WITH SIDE INFORMATION, IEEE transactions on information theory, 40(3), 1994, pp. 634-646
Citations number
12
Categorie Soggetti
Information Science & Library Science","Engineering, Eletrical & Electronic
ISSN journal
00189448
Volume
40
Issue
3
Year of publication
1994
Pages
634 - 646
Database
ISI
SICI code
0018-9448(1994)40:3<634:CSACWS>2.0.ZU;2-I
Abstract
We study the minimum random bit rate required to simulate a random sys tem (channel), where the simulator operates with a given external inpu t. As measures of simulation accuracy we use both the variational dist ance and the dBAR distance between joint input-output distributions. W e find the asymptotic number of random bits per input sample required for accurate simulation, as a function of the distribution of the inpu t process. These results hold for arbitrary channels and input process es, including nonstationary and nonergodic processes and do not hinge on a specific simulation scheme. A by-product of our analysis is a gen eral formula for the minimal achievable source coding rate with side i nformation.