We discuss the quantum mechanics of a particle in a magnetic field when its
position x(mu) is restricted to a periodic lattice, while its momentum p(m
u) is restricted to a periodic dual lattice. Through these considerations w
e define non-commutative geometry on the lattice. This leads to a deformati
on of the algebra of functions on the lattice, such that their product invo
lves a "diamond" product, which becomes the star product in the continuum l
imit. We apply these results to construct non-commutative U(1) and U(M) gau
ge theories, and show that they are equivalent to a purr U(NM) matrix theor
y, where N-2 is the number of lattice points.