Establishing reliable dense correspondences is crucial for many 3-D and projector-related applications. This paper proposes using temporally encoded patterns to directly obtain the correspondence mapping between a projector and a camera without any searching or calibration. The technique naturally extends to efficiently solve the difficult multiframe correspondence problem across any number of cameras and/or projectors. Furthermore, it automatically determines visibility across all cameras in the system and scales linearly in computation with the number of cameras. Experimental results demonstrate the effectiveness of the proposed technique for a variety of applications. Notes: Copyright IEEE. To be published in and presented at IEEE International Workshop on Projector-Camera Systems in conjunction with ICCV 2003, 12 October 2003, Nice, France 8 Pages