This paper introduces a novel accent classification method. Compared with existing methods, it has two unique features. First, it does not explicitly utilize phoneme information. Second, it is built on top of the gender classification. We have tested the proposed algorithm on datasets that are completely independent of training data. The accuracy of distinguishing American accent and British accent is 83%. We have also compared the accent classification with the gender classification in terms of accuracy and the saturation behavior with respect to length of utterance. Notes: Copyright IEEE. To be presented at and published in the 38th Annual Asilomar Conference on Signals, Systems, and Computers, 7-10 November 2004, Pacific Grove, CA 4 Pages