This paper addresses the asymptotic stability of switched time delay systems with heterogeneous time invariant time delays. Piecewise Lyapunov-Razumikhin functions are introduced for the switching candidate systems to investigate the stability in the presence of an infinite number of switchings. We provide sufficient conditions in terms of the minimum dwell time to guarantee asymptotic stability under the assumptions that each switching candidate is delay-independently or delay-dependently stable. Conservatism analysis is also provided by comparing with the dwell time conditions for switched delay-free systems. Finally, a numerical example is given to validate the results.