We develop an efficient multi-scale time domain full wavefrom inversion (FWI) method using Graphics Processing Unit (GPU). Benefited from the acceleration of GPU, the intensive computational cost of time domain FWI becomes affordable on our desktop. As the geological targets in subsurface area are usually multi-scale, we propose a multi-scale time domain FWI method using GPU to invert the model more efficiently and effectively. The strategy for multi-scale FWI is very similar to frequency domain FWI. Therefore we make a comparison between the results of our multi-scale method and the frequency domain FWI results. We use 2D Overthrust model and 2D Marmousi model to demonstrate the validity of our method.