If you're stumbling, you might be speaking too fast!!
One thing I do which really helps my fluency is thinking in Japanese. When you consider it, we think in English all the time, and Japanese people think in Japanese so if you want to speak like a Japanese person, you have to think like one :)...