I believe in the Law of Specificity, in order to be good at something, you need to practice it. 

So if you want to speak English fluently, you need to incorporate frequent speaking practice. There are many ways of doing so, evening classes, hiring a tutor, language exchanges, visiting countries and so on. Try to speak English every day as much as you can and you will see good progress.