Colloquial speech is used in everyday conversation.

At the very least, I'd like to be able to have everyday conversations.

If you want to sound like a native speaker, it's easier if you choose one dialect and stick with it. Native speakers don't usually mix dialects in everyday speaking.