So far I have laid out the differences between Japanese and Vietnamese pronunciation, but reading this will not suddenly let you understand someone's English from tomorrow. What does change a little is how you put your mind to work when facing the other person's English.
When a Vietnamese colleague speaks English and there is a word whose ending you just cannot catch, if you can think, "Vietnamese doesn't release word-final consonants, so this person may be pronouncing /t/ or /k/ in a way that doesn't reach my ears," it becomes easier to guess the word from the flow of the conversation.
This is less about studying English and more about an inference that comes from knowing a little about how Vietnamese sounds work.
The same can be said of knowledge on the English side. I wrote earlier that "three" sounds close to "tree," but this is not limited to Vietnamese people's English. Among native English speakers, too, sociolinguists have documented pronunciations in which th becomes close to t or d, in New York City and its surrounding area, in Irish English and in some African American speech (Th-stopping). Historically, it is explained as having become established as a working-class way of speaking under the influence of the sound systems brought by Irish, Italian and Jewish immigrants from the 19th to the early 20th century.
I belong to a generation that had its th pronunciation strictly corrected at school. Even now, when th is pronounced close to t, I am tempted to think reflexively that "it's wrong." But if you know that native English speech also includes the same choice of sound, then when you hear Vietnamese people's English, there is room to take it as "not a matter of accent, but one of the pronunciations that arises naturally from the sound system of their native language."
Knowing just a little Vietnamese also leads to understanding the English that Vietnamese people speak. It is also an opportunity to consider how your own English reaches the other person, in light of how Japanese sounds work.