We show how good multivariate Poisson mixtures can be approximated by multivariate Poisson distributions and related finite signed measures. Upper bounds for the total variation distance with applications to risk theory and generalized negative multinomial distributions are given. Furthermore, it turns out that the ideas used in this paper also lead to improvements in the Poisson approximation of generalized multinomial distributions.