Full Idea
Bayesians object to inference to the best explanation, because someone who favoured powerful ('lovely') explanations would end up with an incoherent distribution of states of belief. They would be persuaded by loss-making wagers (a 'dutch book').
Gist of Idea
Bayesians say best explanations build up an incoherent overall position
Source
Peter Lipton (Inference to the Best Explanation (2nd) [2004], 07 'The Bayesian')
Book Reference
Lipton,Peter: 'Inference to the Best Explanation (2nd ed)' [Routledge 2004], p.104
A Reaction
[compressed; he cites Van Fraassen 1989 Ch.7] Lipton's Ch. 7 tries to address this issue.