More priests are also abanding their vocation, according to figures.