Source close to British reality TV mogul does not cite specific reason, says Cowell is 'bitterly disappointed'