Ministers said to cite US president's dialogue with North Korea's Kim Jong Un as disturbing precedent, 'but our capacity to influence and confront Trump is extremely limited'