TV network says PM twice stopped defense minister from traveling to Washington and New York, as White House has avoided offering a trip to the premier