Hollywood director says he chalked up stories to 'chasing secretaries around desks' trope and didn't speak to now-convicted sex offender because he thought behavior was 'pathetic'