The two actors, with a 40-year age difference between them, met at a Hollywood party