Appeals court rules that descendants of Jewish businessman who owned 'The Actor' waited too long to demand it be returned from New York museum