Court papers value estate at over $577 million, list no beneficiaries, raise new questions about final days of disgraced financier