The sudden deterioration in the queen's condition left many of her closest family members still on the road to her Scottish castle when she died