Scott moved around a lot as a child until her father’s death in Korea in 1953 prompted her mother to return to Brussels. Your theory seems to be the most likely, and I’d like to think Mrs Afton’s name is Ellie (short for Elenore) and I definitely think her and William had a falling out after Elizabeth and CC died specifically when Liz died. Divorced hopefully, dead potentially.