Ursula Sovereign's second husband was John Joyce (not Leonard). He was born 11 Jun 1823 in Westmorland County, New Brunswick and died in 1899. See the website for Trinity Anglican Church cemetery (http://www.elginogs.ca/Home/ancestor-indexes/gravestones/bayham---trinity-port-burwell). A stone there lists Ursula and two of the kids -- Leonard and Minnie.
John Joyce was the son of Thomas and Elizabeth (Ryan) Joyce of Botsford Parish, N.B. Thomas came over from Ireland.