Edward and Mrs Simpson, as she still was, were seen together too often. They holidayed on a cruise and more.
Edward now knew that he wanted to marry Wallis come Hell or high water. It was 1936 and Hitler's presence was being felt on the World stage. Britain needed a figurehead that it could rely on.
Edward asked to meet with the then Prime Minister, Stanley Baldwin a stern man and in so many ways the opposite of Edward. On November 16 Edward told Baldwin of his intention to marry Wallis as soon as she was a free woman.
Most British people believe that losing the throne meant more to Wallis than it did to Edward but give the woman her due; she stayed with Edward even when he was in effect exiled.
They never lived in poverty though and both still lived a privileged existence.
When Baldwin rejected Edward's intention to marry, Edward came up with another plan. He hoped that he could ascend to the throne as King but Wallis would not be Queen, in real terms. She would be his 'consort'. He hoped and thought that the government would accept this compromise but the British government were having none of it.
Backed into a corner Edward did the only thing he thought he could and abdicated.
On December 10, 1936, Edward, his ministers and relevant family members, signed the papers which would allow him to abdicate.
Edward was made the Duke of Windsor. This title prevented Edward from becoming involved in British politics and more.
The matter was not easily settled and some wanted the Duke and Duchess to have nothing. The Queen Mother maintained an intense dislike of both Edward and Wallis throughout her lifetime.
War with Germany was to follow in 1939 and, as we now know, Edward played the traitor on more than one occasion. He was seen with Adolf Hitler and performing the Nazi salute. In recent years we have seen many revelations regarding Edward and Mrs Simpson.
Although they became the Duke and Duchess of Windsor for many, including myself, they will always be The Prince of Wales and Mrs Simpson.
Edward and Wallace were never welcome in England after the abdication, although they still had many fans and sympathisers. His antics during World War Two, with the likes of Herr Hitler, put the final nail in his coffin, for many. It is rumoured that he was prepared to do a deal with the Nazis in exchange for regaining the throne. Both he and Wallis approved of the Nazis early behaviour.
Although Edward was excluded from events, such as Queen Elizabeth's ascension, to the throne he did attend his brother, King George's funeral.
On the May 28 1977 the Duke of Windsor died at his Paris home with Wallace at his side. He was 77. Edward was given a state funeral in England, on June 5 1977. Wallis was to live for another 14 years.
In death she was finally accepted. She was buried alongside her husband, in the Royal Burial Ground. Her grave is simply marked as Wallis, Duchess of Windsor.
This couple lived such a complex and varied life. The only conclusion about Edward is that, in some ways, he was a silly man, he let his heart, or something, rule his head, he was weak, perhaps he would not have made a good king, he was selfish, he could be touched by the poverty of others, he was likable, he was arrogant and above all he was deeply in love.
This love affair will fascinate people for years to come.
Prince Charles and his wife Camilla have so many similarities to Wallis and Edward, that only time will tell who will be our next ruler.