Frogger,
Right click on the remote desktop connection icon for the saved session.
Goto Experience, uncheck all boxes.
Goto Local Resources, uncheck printers ,clipboard,
Click more, unclick all.
Save and try. Let us know this has any influence.
If not, then try log me in as an alternative. I use logme in and don't have the same issue.