What do you mean by "extended" USB connectors, and how extended is "extended"?
Which Cat 5 USB extenders did you use?
The problem could be impedance mismatch, transmission loss through the connectors, and/or adverse changes to the cable shielding if any.
Some Cat 5 is shielded, others are not and rely solely on pair twisting to mitigate noise issues. If you are using shielded cable, are you grounding the shield?
Depending on your cable length requirements you may want to upgrade to Cat-6 which has better bandwidth and transmission properties. But that only assumes that the problem is strictly cable related and not something else.
---------------------------------
Don't forget to wear a foil hat whenever doing RF work.
It serves no useful purpose but your friends and neighbors will have a good laugh at your expense.