Starting issue.

I have to hold the key in the start position for a few seconds for the starter to engage. Not sure if it is a clutch switch, starter relay or the ignition switch. Is this common for the B7? One thing I did not check is the starter itself, possibly loose and not getting a good ground. I had it out a few months back when I changed my clutch.