How would I know if I had an insect infestation?

Put it this way, 1 spider, 1 beetle and 2 silverfish is what it is, infestation is millions of the little beggars all over. So, no, you are not infested.