Those are not the only idols. Everything that has been Christianized ought to go too. Exodus 20:4 says, "Thou shalt not make unto thee any graven image, or any likeness [of any thing] that [is] in heaven above, or that [is] in the earth beneath, or that [is] in the water under the earth: Thou shalt not bow down thyself to them, nor serve them: for I the LORD thy God [am] a jealous God, visiting the iniquity of the fathers upon the children unto the third and fourth [generation] of them that hate me; And shewing mercy unto thousands of them that love me, and keep my commandments." Stop kissing the statue of Jupiter thinking it is Peter, bowing down to Marian shrines that were once used by pagans, etc.