Even so, for all IRAs, IRS Publication 590 states that custodians or trustees should be an entity accredited by the IRS, a financial institution, a financial savings and personal loan association, or an insured credit score union. Storing gold and other precious metals while in the account