Inherited IRA to Gold - What are my options?

• •So, I’ve got a bit of a situation here and was hoping some of you seasoned folks could shed some light.
• •My brother passed last year, bless his soul, and I’m the beneficiary on his traditional IRA.
• •I’ve been a big proponent of physical metals for a while now, sitting on a pretty substantial allocation myself.

So, I’ve got a bit of a situation here and was hoping some of you seasoned folks could shed some light. My brother passed last year, bless his soul, and I’m the beneficiary on his traditional IRA. It’s sitting at about $850k right now, and frankly, I'm not thrilled with the current market volatility, especially being well into my retirement and having seen a few cycles come and go from my CEO days. My initial thought was to roll it into my self-directed IRA and convert a good portion of it into physical gold and silver, much like I've done with a significant chunk of my own ~3.5M nest egg over the past decade.

I’ve been a big proponent of physical metals for a while now, sitting on a pretty substantial allocation myself. The plan was to do a direct rollover to avoid any taxable distributions, then work with my preferred custodian to get some reputable gold and silver allocated. However, my financial advisor (who, bless his heart, sometimes feels a bit too wedded to traditional paper assets) is making noises about the inherited IRA rules being more restrictive than a standard rollover. He's talking about "inherited IRA" specific rules and some kind of "non-spouse beneficiary" limitations that might make a direct physical gold conversion more complicated or even impossible without triggering early distributions and penalties.

My own IRA is largely in physical metals and has been my financial bedrock, especially living in Palm Beach where the cost of everything keeps climbing. I'm looking to protect this inherited capital, not get hit with a surprise tax bill. Has anyone here specifically navigated converting an inherited IRA (as a non-spouse beneficiary) into physical gold or silver within the IRA structure? What were the hurdles? Did you manage to do it without an immediate taxable event? Are there specific types of custodians that are better equipped for this?

Any insights, war stories, or even just recommended resources would be hugely appreciated. Trying to make sure I do this by the book, but also in a way that aligns with my long-term financial philosophy. Thanks in advance for any wisdom you can share.