Seriously considering pulling the trigger on a Gold IRA, but the custodian thing is tripping me up

• •I've got a decent chunk, about $350k, currently in a mix of stocks and bonds, and I’m looking to move a solid $100k-$150k into gold and silver.
• •My biggest holdup right now is the whole self-directed IRA vs.
• •traditional custodian setup.

Okay, so I’ve been sitting on the sidelines for a while, watching the market do its thing, and I’m ready to finally diversify a significant chunk of my retirement into physical precious metals. I’ve known gold’s value since my days running operations at the Fairfield Works – you see enough commodity cycles in steel to understand what real assets mean. I've got a decent chunk, about $350k, currently in a mix of stocks and bonds, and I’m looking to move a solid $100k-$150k into gold and silver.

My biggest holdup right now is the whole self-directed IRA vs. traditional custodian setup. I’ve been reading a bunch of forums and talked to a few different companies, and frankly, I'm getting a little overwhelmed. On one hand, I like the idea of a self-directed IRA, having more control, potentially lower fees down the line if I do my homework. But then I hear stories about all the compliance headaches, making sure everything is IRS-approved, and honestly, a small part of me just wants to hand it off to a professional and not have to stress about it.

For those of you with experience here, what are the real differences in practice? Not just the brochure bullet points, but the day-to-day reality. Are the fees from a traditional custodian really that much higher over, say, a 10-15 year period? And for those who went the self-directed route, what were the biggest unexpected challenges? I’m in Birmingham, AL, so I’m wondering if there are any local considerations or specific custodians/trustees folks have had good experiences with in the Southeast.

I just want to make sure I’m setting this up right from the start. I’ve seen enough booms and busts to know that taking shortcuts, especially with retirement, is never worth it. Any insights, war stories, or recommendations would be hugely appreciated before I make this move.