Geraldo Rivera is continuing to open up about his departure from Fox News after 23 years at the conservative network.

I should have left a long time ago, Rivera told Mediaite on this weeks episode of The Interview podcast . But for various reasons, not the least of which was my own insecurity about where I would end up, I stuck around and I stayed too long at the dance.

Rivera, 80, announced in June that he was quitting Fox News after being kicked off The Five.

Over time I had a very toxic relationship, as Ive described it, with one or more cast members, he said of the panel show. And it got to be, the friction was visible, very tense on the set.

And then at a certain point, two Fox executives ... they called me and said that I was basically fired from The Five, he added.

Though Rivera, a moderate Republican, didnt name names, he routinely clashed with co-hosts on The Five, particularly Greg Gutfeld , over a range of subjects, including his criticisms of former President Donald Trump .