Simon Cowell Talks ‘X Factor’ Judges & Host, Says Deal Almost Never Happened

Simon Cowell is speaking out about his departure from “American Idol” and his new British TV import, “X Factor” – a deal he says almost didn’t happen.

“We were driving down to do the press conference and we didn’t have an agreement,” Simon told Ryan Seacreast Tuesday morning on KIIS FM’s “On Air with Ryan Seacrest.” “And at one point at about 11:30, we were saying we weren’t going to do the press conference.”

The reality show judge said he entertained the idea of doing both “X Factor” and “Idol” at the same time.

“You gotta know when it’s time to go. I’d always wanted to bring this show over here and at one point I was going to do both shows, but you can’t be on TV too much,” he explained. “And then I genuinely thought people would be sick and tired of me, so it was all agreed in the last few days.”

And now that Simon has announced his plan to bring “X Factor” to FOX in 2011, rumors have been spreading about who might be joining him in his new venture – along with replacing him on “Idol.”

“You know the rumor that’s doing the rounds at the moment, [that] you’re going to replace me [on ‘Idol],’” Simon told Ryan.

“I heard this in this press,” Ryan said.

And what about former “Idol” judge Paula Abdul joining “X Factor?”

“You’ll have to wait and see Ryan…you’ll have to wait and see,” Simon coyly said when asked about Paula “Interestingly, since we made the announcement, everyone has been on the phone.”

And when asked if his new show would have a host, Simon, added, “Yes it does, you’ll have to wait and see!”

As previously reported on AccessHollywood.com, Simon may be leaving, but “Idol” itself isn’t going anywhere. An executive for FOX confirmed the show has been picked up for three additional seasons after this year.