How many times had Gandalf been to Moria?

[Valandil]

I was thinking about this... how when the Fellowship is considering which way to take after turning back from the Dimrill Stair.

I had THOUGHT that both Gandalf and Aragorn say they had only been there once before. When we look closely at what they actually say though - it's clear that Aragorn has only been there once, but with Gandalf it's open ended.

Gandalf: "... Yet it will not be the first time that I have been to Moria. I sought there long ago for Thrain son of Thror after he was lost. I passed through, and I came out again alive."

Aragorn: "I too once passed the Dimrill Gate, but though I came out again, the memory is very evil. I do not wish to enter Moria a second time."

The reason I wonder is this: Gandald and the other Istari came to Middle Earth around 1000 of the Third Age. Moria was still occupied by Dwarves then - Durin's folk dwelt there until 1981.

Did Gandalf never enter Moria for the entire first millenium he was in Middle Earth? And if not, why not? Did the Dwarves not care for visitors? Did he not particularly notice them as long as they were holed up there and not wandering about? Did he just prefer Elves (and a little bit Men, and later Hobbits?)?

Or - perhaps he just saw no need to mention earlier visits there in more pleasant times - since his words sort of "danced around it" and just spoke of the last time he had been there? Perhaps he was speaking only of post-1981 visits?

Thoughts?