Why do some fundamentalist say that they're no real atheist?

The fundamentalist I know, think that "it's impossible for one not to believe in God because of the overwhelming evidence there is for one's existence." yet they strongly assert the non-existence of the deity/deities in other religions. If they don't believe in the existence of other deities, wouldn't that mean mean it is possible to not believe in any deity at all?