Maxim was an aggressive Atheist. Maxim knew the Chinese statesman and general Li Hung Chang to be just as strong an Atheist as he was himself.
"[Frazer] was not an Atheist. I would say perhaps that he held his judgment in suspense." That is the common definition of an Agnostic.