As an adult, Rubinstein referred with pride to his Jewish origins, but he called himself an agnostic. He was reluctant to call himself an Atheist.
"I knew Lincoln was an Infidel. I never heard that Lincoln changed his views. Sometimes Lincoln bordered on Atheism," said friend and political manager Colonel James H. Matheny.