Weinstein said people like Page were critical in ensuring constitutional rights for all those who join the military.
"There is no difference between this and degrading anyone for the color of their skin or being a female," he said.
But he commended West Point for honorably discharging Page and not punishing him for what he has done.
Page said he's received support from other nonreligious cadets. But he's also been called a coward and a quitter.
A former classmate, Charles Clymer, wrote an open letter to Page on the Facebook page of the Secular Student Alliance. Clymer described himself as a Christian but also an "aggressive, outspoken liberal" who voiced his opinion loudly on what he called the injustice of "don't ask, don't tell" and limited career options for women.
He said he was not a typical cadet, but that he was angered by Page's online post and believed that Page lashed out simply because he wasn't cutting it at West Point.
"I never, not even once, witnessed, heard about, or even thought it implied that non-religious cadets face discrimination of any kind at the Academy," Clymer wrote.
"I saw widespread homophobia and sexism but never any negative sentiment towards those cadets who identified as atheist or agnostic," he wrote. "In fact, the closest thing I ever observed that looked like a pro-Christian bias were the few cadets who believed Islam is evil, and that was a very small fraction of our class. The vast majority of Christian cadets treated non-Christian cadets with respect insofar as their beliefs are concerned."
Page said that, ultimately, he was not concerned with what others said about him.
"That's really fine." he said. "I am not trying to talk about myself. I am trying to talk about church and state."