The Border Mail columnist said the member for Albury's parliamentary support for the Reproductive Health Care Reform Bill had stunned him.
"I've been contacted by a number of Catholics and they're deeply hurt by this and I myself am deeply hurt," Father Lee said.
"I really thought when it came to Justin Clancy we had it (his vote) in the bag.
"I was shocked, literally shocked, when I found out he voted for it.
"He rolled over on this one."
Mr Clancy, who is the president of the Sacred Heart Church parish council in North Albury, noted that in his speech to parliament on the bill he had stressed he did not believe abortion should be subject to the Crimes Act.
"A) I genuinely sought to represent my community and B) faith is important to me and as I've said before it informs me that life is precious and it also informs me to be compassionate and listen," he said.
"I recognise a complexity of human experience, I can't speak for the woman that is confronted by that decision, I recognise that, but where we can we need to make sure we work towards education and support and care around this matter."
Asked whether he supported abortion, Mr Clancy replied that "it's not black and white".
Father Lee said he did not support the bill in any circumstances.
"I think abortion is a crime and has been a crime up until this day, we're rewarding bad behaviour (by passing this bill)," he said.
"I would suggest the vast majority of Catholics are opposed to abortion in any circumstances.
"Some people that call themselves Catholic are no more Catholic than getting baptised.
"The rules of being Catholic are very low, but in the case of committed Catholics I've not come across any Catholics that are in favour of abortion."
Wagga Nationals MLC Wes Fang has indicated he will support the bill.
Receive our daily newsletter straight to your inbox each morning from The Border Mail. Sign up here