Clifton Causby told magistrate Ian Watkins that he "didn't understand" why he needed to be bailed and that there was "no help at all" for him in custody.

He appeared via videolink in Wodonga Magistrates Court on Tuesday.

Causby was refused bail due to him being an "unacceptable risk of re-offending" if released.

IN OTHER NEWS:

Prosecutor Jordan O'Toole successfully argued Causby's situation hadn't significantly changed, despite the accused now being eligible for the Court Integrated Services Program (CISP) when released.

Causby is accused of stealing two .22 rifles and a cache of other property worth about $5800 from a Stanley home earlier this year.

He had allegedly used a screwdriver to pry open a gun safe at the remote property to steal the guns.

Barrister Martin Kozlowski told the court there was new support available for his client if bailed.

"CISP will provide a night's accommodation on his release and a month's worth of assistance with substance use, he has been an ice user, and mental health support," he said. "He is understandably struggling in custody.

"This support will not only be reducing his risk of re-offending but helping himself to rehabilitate as well."

Magistrate Ian Watkins disagreed with Mr Kozlowski, and said while "some support is better than nothing" he couldn't be satisfied Causby wouldn't fall back into old habits if released.

Causby's car was also deliberately torched in August, while he was in custody.

This is the second time he has been refused bail by Mr Watkins.

The case will be heard in the Wodonga County Court on October 30 to give Mr Kozlowski enough time to get a psychiatric assessment of Causby.