If it were, the accusative would be **_virum_.
And indeed it is. Even though it's neuter.
Gender certainly determines declension in, eg., the participles in _-ns_.
Sorry, I was talking about nouns only.