Password length is controlled by the PASSLENGTH parameter. This can be set using the System Defaults Manager or the defadm(1M) command: defadm passwd PASSLENGTH=value
The maximum length is 80 characters.