Prior to your registration for Singapore Citizenship with ICA in stage 3, you can still travel with your valid foreign travel documents.