Can I have contacts that are from different networks?

No, you cannot. The idea of private team network is that the participants are in a private area of authorized users only. Each account can have accounts from its network only. If you want to have contacts from another network, you need to create an account in that network.