Network Issues

I have a prefab, each player clones it. It seems that if in the network one player connects as server and the other player connects as the client, 4 samples of this prefab will be created. 2 of them is shown for the server and two for the client. Is this work like this? If it is, how can I access to these 4 prefabs. I have to change the color of each prefab for each player. (If we have 2 player we have the same prefab with two colors). I can change the color in server view but I have problem with the client. Thanks