Changing an objects layer over the network with rpcs, PUN?

I have set up a script where it changes an objects layer on my character, however it does this for every character. I am working on a character customization system and need a way for the objects to be on over the network. I can switch their layers but it happens for every characters version of this object .

This is the basic idea ive been trying to get to function:

using UnityEngine; using System.Collections;

public class CustomizationController : MonoBehaviour { public GameObject Hat2; // Use this for initialization void Start () {

 }
 
 // Update is called once per frame
 void Update () {
     if (Input.GetKeyDown(KeyCode.M)) {
     
         Hat2.GetComponent<PhotonView> ().RPC ("MakeVisible", PhotonTargets.All);
     
     }
 }

}

This type of script will go on each object and the one above will call all the RPCs, I am using an input function as an easy way to test if it works

 using UnityEngine;
 using System.Collections;
 
 public class Hat2 : MonoBehaviour {
 
     // Use this for initialization
     void Start () {
 
     }
     
     // Update is called once per frame
     [PunRPC]
     void MakeVisible(){
         if (gameObject.layer == 8) {
 
             gameObject.layer = 1;
         
         }
     
         else {
         
             gameObject.layer = 8;
         
         }
     }
 }