How to make a game object ONLY to appear in game startup?

I want my game object to appear only in game startup in my menu. But what happens is, during game play, when you go back to the menu, the game object appears again (which is not what I want). Could you guys help me how to fix this.

You can just do

bool IsStartup;
public GameObject yourGameObject;

if (//you can put here when the button is clicked or key is down)
{IsStartup = true}
if (IsStartup == true)
{Destroy(yourGameObject)}