Based on my experience, this is better put into the Settings -> Customizability dialogue, not Memories

Another user mentioned how it will reference the very instruction ("I know you would prefer concise answers, so here's a concise answer..") but that makes sense when you realize that Memories are more for things like "user lives in San Francisco and is new in town and is open to recommendations of third places to meet people" so if it's answering the question about the best coffee places in n SF, it would make sense for ChatGPT to finish with "Also, given that you are new to San Francisco, and your interest in both boardgames and meeting new people, have you considered visiting [place]? It's a local coffee shop that also rents out board games, with a Thursday evening theme where you are partnered with strangers. It might be a good way to make new people that enjoy similar things!"

If you consider adding Memories us adding something to the system prompt, it won't make very much sense a lot of the time, because you might forget what you wrote and then be surprised when your model suddenly suggests jigsaw puzzles when you mentioned that you're stressed building a compiler. Hence it tells the user the context of the memory that it's using and why, whereas if you added to Customizability I've never seen it leak out like that.

If you add to Memories "user is a software engineer and prefers Rust to C/C++" it may say something like "By the way, since you prefer Rust I would recommend [this development path]" but if you put it into Customizability as "do not suggest C/C++ for software projects unless it's the only way, use Rust or Go instead" it will likely start down the path of suggesting and researching Rust from the very beginning without explaining to you your own instructions.

Basically, what I'm trying to say is that the Customizability instructions (mine say "be concise, do not be afraid to correct the user or use occasional dry humor. Speak frankly and tell the user if they may be making a mistake and suggest other courses of action" whereas Memories contain simple facts about me, i e. ("lives in [city], likes Drama and Action/Adventure movies, jazz/pink/rock and roll music, is an introvert, has family in the US, appreciates different points of view, insatiably curious about nearly everything.")

Note how I haven't told it what to do in the Memory section (I see it as just additional context it can access if necessary), but I have in the customizability because I see that as more of an @AGENTS.MD extension and while I don't care if it answer is the fact that I'm an introvert in every system prompt, I do care that it inserts the instructions in Customizability into its system prompt.

Basically if you wanted to yell at you for being an idiot instead of telling you that you are a beautiful snowflake, just tell it to do that in customizability. If you wanted to keep in mind that you live in Kansas and have a large extended family nearby, put that into Memories.

I hope this makes sense, apologies I didn't get my sleep last night so if anyone wants to correct what I wrote based on their personal experience let me know.

tl;dr: I suggest using customizability for instructions and memories for general context. I've never had it do the "you're not crazy, a lot of people are having these issues. Let's work through them together.." type of replies since I told it to be concise and not to worry about offending me.