Assume we are living in a simulation, as Scott Adams and Elon Musk believe.
If you're authoring our simulation then you don't much care where memories are stored, because we assume you're either running the simulation to learn something or for entertainment (or both), and one assumes you only care about results. As Elon Musk says (from his simulation viewpoint), "Most entertaining outcome is most likely". In fact, it might be an optimization to kill off actors, with just their external impact remembered by other actors in the simulation. That would free up a lot of memory and possibly remove useless detail.
However, as an actor in the simulation, I do care about my memories, because they are my identity. And I've been programmed to want to keep my identity. Okay, there are some things I would rather forget. But generally I like my own sense of continuity. It's what makes me, me.
(The "Ship of Theseus" question as to whether a boat that has gradually had all of the parts replaced is the same boat - yes, it's the same boat! This is called the "Continuity View" but there are other views. But they are wrong. At least for purposes of this discussion.)
So, as a game developer, who has worked in offline and online worlds for 35 years, I am somewhat familiar with what it means to run a simulation. And one of the key factors that Scott Adams and Elon Musk have left out (as far as I can tell) is the importance of the SAVE FILE. When I hear someone talk about living in the simulation (and quite typically in books like "Fall; or, Dodge in Hell" by Neal Stephenson) they just assume the simulation is like physics - one thing leads to the next thing.
But that need not be the case.
For one thing, time might literally be an illusion, in that our life as actors in the simulation might be time-sliced with everyone else. Maybe we're only simulating ourselves 1/100th of the time; and 99/100s of the time we're "off". (In most game simulations the time spent on or off is variable depending on load (i.e., number of things being simulated)). You could be turned off for a couple of minutes - and maybe you experience it as daydreaming - random thoughts that have nothing to do with your purpose in life. It would be a cover story - and you don't even need to be in a running state for daydreaming. All that's required is when you are unpaused, a memory of daydreaming is dropped in to cover the time. Obviously sleeping could be a much bigger version of this! But it's worse (or better!): you could be turned off for a full day and not know it, and then have a vague memory of being sick planted in your mind to cover the missing time.
And while you are paused - your save file could be edited. There is nothing that requires the simulation of all these actors to be consistent. If it matters, for some purpose of the simulation, then a "rendezvous" (in Ada language) or a "channel" (in Golang language) could be set up to trade some state to improve consistency. Maybe these are created automatically when two actors are physically close to each other. Most of the rest of our information about NEARLY EVERYTHING is hearsay.
So the past could be an illusion as well. Just as some fundamentalist Christians believe the entire world was made 8,000 years ago, complete with dinosaur bones embedded in the Earth, so too, our life, as we know it, might have started 10 milliseconds ago, with our own history and sense of continuity restored from a modified save file.
So ...
What was I saying?