Most of the time no, especially if the voice is similar, but if its an extreme change or the voice is too characteristic of the character than it might be. But take subbing vs dubbing as an example. The voices are almost always different but they are still the same character but there are some I imagine that it might be the case. Like many other things, it depends

Depends if the replacement carries the same personality in their voice. Sometimes a new VA doesnt capture the charm of the character well. A huge example that makes me pick depends is the voice actor for Ratchet from the Ratchet and Clank game series. The voice actor is different from the very first game and it absolutely improved on the likability of the character. The original voice was good but the replacement was a big improvement.
There are examples for both sides though. It just truly depends.

Depends how the new voice actor as the replacement bring the similar vibes in his/her voice just like the old voice actor did.

Especially if they change after a really long time.

Acxa almoat had me picking no but then I remembered Icy from Winx and my mind changed in a flash. With Acxa the feeling of her character remained the same but because the change was rather subtle. She still had a soothing, intelligent vibe. With Icy the change in the voice was so drastic that it completely changed the atmosphere of her character. It went from deep and intimidating and mature to literal Mean Girls style high school bully voice. Combined with a new art style she's practically a different character and I actually don't like her. And that's saying something because I NEVER (until then) stopped liking a character I obsessed over.