Yes the amniotic fluid replenishes. So much so that my wife had to have some removed twice during her pregnancy with our youngest. The way they do that is exactly how you’d think. They stick a really long needle through your stomach and drain it. Fun times. I just had to watch and hold my wife’s hand but I’d just as soon never witnesses something like that again.