I finally found a way to achieve my need.
On Aurora, you can create custom endpoints which will not change even if you rename the cluster.
Then you can use it as your proxy target.
Be aware if you create the endpoint through API, you cannot setup it to attach future started instances and so it can’t works with readers auto scaling. However you can setup it through the AWS Console.