Thanks for replying Barret. We are trying out clickhouse at the moment as the log storage purely for enhanced performance. We will be using inotify to monitor the percona log and then use a python script to load the data to clickhouse. The idea comes from one of Percona’s blogs which mentions clicktail and clickhouse but unfortunately clicktail doesnt seem to be in development anymore. I am just noting this down here as a possible implementation for anyone else who may be going down the route that we are. Logstash and ELK as a whole also looks good.