WiredTiger configuration, file_manager

MongoDB Percona Operator for MongoDB
1

With Percona image percona/percona-server-mongodb:4.4.3-5 the file manager has the following config

file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250)

So after 27.7h it starts to release the file handles and with a regular HDD the livenessprobe gets a timeout because the HDD is clogged up with closing the files. Therfore I want to avoid that or reduce the amount of open files.

According to

https://jira.mongodb.org/browse/SERVER-31155

This should be possible but it seems on Percona it has no effect

    engineConfig:
        configString: "file_manager=(close_handle_minimum=20000,close_idle_time=3600,close_scan_interval=60)"

Thanks
John

1 Like
2

Hello John,

if you run v 1.9 of our Operator then you should be able to customize mongod/mongos parameters through spec.replsets..configuration. See more here:

engineConfig.configString is not supported in our Operator.

1 Like
3

Thanks @Sergey_Pronin … it looks like the values get accepted:

  replsets:
...
    configuration: |
      storage:
        wiredTiger:
          engineConfig:
            configString: "file_manager=(close_idle_time=30,close_scan_interval=30,close_handle_minimum=100)"

In the log file we have the file_manager settings in 3 places. So which is now valid ?

{“t”:{“$date”:“2021-07-27T16:13:08.921+00:00”},“s”:“I”, “c”:“CONTROL”, “id”:21951, “ctx”:“initandlisten”,“msg”:“Options set by command line”,“attr”:{“options”:{“config”:“/etc/mongodb-config/mongod.conf”,“net”:{“bindIp”:“*”,“port”:27017,“tls”:{“CAFile”:“/etc/mongodb-ssl/ca.crt”,“allowInvalidCertificates”:true,“certificateKeyFile”:“/tmp/tls.pem”,“clusterCAFile”:“/etc/mongodb-ssl-internal/ca.crt”,“clusterFile”:“/tmp/tls-internal.pem”,“mode”:“preferTLS”}},“operationProfiling”:{“mode”:“slowOp”,“rateLimit”:100,“slowOpThresholdMs”:100},“replication”:{“replSet”:“rs01”},“security”:{“authorization”:“enabled”,“clusterAuthMode”:“x509”,“enableEncryption”:true,“encryptionCipherMode”:“AES256-CBC”,“encryptionKeyFile”:“/etc/mongodb-encryption/encryption-key”,“relaxPermChecks”:true},“setParameter”:{“ttlMonitorSleepSecs”:“60”,“wiredTigerConcurrentReadTransactions”:“128”,“wiredTigerConcurrentWriteTransactions”:“128”},“sharding”:{“clusterRole”:“shardsvr”},“storage”:{“dbPath”:“/data/db”,“engine”:“wiredTiger”,“wiredTiger”:{“collectionConfig”:{“blockCompressor”:“snappy”},“engineConfig”:{“cacheSizeGB”:3.23,“configString”:“file_manager=(close_idle_time=30,close_scan_interval=30,close_handle_minimum=100)”,“journalCompressor”:“snappy”},“indexConfig”:{“prefixCompression”:true}}}}}}

{“t”:{“$date”:“2021-07-27T16:13:09.602+00:00”},“s”:“I”, “c”:“STORAGE”, “id”:22315, “ctx”:“initandlisten”,“msg”:“Opening WiredTiger”,“attr”:{“config”:“create,cache_size=3307M,session_max=33000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000,close_scan_interval=10,close_handle_minimum=250),statistics_log=(wait=0),verbose=[recovery_progress,checkpoint_progress,compact_progress],encryption=(name=percona,keyid="/default"),extensions=[local=(entry=percona_encryption_extension_init,early_load=true,config=(cipher=AES256-CBC)),],file_manager=(close_idle_time=30,close_scan_interval=30,close_handle_minimum=100)”}}

1 Like