Process are aborting

chethan4046 · September 25, 2023, 7:04am

Version: 8.0.31-23.2

Error


2023-09-23T07:30:36.070920Z 30 [Note] [MY-000000] [Galera] after_statement: success(30,exec,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.070927Z 30 [Note] [MY-000000] [Galera] after_command_before_result: enter(30,exec,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.070934Z 30 [Note] [MY-000000] [Galera] after_command_before_result: leave(30,result,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.070988Z 30 [Note] [MY-000000] [Galera] after_command_after_result_enter(30,result,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.070997Z 30 [Note] [MY-000000] [Galera] after_command_after_result: leave(30,idle,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.501793Z 11727 [Note] [MY-000000] [Galera] before_command: enter(11727,idle,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.501847Z 11727 [Note] [MY-000000] [Galera] before_command: success(11727,exec,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.502069Z 11727 [Note] [MY-000000] [Galera] start_transaction enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.502096Z 11727 [Note] [MY-000000] [Galera] start_transaction success
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506185Z 11727 [Note] [MY-000000] [Galera] before_rollback_enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506221Z 11727 [Note] [MY-000000] [Galera] client: 11727 txc: 143485884 state: executing -> aborting
2023-09-23T07:30:36.506237Z 11727 [Note] [MY-000000] [Galera] before_rollback_leave
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: aborting, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506250Z 11727 [Note] [MY-000000] [Galera] after_rollback_enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: aborting, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506260Z 11727 [Note] [MY-000000] [Galera] client: 11727 txc: 143485884 state: aborting -> aborted
2023-09-23T07:30:36.506277Z 11727 [Note] [MY-000000] [Galera] after_rollback_leave
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506288Z 11727 [Note] [MY-000000] [Galera] after_statement: enter(11727,exec,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.506303Z 11727 [Note] [MY-000000] [Galera] after_statement_enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506318Z 11727 [Note] [MY-000000] [Galera] cleanup_enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: 143485884, seqno: -1, flags: 1
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506333Z 11727 [Note] [MY-000000] [Galera] cleanup_leave
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506347Z 11727 [Note] [MY-000000] [Galera] after_statement_leave
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506356Z 11727 [Note] [MY-000000] [Galera] after_statement: success(11727,exec,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.506381Z 11727 [Note] [MY-000000] [Galera] after_statement: enter(11727,exec,local,success,0,toi: -1,nbo: -1)
2023-09-23T07:30:36.506395Z 11727 [Note] [MY-000000] [Galera] after_statement_enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506409Z 11727 [Note] [MY-000000] [Galera] cleanup_enter
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506422Z 11727 [Note] [MY-000000] [Galera] cleanup_leave
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700
2023-09-23T07:30:36.506435Z 11727 [Note] [MY-000000] [Galera] after_statement_leave
    server: bea1db29-f12f-11ed-afd4-36799570b242, client: 11727, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7fdb7c6e0700

chethan4046 · September 26, 2023, 6:10pm

@Kamil_Holubicki @Mauricio_Cacho Can you help me on this

Kamil_Holubicki · September 27, 2023, 7:07am

Hi @chethan4046 ,
I’m not sure what kind of help is needed. The log shows the transaction being aborted. Something crashes or stuck or works in an unexpected way after this?
Could you provide a wider context?

chethan4046 · September 27, 2023, 7:45am

@Kamil_Holubicki I am not sure why transaction being aborted, logs keep filling up the disk,
Currently works in an unexpected way, But i wan a know root cause of this issue,
Seems some vector connection is failing due to aborted might be, This connection failing causing disk issue in k8s cluster

Kamil_Holubicki · September 27, 2023, 7:55am

Please add wsrep_log_conflicts=1 in your my.cnf and collect the log again. It should give some insights into what transactions are being aborted.

chethan4046 · September 27, 2023, 9:43am

Thanks will check @Kamil_Holubicki

chethan4046 · October 20, 2023, 8:02am

@Kamil_Holubicki Added wsrep_log_conflicts=1 But still not showing proper error,
FYI when i enabled wsrep_debug=1 above error is not showing.

Kamil_Holubicki · October 20, 2023, 10:13am

Hi @chethan4046 ,
Sorry, but I still don’t understand what kind of help you need. I don’t see any error in your log. I need a wider context:

What is the scenario (steps to reproduce)
What leads you to the conclusion that something is wrong?
What do you expect to be the proper behavior?

chethan4046 · October 20, 2023, 11:00am

@Kamil_Holubicki

I am running PXC operator:1.12.0 and PXC cluster:8.0.31-23.2 In my k8s cluster. with below config

[mysqld]
secure_file_priv=""
local-infile=1
wsrep_debug=CLIENT
wsrep_log_conflicts=1
debug=d
wsrep_provider_options="gcache.size=1G; gcache.recover=yes"
max_connections=2048
pxc_strict_mode=DISABLED
[sst]
xbstream-opts=--decompress
[xtrabackup]
compress=lz4

I am getting below error in pxccluster-pxc-1

    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.509080Z 1597 [Note] [MY-000000] [Galera] start_transaction success
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510357Z 1597 [Note] [MY-000000] [Galera] before_rollback_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510401Z 1597 [Note] [MY-000000] [Galera] client: 1597 txc: 7238 state: executing -> aborting
2023-10-20T10:53:53.510418Z 1597 [Note] [MY-000000] [Galera] before_rollback_leave
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: aborting, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510434Z 1597 [Note] [MY-000000] [Galera] after_rollback_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: aborting, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510457Z 1597 [Note] [MY-000000] [Galera] client: 1597 txc: 7238 state: aborting -> aborted
2023-10-20T10:53:53.510472Z 1597 [Note] [MY-000000] [Galera] after_rollback_leave
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510494Z 1597 [Note] [MY-000000] [Galera] after_statement: enter(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510508Z 1597 [Note] [MY-000000] [Galera] after_statement_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510524Z 1597 [Note] [MY-000000] [Galera] cleanup_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: 7238, seqno: -1, flags: 1
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510549Z 1597 [Note] [MY-000000] [Galera] cleanup_leave
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510563Z 1597 [Note] [MY-000000] [Galera] after_statement_leave
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510585Z 1597 [Note] [MY-000000] [Galera] after_statement: success(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510603Z 1597 [Note] [MY-000000] [Galera] after_statement: enter(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510618Z 1597 [Note] [MY-000000] [Galera] after_statement_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510642Z 1597 [Note] [MY-000000] [Galera] cleanup_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510658Z 1597 [Note] [MY-000000] [Galera] cleanup_leave
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510682Z 1597 [Note] [MY-000000] [Galera] after_statement_leave
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1597, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: aborted, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8407700
2023-10-20T10:53:53.510693Z 1597 [Note] [MY-000000] [Galera] after_statement: success(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510706Z 1597 [Note] [MY-000000] [Galera] after_command_before_result: enter(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510717Z 1597 [Note] [MY-000000] [Galera] after_command_before_result: leave(1597,result,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510798Z 1597 [Note] [MY-000000] [Galera] after_command_after_result_enter(1597,result,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510821Z 1597 [Note] [MY-000000] [Galera] after_command_after_result: leave(1597,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.510973Z 1597 [Note] [MY-000000] [Galera] before_command: enter(1597,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511000Z 1597 [Note] [MY-000000] [Galera] before_command: success(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511014Z 1597 [Note] [MY-000000] [Galera] after_command_before_result: enter(1597,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511026Z 1597 [Note] [MY-000000] [Galera] after_command_before_result: leave(1597,result,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511044Z 1597 [Note] [MY-000000] [Galera] after_command_after_result_enter(1597,result,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511056Z 1597 [Note] [MY-000000] [Galera] after_command_after_result: leave(1597,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511070Z 1597 [Note] [MY-000000] [Galera] close: enter(1597,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511081Z 1597 [Note] [MY-000000] [Galera] Disabling streaming
2023-10-20T10:53:53.511097Z 1597 [Note] [MY-000000] [Galera] close: leave(1597,quit,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511222Z 1597 [Note] [MY-000000] [Galera] cleanup: enter(1597,quit,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:53:53.511247Z 1597 [Note] [MY-000000] [Galera] cleanup: leave(1597,none,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508281Z 1598 [Note] [MY-000000] [Galera] open: enter(0,none,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508334Z 1598 [Note] [MY-000000] [Galera] open: leave(1598,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508441Z 1598 [Note] [MY-000000] [Galera] before_command: enter(1598,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508470Z 1598 [Note] [MY-000000] [Galera] before_command: success(1598,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508578Z 1598 [Note] [MY-000000] [Galera] after_statement: enter(1598,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508617Z 1598 [Note] [MY-000000] [Galera] after_statement_enter
    server: 00000000-0000-0000-0000-000000000000, client: 1598, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8509700
2023-10-20T10:54:03.508689Z 1598 [Note] [MY-000000] [Galera] after_statement_leave
    server: 00000000-0000-0000-0000-000000000000, client: 1598, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8509700
2023-10-20T10:54:03.508707Z 1598 [Note] [MY-000000] [Galera] after_statement: success(1598,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508719Z 1598 [Note] [MY-000000] [Galera] after_command_before_result: enter(1598,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508730Z 1598 [Note] [MY-000000] [Galera] after_command_before_result: leave(1598,result,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508808Z 1598 [Note] [MY-000000] [Galera] after_command_after_result_enter(1598,result,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.508827Z 1598 [Note] [MY-000000] [Galera] after_command_after_result: leave(1598,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.509062Z 1598 [Note] [MY-000000] [Galera] before_command: enter(1598,idle,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.509098Z 1598 [Note] [MY-000000] [Galera] before_command: success(1598,exec,local,success,0,toi: -1,nbo: -1)
2023-10-20T10:54:03.509171Z 1598 [Note] [MY-000000] [Galera] start_transaction enter
    server: 00000000-0000-0000-0000-000000000000, client: 1598, state: exec, mode: local
    trx_id: -1, seqno: -1, flags: 0
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8509700
2023-10-20T10:54:03.509190Z 1598 [Note] [MY-000000] [Galera] start_transaction success
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1598, state: exec, mode: local
    trx_id: 7241, seqno: -1, flags: 1
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0
    own: 1 thread_id: 7f7ba8509700
2023-10-20T10:54:03.509241Z 1598 [Note] [MY-000000] [Galera] before_rollback_enter
    server: bcd48cd3-6f18-11ee-96a0-ef15e662027a, client: 1598, state: exec, mode: local
    trx_id: 7241, seqno: -1, flags: 1
    state: executing, bfa_state: executing, error: success, status: 0
    is_sr: 0, frags: 0, frags size: 0, unit: 0, size: 0, counter: 0, log_pos: 0, sr_rb: 0```

Note: Based on seeing log aborting -> aborted This message conclusion that something is wrong
and some zombi process are creating in k8s node level, Making resource unavailable.
I am expecting no aborting -> aborted message in logs or need to know proper reason for process aborted

Kamil_Holubicki · October 20, 2023, 11:44am

This log says that the transaction was aborted, not the process (in the meaning of Linux process). Transaction aborts in PXC are something normal.
After this log, does the cluster behave in normal way, or something is blocked, you can’t connect to some node?
If you want to see more details about transaction which was aborted, please set wsrep_log_conflicts=1.
Please set wsrep_debug=1 (or SERVER).
If that still does not give any clues (details about aborted transactions are not printed) I would need detailed steps to reproduce the situation to say something more.

Any reason for having pxc_strict_mode=DISABLED?

chethan4046 · October 20, 2023, 8:09pm

@Kamil_Holubicki
After this log cluster behave in normal way
And i have added wsrep_log_conflicts=1 and wsrep_debug=SERVER
Now no such error in log.

Might be those error message coming for client connection closes, Because I was enabled wsrep_debug=ClIENT, When every query completed client connection were closed.

No just like that I have DISABLED pxc_strict_mode, Is it problematic ?, Which is the standard mode i need to add.
DISABLED
PERMISSIVE
ENFORCING
MASTER

Is there any config i need to update for stop creating zombi process from PXC.

Kamil_Holubicki · October 30, 2023, 1:00pm

What do you mean by “zombi processes from PXC”?