# Error Pt-archival

**URL:** <https://forums.percona.com/t/error-pt-archival/30651>\
**Category:** Uncategorized\
**Tags:** percona\
**Created:** [May 28, 2024, 3:08pm UTC](https://forums.percona.com/t/error-pt-archival/30651 "2024-05-28T15:08:24Z")\
**Posts on this page:** 12\
**Page:** 1

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 28, 2024, 3:08pm UTC](https://forums.percona.com/t/error-pt-archival/30651/1 "2024-05-28T15:08:24Z")

</div>

Hi ,

We are getting below error during pt-archival of 1 table’s

Unicode non-character U+FFFF is illegal for open interchange at /bin/pt-archiver line 6923.

Kindly check and help for this

---

<div class="post-metadata">

**Author:** ![lalit.choudhary](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/lalit.choudhary/32/51_2.png) [@lalit.choudhary](https://forums.percona.com/u/lalit.choudhary)\
**Post date:** [May 30, 2024, 6:10am UTC](https://forums.percona.com/t/error-pt-archival/30651/2 "2024-05-30T06:10:09Z")

</div>

Hello @SumitKumar

Are you using the latest version of pt-archival ?  
What is the MySQL/PS version and charset of a table?

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 30, 2024, 7:02am UTC](https://forums.percona.com/t/error-pt-archival/30651/3 "2024-05-30T07:02:05Z")

</div>

Hi @lalit.choudhary

> > > Are you using the latest version of pt-archival ?  
> > > VERSION is pt-archiver 3.5.7

> > > > > What is the MySQL/PS version and charset of a table?  
> > > > > version: 8.0.22-commercial MySQL Enterprise Server - Commercial

Table charset – ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8\_unicode\_ci

Thanks

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 30, 2024, 8:26am UTC](https://forums.percona.com/t/error-pt-archival/30651/4 "2024-05-30T08:26:30Z")

</div>

@lalit.choudhary

Please update

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 31, 2024, 6:32am UTC](https://forums.percona.com/t/error-pt-archival/30651/5 "2024-05-31T06:32:33Z")

</div>

Hi  
Requesting…Can any one help for this ?

---

<div class="post-metadata">

**Author:** ![kedarpercona](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/kedarpercona/32/809_2.png) [@kedarpercona](https://forums.percona.com/u/kedarpercona)\
**Post date:** [May 31, 2024, 6:40am UTC](https://forums.percona.com/t/error-pt-archival/30651/6 "2024-05-31T06:40:44Z")

</div>

Hi @SumitKumar,

Let’s do a thing. Provide us your table definition and command; I’ll try to reproduce.  
We already know pt-archiver 3.5.7 and mysql 8.0.22

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 31, 2024, 6:46am UTC](https://forums.percona.com/t/error-pt-archival/30651/7 "2024-05-31T06:46:26Z")

</div>

@kedarpercona Please check below as requested

Table Definition 👎

Create Table: CREATE TABLE `od_audit` (  
`AUDIT_ID` varchar(32) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`EVENT_ID` int NOT NULL,  
`APP_SERVER` varchar(20) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`CLIENT_IP_ADDR` varchar(50) COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`WEB_SERVER` varchar(20) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`AUDIT_DATE` datetime NOT NULL,  
`REFERENCE` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`SESSION_ID` varchar(150) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`OD_LOGIN_ID` varchar(120) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`USER_NO` varchar(120) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`OD_GCIF` varchar(120) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`OD_PARENT_GCIF` varchar(120) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`SIMULATION_MODE` varchar(1) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`CHANNEL` varchar(20) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci NOT NULL,  
`BROWSER_NAME` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`AUDIT_DATA` longtext COLLATE utf8\_unicode\_ci,  
`DSA_DATA` text CHARACTER SET utf8 COLLATE utf8\_unicode\_ci,  
`DEVICE_BAND_ID` varchar(10) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`USER_AGENT` varchar(500) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`WORKSPACE_ID` varchar(50) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`LAYOUT_ID` varchar(50) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`WIDGET_ID` varchar(50) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`GEO_LOCATION` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`REQUEST_ID` varchar(45) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`REQUEST_URI` varchar(256) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`REFERENCE_KEY` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF1` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF2` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF3` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF4` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF5` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF6` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF7` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF8` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF9` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
`UDF10` varchar(100) CHARACTER SET utf8 COLLATE utf8\_unicode\_ci DEFAULT NULL,  
PRIMARY KEY (`AUDIT_ID`),  
UNIQUE KEY `SYS_C008745` (`AUDIT_ID`),  
KEY `OD_AUDIT_IDX4` (`USER_NO`,`SESSION_ID`,`OD_GCIF`),  
KEY `OD_AUDIT_IDX2` (`OD_GCIF`,`EVENT_ID`,`AUDIT_DATE`),  
KEY `OD_AUDIT_IDX3` (`OD_GCIF`,`OD_LOGIN_ID`,`EVENT_ID`,`AUDIT_DATE`),  
KEY `OD_AUDIT_TRAIL_IDX1` (`REFERENCE`)  
) ENGINE=InnoDB DEFAULT CHARSET=utf8 COLLATE=utf8\_unicode\_ci  
1 row in set (0.00 sec)

Command is:-

TABLE=od\_audit  
pt-archiver --source h=localhost,u=$USERNAME,p=$PASSWORD,D=$DATABASE,t=$TABLE --where ‘AUDIT\_DATE \< now()’ --no-check-charset --limit=5000 --commit-each --file ${ARCHIVAL\_PATH}/%Y-%m-%d-%D.%t 2\>\> $LOGPATH/arch\_cp.err  
RETURN\_STATUS1=$?  
status\_check

---

<div class="post-metadata">

**Author:** ![kedarpercona](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/kedarpercona/32/809_2.png) [@kedarpercona](https://forums.percona.com/u/kedarpercona)\
**Post date:** [May 31, 2024, 9:49am UTC](https://forums.percona.com/t/error-pt-archival/30651/8 "2024-05-31T09:49:25Z")

</div>

Had a quick test and you rcommand is ok. The place where it appears to have stuck or “erroring” appears to be complaining about the data it is processing.  
`Unicode non-character U+FFFF is illegal for open interchange` - Your data appears to have these non-character data included causing the archiver to fail. Is it possible to clean your data from such special characters?

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 31, 2024, 10:49am UTC](https://forums.percona.com/t/error-pt-archival/30651/9 "2024-05-31T10:49:01Z")

</div>

Hi @kedarpercona ,

How we find these special character and clean ?

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 31, 2024, 5:58pm UTC](https://forums.percona.com/t/error-pt-archival/30651/10 "2024-05-31T17:58:34Z")

</div>

Hi Team,

> > > > Is it possible to clean your data from such special characters?  
> > > > We can can change manually such type character from the tables , any other solution please help ?

---

<div class="post-metadata">

**Author:** ![SumitKumar](https://avatars.discourse-cdn.com/v4/letter/s/b77776/32.png) [@SumitKumar](https://forums.percona.com/u/SumitKumar)\
**Post date:** [May 31, 2024, 6:02pm UTC](https://forums.percona.com/t/error-pt-archival/30651/11 "2024-05-31T18:02:36Z")

</div>

Ignore above comment

Is it possible to clean your data from such special characters?  
We can not change manually such type character from the tables , any other solution please help ?

---

<div class="post-metadata">

**Author:** ![kedarpercona](https://sea1.discourse-cdn.com/flex019/user_avatar/forums.percona.com/kedarpercona/32/809_2.png) [@kedarpercona](https://forums.percona.com/u/kedarpercona)\
**Post date:** [June 7, 2024, 3:53am UTC](https://forums.percona.com/t/error-pt-archival/30651/12 "2024-06-07T03:53:23Z")

</div>

So did this work for you: [PT- Archiver Error - #7 by SumitKumar](https://forums.percona.com/t/pt-archiver-error/30482/7)
