# Creating a custom stoplist from actual data

**URL:** <https://forums.percona.com/t/creating-a-custom-stoplist-from-actual-data/2076>\
**Category:** Sphinx & Full-Text Search\
**Created:** [October 16, 2008, 3:57am UTC](https://forums.percona.com/t/creating-a-custom-stoplist-from-actual-data/2076 "2008-10-16T03:57:17Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![myraz](https://avatars.discourse-cdn.com/v4/letter/m/258eb7/32.png) [@myraz](https://forums.percona.com/u/myraz)\
**Post date:** [October 16, 2008, 3:57am UTC](https://forums.percona.com/t/creating-a-custom-stoplist-from-actual-data/2076/1 "2008-10-16T03:57:17Z")

</div>

I have some huge fulltext indexes created using ft\_min\_wordlen=2 and no stoplist. The data is not english language so the default stoplist cannot be used.

I have this idea if you could ‘look’ at the current index (using a custom tool, a mysql patch or whatever) you should be able to determine what words would be good candidates in a custom stoplist. Would that make sense? Is it at all theoretically possible? If it is, and if someone would create that tool, I guess it would be of benefit for many users with non-english (but space delimited) data.

As a parenthesis, I did try having a perl script extract all words from the table (not the index) and count their frequencies. It works fine, but is very slow and dull. If my idea is doable, I picture it would be blazingly fast and usable on huge existing tables.

Ideas? Comments? Thanks.

---

<div class="post-metadata">

**Author:** ![xaprb](https://avatars.discourse-cdn.com/v4/letter/x/49beb7/32.png) [@xaprb](https://forums.percona.com/u/xaprb)\
**Post date:** [December 25, 2009, 7:03am UTC](https://forums.percona.com/t/creating-a-custom-stoplist-from-actual-data/2076/2 "2009-12-25T07:03:14Z")

</div>

Maybe you are looking for myisam\_ftdump.

---

<div class="post-metadata">

**Author:** ![myraz](https://avatars.discourse-cdn.com/v4/letter/m/258eb7/32.png) [@myraz](https://forums.percona.com/u/myraz)\
**Post date:** [December 25, 2009, 9:54am UTC](https://forums.percona.com/t/creating-a-custom-stoplist-from-actual-data/2076/3 "2009-12-25T09:54:46Z")

</div>

Doh, it was there all the time? Many thanks, my post was over a year ago but I still needed it!