# Bayesian Classifiers, Forum Moderation and Discourse

**URL:** <https://community.unix.com/t/bayesian-classifiers-forum-moderation-and-discourse/380324>\
**Category:** Discourse System Administration\
**Created:** [October 10, 2020, 2:46am UTC](https://community.unix.com/t/bayesian-classifiers-forum-moderation-and-discourse/380324 "2020-10-10T02:46:22Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Neo](https://community.unix.com/user_avatar/community.unix.com/neo/32/22838_2.png) [@Neo](https://community.unix.com/u/Neo)\
**Post date:** [October 10, 2020, 2:46am UTC](https://community.unix.com/t/bayesian-classifiers-forum-moderation-and-discourse/380324/1 "2020-10-10T02:46:23Z")

</div>

#### Question over at Meta Discourse

> [@](#):
>
> Hi everyone!
> 
> I’m a machine learning PhD and I’ve been thinking about building a tool to let anyone train a custom AI to help with content moderation on the discourse forums. Is this something that people here would want?
> 
> I know that there is the Google perspective API but its very generic. My idea is that you’d have a plugin where you can moderate posts and it automatically trains a text classifier to learn from your moderation. For example, if you mark a post as having toxic language or being off-topic it learns from you and can flag similar posts or even pre-moderate them.
> 
> What do you think?

#### Reply

Text classifiers (used in forums, for example) have been around for a long time.

Typically this type of text classification and scoring is performed with Bayesian classifiers.

If you do a Google search with keywords:

```plaintext
bayesian classifier ruby

```

and /or

```plaintext
bayesian classifier javascript

```

You will find myriad libraries and examples of text classification using Bayesian classifiers.

We have used various Bayesian classifiers for forum post moderation, spam detection, and more over the years; and have implemented custom code to train the classifier when moderators perform mod actions.

Hope this helps.

Reference:

> **[Custom AI Content Moderation](https://meta.discourse.org/t/custom-ai-content-moderation/166783/)**
>
> Hi everyone! I’m a machine learning PhD and I’ve been thinking about building a tool to let anyone train a custom AI to help with content moderation on the discourse forums. Is this something that people here would want? I know that there is the...
