September 10, 2015

Building Profanity Filters: clbuttic sh!t

My name is Anastasiia. Recently I have shared our experience in creating profanity filters in mobile apps and described the evolution of the filter rules.

IT-Saturday, @vixentael
IT-Saturday, @vixentael

The built-in profanity filter is not a popular feature in the mobile apps. We’re developing an application that cares about users really much: users shouldn’t see any offensive texts there. But checking every post by a live moderator takes a lot of time and reduces the application responsiveness.

We’ve created a “live” filter inside the app that is completely invisible, as long as the user’s text does not contain offensive words. If the filter finds something rude, it gently hints user about wicked content.
Of course, every filter can be broken, so, in addition, the app has ‘flag abuse’ feature for users to mark inappropriate content.

Creating profanity filter is quite interesting and tricky task. We found lots of corner cases and learned many dirty words 🙂

I described the evolution of the filter rules in my slides with examples and live filter demo.

Attention! 18+. Lot of dirty words below:)