open-source-search-engine

gigablast/open-source-search-engine

Fork 0

mirror of https://github.com/gigablast/open-source-search-engine.git synced 2024-10-04 20:27:43 +03:00

Commit Graph

Author	SHA1	Message	Date
mwells	92413001fb	dirty word detector revisions. we need a word-based function, isDirtyWord() which IDs single words, bigrams and trigrams. it'll be much faster than the current approach and won't slow down when the list of dirty words gets big. we then need isDirtyUrl() to use the logic in Speller.cpp to split a url up into composing words to run through isDirtyWord().	2013-10-16 20:19:49 -07:00
mwells	6052f60c48	speed up dirty word detection since we added a bunch of new dirty words/phrases.	2013-10-15 22:41:31 -07:00
Matt Wells	c911a606c9	renamed matches.h and matches.cpp to matches2.h and matches2.cpp to avoid potential confusion with Matches.h and Matches.cpp files.	2013-10-01 07:58:24 -07:00

Author

SHA1

Message

Date

mwells

92413001fb

dirty word detector revisions. we need

a word-based function, isDirtyWord()
which IDs single words, bigrams and trigrams.
it'll be much faster than the current approach
and won't slow down when the list of dirty
words gets big. we then need isDirtyUrl() to
use the logic in Speller.cpp to split
a url up into composing words to run through
isDirtyWord().

2013-10-16 20:19:49 -07:00

mwells

6052f60c48

speed up dirty word detection since we added a bunch

of new dirty words/phrases.

2013-10-15 22:41:31 -07:00

Matt Wells

c911a606c9

renamed matches.h and matches.cpp to

matches2.h and matches2.cpp to avoid potential
confusion with Matches.h and Matches.cpp files.

2013-10-01 07:58:24 -07:00

3 Commits