gigablast/open-source-search-engine
1
0
Fork 0
mirror of https://github.com/gigablast/open-source-search-engine.git synced 2024-10-04 04:07:13 +03:00
Code Issues Projects Releases Wiki Activity
Nov 20 2017 -- A distributed open source search engine and spider/crawler written in C/C++ for Linux on Intel/AMD. From gigablast dot com, which has binaries for download. See the README.md file at the very bottom of this page for instructions.
2,370 Commits 3 Branches 0 Tags 222 MiB
C++ 96.7%
HTML 1.4%
C 1.2%
Python 0.5%
Makefile 0.1%
e7dd8f7956
Go to file
Matt Wells e7dd8f7956 replace long long with int64_t
2014-10-30 13:36:39 -06:00
antiword-dir Initial file population. 2013-08-02 13:12:24 -07:00
diffbot-widget widget updates 2014-04-21 09:21:28 -07:00
html more updates to cloud code 2014-09-29 18:28:36 -07:00
openssl we already include our own 32-bit 2013-09-15 18:25:49 -06:00
ucdata Initial file population. 2013-08-02 13:12:24 -07:00
Abbreviations.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Abbreviations.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Accessdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Accessdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Address.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Address.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
addtest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Ads.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Ads.h move CollectionRec stuff into Collectiondb files 2013-12-10 15:28:04 -08:00
AdultBit.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
AdultBit.h Initial file population. 2013-08-02 13:12:24 -07:00
animate.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
antiword fix ulimit and antiword bugs 2014-06-18 04:06:20 -07:00
AutoBan.cpp fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
AutoBan.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
badcattable.dat Initial file population. 2013-08-02 13:12:24 -07:00
BigFile.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
BigFile.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Bits.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Bits.h Initial file population. 2013-08-02 13:12:24 -07:00
blaster2.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Blaster.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Blaster.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
bmptopnm Initial file population. 2013-08-02 13:12:24 -07:00
Cachedb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Cachedb.h Initial file population. 2013-08-02 13:12:24 -07:00
camsort.cpp Initial file population. 2013-08-02 13:12:24 -07:00
catcountry.dat Initial file population. 2013-08-02 13:12:24 -07:00
Catdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Catdb.h move CollectionRec stuff into Collectiondb files 2013-12-10 15:28:04 -08:00
Categories.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Categories.h documentation updates. fixed sd=0. 2013-10-13 14:24:41 -07:00
CatRec.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
CatRec.h Initial file population. 2013-08-02 13:12:24 -07:00
changelog version update 2014-09-26 08:52:09 -06:00
character-sets Initial file population. 2013-08-02 13:12:24 -07:00
check_unicode.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Clusterdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Clusterdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Collectiondb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Collectiondb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Conf.cpp fix gblocal.conf bug 2014-10-06 21:35:54 -07:00
Conf.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
control.deb package bldg updates 2014-06-16 21:50:32 -06:00
convert.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
copyright.head package bldg updates 2014-06-16 21:50:32 -06:00
copyright.tail package bldg updates 2014-06-16 21:50:32 -06:00
CountryCode.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
CountryCode.h fix pagecrawlbot.cpp to support &c=token-name. 2014-01-22 23:40:38 -08:00
create_ucd_tables.cpp Initial file population. 2013-08-02 13:12:24 -07:00
DailyMerge.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
DailyMerge.h move CollectionRec stuff into Collectiondb files 2013-12-10 15:28:04 -08:00
DataFeed.cpp Initial file population. 2013-08-02 13:12:24 -07:00
DataFeed.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Datedb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Datedb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Dates.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Dates.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Diff.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Diff.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Dir.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Dir.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
DiskPageCache.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
DiskPageCache.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
dlstubs.c Initial file population. 2013-08-02 13:12:24 -07:00
dmozparse.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Dns.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Dns.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
DnsProtocol.h fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
dnstest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Domains.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Domains.h Initial file population. 2013-08-02 13:12:24 -07:00
dumpcore.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Entities.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Entities.h Initial file population. 2013-08-02 13:12:24 -07:00
Errno.cpp rename admin.html to faq.html etc. file juggling. 2014-08-31 09:51:21 -07:00
Errno.h Merge branch 'testing' into diffbot-matt 2014-07-10 10:06:55 -07:00
errnotest.cpp errno test update 2013-11-19 00:10:10 -07:00
Events.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Facebook.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Facebook.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
fastIndexTable.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
fctypes.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
fctypes.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
File.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
File.h tons of changes from live github on neo. 2014-01-17 21:01:43 -08:00
filterquerylogs.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
Flags.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Flags.h Initial file population. 2013-08-02 13:12:24 -07:00
gb-1.0.spec make it so we don't need --nodeps with 2014-05-25 22:08:46 -04:00
gb-include.h compiler cleanups for cygwin compile 2014-06-07 14:20:04 -07:00
gb.deb.rules if netpbm pkg already installed use it. 2014-07-06 09:54:28 -07:00
gb.pem so we have spider https sites add 2013-10-13 00:15:39 -07:00
gbfilter.cpp Initial file population. 2013-08-02 13:12:24 -07:00
gbtitletest.cpp Initial file population. 2013-08-02 13:12:24 -07:00
geneaology.cpp Initial file population. 2013-08-02 13:12:24 -07:00
generateSuperMergeCode.cpp Initial file population. 2013-08-02 13:12:24 -07:00
geo_ip_table.cpp Initial file population. 2013-08-02 13:12:24 -07:00
geo_ip_table.h Initial file population. 2013-08-02 13:12:24 -07:00
GeoIP_internal.h Initial file population. 2013-08-02 13:12:24 -07:00
GeoIP.c Initial file population. 2013-08-02 13:12:24 -07:00
GeoIP.h Initial file population. 2013-08-02 13:12:24 -07:00
GeoIPCity.c Initial file population. 2013-08-02 13:12:24 -07:00
GeoIPCity.h Initial file population. 2013-08-02 13:12:24 -07:00
getsample.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
giftopnm Initial file population. 2013-08-02 13:12:24 -07:00
hash.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
hash.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
HashTable.cpp fix core from last push. 2013-12-09 14:21:46 -07:00
HashTable.h fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
HashTableT.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
HashTableT.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
HashTableX.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
HashTableX.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
hashtest2.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
hashtest3.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
hashtest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Highlight.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Highlight.h trying to fix json decoding bug. 2013-10-24 17:55:01 -07:00
Hostdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Hostdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
hosts.cpp Initial file population. 2013-08-02 13:12:24 -07:00
HttpMime.cpp fix time/date core 2014-09-22 07:00:10 -07:00
HttpMime.h Merge branch 'testing' into diffbot-matt 2014-06-13 11:00:09 -07:00
HttpRequest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
HttpRequest.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
HttpServer.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
HttpServer.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
iana_charset.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
iana_charset.h merge diffbot-testing 2014-04-09 20:10:30 -07:00
iconv.h Initial file population. 2013-08-02 13:12:24 -07:00
Images.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Images.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Indexdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Indexdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexList.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexList.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexReadInfo.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexReadInfo.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexTable2.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexTable2.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexTable.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
IndexTable.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
init.gb.conf minor make install changes 2014-05-22 18:46:38 -07:00
injectme3 added injectme3 file and documentation into compare.html 2013-08-17 11:02:26 -06:00
injector.cpp Initial file population. 2013-08-02 13:12:24 -07:00
iostream.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
ip.cpp misc/various bug fixes. 2014-08-28 18:07:22 -07:00
ip.h Initial file population. 2013-08-02 13:12:24 -07:00
ipconfig.cpp fixed some cores. brought in fixes from 2013-09-08 16:16:13 -06:00
Iso8859.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Iso8859.h Initial file population. 2013-08-02 13:12:24 -07:00
jointest.cpp Initial file population. 2013-08-02 13:12:24 -07:00
jpegtopnm Initial file population. 2013-08-02 13:12:24 -07:00
Json.cpp multiple core fixes 2014-09-22 07:07:40 -07:00
Json.h v3 support for tokenized diffbot replies 2014-05-12 16:13:24 -07:00
keepalive.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Lang.cpp fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
Lang.h when user searches for a word without the 2014-06-01 09:37:00 -07:00
LangList.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
LangList.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Language.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Language.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
LanguageIdentifier.cpp more minor bug fixes. 2014-08-28 18:11:07 -07:00
LanguageIdentifier.h Initial file population. 2013-08-02 13:12:24 -07:00
LanguagePages.cpp misc/various bug fixes. 2014-08-28 18:07:22 -07:00
LanguagePages.h Initial file population. 2013-08-02 13:12:24 -07:00
libc.a Initial file population. 2013-08-02 13:12:24 -07:00
libcrypto.a turn off hearbeats when compiling openssl libs 2014-04-22 16:39:40 -07:00
libgcc.a Initial file population. 2013-08-02 13:12:24 -07:00
libiconv.a Initial file population. 2013-08-02 13:12:24 -07:00
libiconv.la Initial file population. 2013-08-02 13:12:24 -07:00
libjpeg.so.62 thumbnail generation support back in. 2014-04-24 10:13:45 -07:00
libm.a Initial file population. 2013-08-02 13:12:24 -07:00
libnetpbm.so.10 thumbnail generation support back in. 2014-04-24 10:13:45 -07:00
libpng12.so.0 thumbnail generation support back in. 2014-04-24 10:13:45 -07:00
libpthread.a Initial file population. 2013-08-02 13:12:24 -07:00
libssl.a turn off hearbeats when compiling openssl libs 2014-04-22 16:39:40 -07:00
libstdc++.a Initial file population. 2013-08-02 13:12:24 -07:00
libtiff.so.4 thumbnail generation support back in. 2014-04-24 10:13:45 -07:00
libz.a Initial file population. 2013-08-02 13:12:24 -07:00
libz.so.1 thumbnail generation support back in. 2014-04-24 10:13:45 -07:00
LICENSE license fix 2014-06-16 13:52:51 -07:00
Linkdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Linkdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
LinkedList.h Initial file population. 2013-08-02 13:12:24 -07:00
linkspam.cpp fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
linkspam.h Initial file population. 2013-08-02 13:12:24 -07:00
Log.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Log.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Loop.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Loop.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
looptest.cpp Initial file population. 2013-08-02 13:12:24 -07:00
main.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Make.depend force gb to recompile version every time 2014-09-19 12:23:40 -07:00
Makefile cygwin fixes 2014-09-26 23:04:16 -07:00
malloc.c Initial file population. 2013-08-02 13:12:24 -07:00
matches2.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
matches2.h renamed matches.h and matches.cpp to 2013-10-01 07:58:24 -07:00
Matches.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Matches.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Mem.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Mem.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
membustest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
MemPool.cpp Initial file population. 2013-08-02 13:12:24 -07:00
MemPool.h Initial file population. 2013-08-02 13:12:24 -07:00
MemPoolTree.cpp Initial file population. 2013-08-02 13:12:24 -07:00
MemPoolTree.h Initial file population. 2013-08-02 13:12:24 -07:00
memtest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
mergetest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
MetaContainer.cpp Initial file population. 2013-08-02 13:12:24 -07:00
MetaContainer.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Mime.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Mime.h Initial file population. 2013-08-02 13:12:24 -07:00
mixfile.cpp Initial file population. 2013-08-02 13:12:24 -07:00
mmseg.h Initial file population. 2013-08-02 13:12:24 -07:00
monitor.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Monitordb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Monitordb.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg0.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg0.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg1.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg1.h use collnum instead of coll string. 2014-03-06 15:48:11 -08:00
Msg1f.cpp if logging to stderr then return err when trying to 2014-07-05 14:16:33 -07:00
Msg1f.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg2.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg2.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg2a.cpp Merge branch 'master' into diffbot 2013-10-16 14:28:42 -07:00
Msg2a.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg2b.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Msg2b.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg3.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg3.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg3a.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg3a.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg3e.cpp fix infinite loop from json parsing and 2013-09-27 17:52:36 -06:00
Msg3e.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg4.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg4.h upped MAX_SPIDERS from 100 to 300. 2014-09-03 07:25:40 -07:00
Msg5.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg5.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg6b.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg6b.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg8b.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg8b.h Merge branch 'master' into diffbot 2013-10-16 14:28:42 -07:00
Msg9b.cpp use collnum instead of coll string. 2014-03-06 15:48:11 -08:00
Msg9b.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg13.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg13.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg17.cpp first compiled stab at multi collection searching. 2014-03-06 10:45:13 -08:00
Msg17.h first compiled stab at multi collection searching. 2014-03-06 10:45:13 -08:00
Msg20.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg20.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg22.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg22.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg24.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg28.cpp fix core from (broad)casting valueless cgi field. 2013-10-03 14:51:59 -07:00
Msg28.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg30.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Msg30.h move CollectionRec stuff into Collectiondb files 2013-12-10 15:28:04 -08:00
Msg35.cpp move from groups to shards. got rid of annoying 2013-10-04 16:18:56 -07:00
Msg35.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg36.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg36.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg37.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg37.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg39.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg39.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg40.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg40.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg40Cache.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Msg40Cache.h Initial file population. 2013-08-02 13:12:24 -07:00
Msg42.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg42.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg51.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msg51.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Msgaa.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Msgaa.h Initial file population. 2013-08-02 13:12:24 -07:00
MsgC.cpp move from groups to shards. got rid of annoying 2013-10-04 16:18:56 -07:00
MsgC.h Initial file population. 2013-08-02 13:12:24 -07:00
Msge0.cpp use collnum instead of coll string. 2014-03-06 15:48:11 -08:00
Msge0.h use collnum instead of coll string. 2014-03-06 15:48:11 -08:00
Msge1.cpp fixed qa tests when doing it over multi-host cluster 2014-09-16 10:25:45 -06:00
Msge1.h Initial file population. 2013-08-02 13:12:24 -07:00
Multicast.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Multicast.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
mysynonyms.txt Initial file population. 2013-08-02 13:12:24 -07:00
numwords.cpp Initial file population. 2013-08-02 13:12:24 -07:00
PageAddColl.cpp fix qa test so we can roll out proxy code. 2014-09-30 15:40:02 -07:00
PageAddUrl.cpp fixes to make easier to compile on max os x. 2014-08-28 12:55:02 -07:00
PageBasic.cpp print chrome on other pages 2014-09-23 20:59:48 -07:00
PageCatdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageCrawlBot.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageCrawlBot.h more api updates 2014-07-13 09:35:44 -07:00
PageDirectory.cpp fix dmoz building. 2014-07-05 22:20:15 -07:00
PageEvents.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageGet.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageHosts.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageIndexdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageInject.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageInject.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageLogView.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageNetTest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageNetTest.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageOverview.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageParser.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageParser.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
PagePerf.cpp took out pagecount table. just hafta scan 2014-01-19 20:34:38 -08:00
PageReindex.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageReindex.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageResults.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageResults.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageRoot.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Pages.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Pages.h add 2nd collection passwords link 2014-10-27 11:21:23 -06:00
PageSockets.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageSpam.cpp Initial file population. 2013-08-02 13:12:24 -07:00
PageStats.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageStatsdb.cpp fix core 2014-09-17 16:58:24 -06:00
PageSubmit.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageThesaurus.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageThreads.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageTitledb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageTurk.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PageTurk.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Parms.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Parms.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
parse_iana_charsets.pl move CollectionRec stuff into Collectiondb files 2013-12-10 15:28:04 -08:00
pdftohtml try new pdftohtml binary 2014-09-26 08:02:17 -07:00
Phrases.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Phrases.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
PingServer.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PingServer.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Placedb.cpp use collnum instead of coll string. 2014-03-06 15:48:11 -08:00
Placedb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
pngtopnm Initial file population. 2013-08-02 13:12:24 -07:00
pnmscale Initial file population. 2013-08-02 13:12:24 -07:00
Pops.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Pops.h Initial file population. 2013-08-02 13:12:24 -07:00
porter.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Pos.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Pos.h Initial file population. 2013-08-02 13:12:24 -07:00
Posdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Posdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
postalCodes.txt Initial file population. 2013-08-02 13:12:24 -07:00
PostQueryRerank.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
PostQueryRerank.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
ppmtojpeg Initial file population. 2013-08-02 13:12:24 -07:00
Process.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Process.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Profiler.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Profiler.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Proxy.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Proxy.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
pstotext Initial file population. 2013-08-02 13:12:24 -07:00
qa.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
QAClient.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
QAClient.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
quarantine.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Query.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Query.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Rdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Rdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbBase.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbBase.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbBuckets.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbBuckets.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbCache.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbCache.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbDump.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbDump.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbList.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbList.h replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
RdbMap.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbMap.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbMem.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbMem.h now we can reset collection mid stream 2013-10-18 17:49:36 -07:00
RdbMerge.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbMerge.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbScan.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbScan.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
rdbtest2.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
rdbtest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbTree.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RdbTree.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
README.md documentation updates 2014-09-12 03:09:06 -07:00
readRec.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Rebalance.cpp tuning the rebalance loop 2014-03-15 14:56:11 -07:00
Rebalance.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
reindex2.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Repair.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Repair.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
RequestTable.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
RequestTable.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
rescue.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Revdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Revdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
rmbots.cpp replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
S99gb added S99gb for loading at boot. 2014-06-23 07:32:38 -06:00
SafeBuf.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
SafeBuf.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
SafeList.h Initial file population. 2013-08-02 13:12:24 -07:00
Sanity.h Initial file population. 2013-08-02 13:12:24 -07:00
Scores.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Scores.h Initial file population. 2013-08-02 13:12:24 -07:00
Scraper.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Scraper.h misc/various bug fixes. 2014-08-28 18:07:22 -07:00
SearchInput.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
SearchInput.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Sections.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Sections.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
seektest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
seo.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
SiteGetter.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
SiteGetter.h use collnum instead of coll string. 2014-03-06 15:48:11 -08:00
sleepandlog.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
sort.cpp Initial file population. 2013-08-02 13:12:24 -07:00
sort.h Initial file population. 2013-08-02 13:12:24 -07:00
Speller.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Speller.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Spider.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Spider.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
SpiderProxy.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
SpiderProxy.h added parm to reset proxy stats in table. erases 2014-09-30 17:38:59 -07:00
Stats.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Stats.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Statsdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Statsdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
StopWords.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
StopWords.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
streambuf.h Initial file population. 2013-08-02 13:12:24 -07:00
Strings.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Strings.h Initial file population. 2013-08-02 13:12:24 -07:00
Summary.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Summary.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
superMergeTest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
supported_charsets.cpp Initial file population. 2013-08-02 13:12:24 -07:00
supported_charsets.txt Initial file population. 2013-08-02 13:12:24 -07:00
Syncdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Syncdb.h Initial file population. 2013-08-02 13:12:24 -07:00
Synonyms.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Synonyms.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Tagdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Tagdb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
TcpServer.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
TcpServer.h added some debug logic. (will remove shortly) 2014-10-13 16:36:43 -07:00
TcpSocket.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
test2.cpp Initial file population. 2013-08-02 13:12:24 -07:00
test_convert.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
test_hash.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
test_norm.cpp Initial file population. 2013-08-02 13:12:24 -07:00
test_parser2.cpp Initial file population. 2013-08-02 13:12:24 -07:00
test_parser.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
test_unicode.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Test.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Test.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
testfloats.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Tfndb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Tfndb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Thesaurus.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Thesaurus.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Threads.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Threads.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
threadtest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
thunder.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
tifftopnm Initial file population. 2013-08-02 13:12:24 -07:00
Timedb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Timedb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Timer.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Title.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Title.h qa test fixes 2014-07-15 10:06:33 -07:00
Titledb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Titledb.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
TopTree.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
TopTree.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
treetest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
TuringTest.cpp Initial file population. 2013-08-02 13:12:24 -07:00
TuringTest.h Initial file population. 2013-08-02 13:12:24 -07:00
Turkdb.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
types.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
UCNormalizer.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
UCNormalizer.h Initial file population. 2013-08-02 13:12:24 -07:00
UCPropTable.cpp Initial file population. 2013-08-02 13:12:24 -07:00
UCPropTable.h Initial file population. 2013-08-02 13:12:24 -07:00
UCWordIterator.cpp Initial file population. 2013-08-02 13:12:24 -07:00
UCWordIterator.h Initial file population. 2013-08-02 13:12:24 -07:00
UdpProtocol.h replaced unsigned long long with uint64_t 2014-10-30 13:30:39 -06:00
UdpServer.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
UdpServer.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
UdpSlot.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
UdpSlot.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
udptest.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Unicode.cpp when user searches for a word without the 2014-06-01 09:37:00 -07:00
Unicode.h new import code copiling. now needs runtime testing and 2014-09-20 20:12:28 -07:00
UnicodeProperties.cpp code cleanups. 2014-01-18 21:19:26 -08:00
UnicodeProperties.h Initial file population. 2013-08-02 13:12:24 -07:00
unifiedDict.txt Initial file population. 2013-08-02 13:12:24 -07:00
uniq2.cpp Initial file population. 2013-08-02 13:12:24 -07:00
Url.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Url.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
urlinfo.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Users.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Users.h Initial file population. 2013-08-02 13:12:24 -07:00
ValidPointer.cpp Initial file population. 2013-08-02 13:12:24 -07:00
ValidPointer.h Initial file population. 2013-08-02 13:12:24 -07:00
Vector.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Vector.h Initial file population. 2013-08-02 13:12:24 -07:00
Version.cpp force gb to recompile version every time 2014-09-19 12:23:40 -07:00
Version.h makefile updates 2014-09-19 13:51:08 -06:00
Weights.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Weights.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Wiki.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Wiki.h Initial file population. 2013-08-02 13:12:24 -07:00
wikititles.txt.part1 Initial file population. 2013-08-02 13:12:24 -07:00
wikititles.txt.part2 Initial file population. 2013-08-02 13:12:24 -07:00
wiktionary-buf.txt when user searches for a word without the 2014-06-01 09:37:00 -07:00
wiktionary-lang.txt when user searches for a word without the 2014-06-01 09:37:00 -07:00
wiktionary-syns.dat when user searches for a word without the 2014-06-01 09:37:00 -07:00
Wiktionary.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Wiktionary.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Words.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Words.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
Xml.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
Xml.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
XmlDoc.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
XmlDoc.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
XmlNode.cpp replace long long with int64_t 2014-10-30 13:36:39 -06:00
XmlNode.h replace long long with int64_t 2014-10-30 13:36:39 -06:00
zconf.h Initial file population. 2013-08-02 13:12:24 -07:00
zlib.h Initial file population. 2013-08-02 13:12:24 -07:00

README.md

open-source-search-engine

An open source web and enterprise search engine. As can be seen on http://www.gigablast.com/ .

RUNNING GIGABLAST

See html/faq.html for all administrative documentation including the quick start instructions.

Alternatively, visit http://www.gigablast.com/admin.html

See html/compare.html for a comparison of Gigablast to SOLR. Although this is very sparse right now, it does include some useful commands.

CODE ARCHITECTURE

See html/developer.html for all code documentation.

Alternatively, visit http://www.gigablast.com/developer.html

CONTACT

Contact me for feature requests or help in general. I will work for free for good use cases. mattdwells@hotmail.com.