redpony
|
2fc0a82c92
|
enable language model stats computation. enable with '-L true'
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@739 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 22:51:56 +00:00 |
|
hieuhoang1972
|
2f1e974c70
|
code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@738 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 22:45:06 +00:00 |
|
redpony
|
da207d0016
|
add optional LM statistics reporting. enable with '-L true' on command line
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@737 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 22:44:01 +00:00 |
|
hieuhoang1972
|
b7a7b4286f
|
code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@736 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 22:37:24 +00:00 |
|
eherbst
|
1374aefc6d
|
- fixed caching behavior of Corpus to remove gibberish and cache everything
- fixed javascript sorting in sentence-by-sentence
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@735 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 22:18:54 +00:00 |
|
hieuhoang1972
|
91521bd911
|
LM code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@734 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 21:56:28 +00:00 |
|
hieuhoang1972
|
93af8a2780
|
joint multi-factor LM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@733 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 21:30:19 +00:00 |
|
mfederico
|
589f3040d5
|
file was in the wrong place
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@732 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 21:29:31 +00:00 |
|
redpony
|
aa18da184b
|
fix build
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@731 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 19:42:28 +00:00 |
|
bojar
|
5c2d19a156
|
reversed exit codes of symal and added safesystem to call symal
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@730 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 17:54:11 +00:00 |
|
bojar
|
7735bc6b6d
|
the python compiled files should not be in the cvs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@729 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 17:53:23 +00:00 |
|
mfederico
|
f211a2a738
|
New version with c++ module (symal) performing step (3).
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@728 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 17:43:17 +00:00 |
|
bojar
|
0241f2fc5f
|
better explanation in README, fixed test preparation in tests/train-factored-test-step3.test
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@727 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 17:36:36 +00:00 |
|
mfederico
|
f0a5eb167e
|
Added a test to check step 3 of train-factored-models
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@726 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 16:20:40 +00:00 |
|
hieuhoang1972
|
47d6f95684
|
implemented new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@725 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 16:19:10 +00:00 |
|
eherbst
|
87056b15a7
|
added my script to the docs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@724 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 16:13:29 +00:00 |
|
eherbst
|
20f49a1ded
|
fixed legend display
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@723 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 16:09:21 +00:00 |
|
hieuhoang1972
|
d13c54adb8
|
implemented new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@722 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:53:49 +00:00 |
|
mfederico
|
32c9252bea
|
added quantize-lm
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@721 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:26:25 +00:00 |
|
mfederico
|
16affa91fa
|
Quantization of ARPA-like LMs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@720 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:24:19 +00:00 |
|
mfederico
|
a1944e1985
|
Added symal stuff
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@719 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:18:58 +00:00 |
|
mfederico
|
6d6ac5c1e4
|
New version with faster computation of word alignments.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@718 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:18:12 +00:00 |
|
mfederico
|
c3ea1ef545
|
Filter to make GIZA++ alignment files more readable.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@717 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:06:58 +00:00 |
|
mfederico
|
e72010d6ce
|
A tool to compute symmetric alignments from GIZA++ alignments.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@716 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 15:03:49 +00:00 |
|
zens
|
032e0688ce
|
- remove some debug stuff
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@715 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 13:10:02 +00:00 |
|
hieuhoang1972
|
209e215075
|
allow 1 gen table weight to be used when 2 probability numbers present in file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@714 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 04:39:17 +00:00 |
|
hieuhoang1972
|
714c4e9299
|
implemented new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@713 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 03:59:38 +00:00 |
|
hieuhoang1972
|
1da8c78547
|
getting ready to implement new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@712 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 03:42:59 +00:00 |
|
mfederico
|
bad0b1b2e0
|
tracing of cache use
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@711 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 03:30:20 +00:00 |
|
hieuhoang1972
|
3f52084112
|
getting ready to implement new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@710 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 03:16:46 +00:00 |
|
hieuhoang1972
|
fd93ec083d
|
getting ready to implement new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@709 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 03:02:40 +00:00 |
|
mfederico
|
afe537ca68
|
quantization of ARPA-like LMs
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@708 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:51:36 +00:00 |
|
mfederico
|
a53e3d07d5
|
tracing of cache usage
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@707 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:51:12 +00:00 |
|
mfederico
|
fdee18ff88
|
tuning of cache use
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@706 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:50:27 +00:00 |
|
mfederico
|
d0a573bc51
|
added tracing of cache usage
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@705 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:49:35 +00:00 |
|
mfederico
|
7cc3d890b1
|
changed diagnostic ouput
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@704 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:46:38 +00:00 |
|
mfederico
|
3c28c78fba
|
added some options to command
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@703 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:45:20 +00:00 |
|
mfederico
|
d9dd8510ff
|
modification of diagnostic messsage
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@702 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 02:40:23 +00:00 |
|
hieuhoang1972
|
5d6b278f9c
|
billions of warnings!!
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@701 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 01:04:36 +00:00 |
|
hieuhoang1972
|
d337cb0280
|
getting ready to implement new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@700 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 00:35:07 +00:00 |
|
hieuhoang1972
|
4c516031d8
|
getting ready to implement new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@699 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 00:30:14 +00:00 |
|
hieuhoang1972
|
c1724ee9ef
|
visual studio proj file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@698 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-14 00:04:45 +00:00 |
|
hieuhoang1972
|
79ee394546
|
visual studio proj file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@697 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 23:58:42 +00:00 |
|
hieuhoang1972
|
7e0cfbb46e
|
visual studio proj file
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@696 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 23:41:46 +00:00 |
|
hieuhoang1972
|
6eab7a9114
|
visual studio issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@695 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 23:41:29 +00:00 |
|
hieuhoang1972
|
c1e1fe33c2
|
getting ready to implement new phrase dictionary pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@694 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 23:41:08 +00:00 |
|
ccorbett
|
4e3631e1b0
|
IOCommandLine.cpp, fixed minor NBestFile output error in LexicalReordering distortion
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@693 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 19:51:17 +00:00 |
|
hieuhoang1972
|
2a7179a8fa
|
choice of not labelling n-best output for wade shen's mert script
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@692 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 19:08:39 +00:00 |
|
hieuhoang1972
|
204c64c2d5
|
newline encoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@691 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 18:36:26 +00:00 |
|
ccorbett
|
7019abf652
|
reordering scores are now implemented for n-best lists
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@690 1f5c12ca-751b-0410-a591-d2e778427230
|
2006-08-13 18:11:52 +00:00 |
|