hieuhoang1972
5dee5d04aa
rename IOStream to IOWrapper.
...
move vs.net solution file to root folder
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1872 1f5c12ca-751b-0410-a591-d2e778427230
2008-08-05 00:24:45 +00:00
hieuhoang1972
47e4803f97
move cube pruning moses lib to trunk
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1849 1f5c12ca-751b-0410-a591-d2e778427230
2008-06-11 13:22:26 +00:00
hieuhoang1972
1792e14945
eclipse project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1810 1f5c12ca-751b-0410-a591-d2e778427230
2008-06-02 21:23:33 +00:00
hieuhoang1972
9997b7fd7e
alignment output fix
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1604 1f5c12ca-751b-0410-a591-d2e778427230
2008-05-04 13:13:12 +00:00
hieuhoang1972
3fc0b8ddb4
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1603 1f5c12ca-751b-0410-a591-d2e778427230
2008-05-04 12:52:52 +00:00
hieuhoang1972
24a5a24c8b
changed eclipse project for irstlm changes
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1595 1f5c12ca-751b-0410-a591-d2e778427230
2008-04-15 14:22:42 +00:00
nicolabertoldi
43ae535165
added stuff for time-out policy. If translation takes too much time, it will be interrupted and the actual partial translation is output. By default, time-out is not set.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1591 1f5c12ca-751b-0410-a591-d2e778427230
2008-04-02 17:08:54 +00:00
phkoehn
4ee468dc03
output search graph
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1588 1f5c12ca-751b-0410-a591-d2e778427230
2008-03-17 21:34:19 +00:00
hieuhoang1972
2d95df359e
code clean - move creating wordgraph file to iostream class
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1581 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-29 23:08:58 +00:00
hieuhoang1972
e2f4d64608
output wordgraph for german
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1574 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-27 13:31:37 +00:00
hieuhoang1972
4964c45489
output wordgraph for german
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1573 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-27 12:43:04 +00:00
hieuhoang1972
76606d3823
minor -
...
add svn properties for XmlOption.
make vs & eclipse build use return, rather than exit, when closing down
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1555 1f5c12ca-751b-0410-a591-d2e778427230
2008-02-09 17:08:09 +00:00
hieuhoang1972
fd60fe93b9
roll back last change. seg fault in release build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1549 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-29 19:28:13 +00:00
phkoehn
0faf1a83c0
bug fix for distinct n-best list generation, resolved memory blowup issue
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1542 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-18 19:00:07 +00:00
phkoehn
1044b16522
bug fixes to distinct n-best list, mbr decoding; also changed switches for mbr
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1540 1f5c12ca-751b-0410-a591-d2e778427230
2008-01-16 20:25:01 +00:00
abarun
aa6f605a2d
Updated xcode project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1518 1f5c12ca-751b-0410-a591-d2e778427230
2007-11-26 15:32:05 +00:00
hieuhoang1972
dee505b823
don't use hypo pool until delayed destructor is sorted out
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1513 1f5c12ca-751b-0410-a591-d2e778427230
2007-11-16 00:09:21 +00:00
redpony
7dbcef925d
Implemented -r (-recover-input-path) to recover the actual path through the CN/word lattice that was used in the best translation. Also cleaned up handling of source Phrases in the context of a particular hypothesis, which may improve performance translating with lexicalized reordering models.
...
Removed PhraseReference since the concept was broken for CN/lattice inputs.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1468 1f5c12ca-751b-0410-a591-d2e778427230
2007-09-28 16:43:33 +00:00
jdschroeder
6eaf3db0f5
updated xcode projects to include new source files.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1457 1f5c12ca-751b-0410-a591-d2e778427230
2007-09-05 10:46:18 +00:00
hieuhoang1972
4a2982cd34
build with SRILM in windows under different configuration
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1427 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-17 20:45:51 +00:00
jdschroeder
0bfb92cfe1
Deleted old xcode files.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1409 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:49:52 +00:00
hieuhoang1972
9aac5e70de
update eclipse project file for irstlm change
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1407 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:34:48 +00:00
jdschroeder
b522eca41a
Added Xcode 2.4 projects for moses and moses-cmd. Uses links to external srilm and irstlm libraries.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1406 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 09:03:00 +00:00
hieuhoang1972
8525279d7d
rename LatticePath class and associated classes to TrellisPath, to avoid confusion with WordLattice input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1389 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 13:08:55 +00:00
hieuhoang1972
b5d97c620e
code tidy up
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1388 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 12:52:49 +00:00
redpony
5c6e4850fc
fix compile error
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1387 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 23:11:17 +00:00
abarun
4c2dcc23d7
Code for MBR decoding
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1386 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 22:20:08 +00:00
hieuhoang1972
af46795b3c
visual studio compile errors
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1385 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 21:37:25 +00:00
abarun
5c0f6d0415
Code for MBR decoding
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1383 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 20:54:39 +00:00
hieuhoang1972
d2ebe33f9e
visual studio project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1364 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-18 18:10:24 +00:00
redpony
c80d8b8d47
Support for the decoding of arbitrary word lattices. Must be given in the form of a "plf" file, which is a little tricky. I'll add documentation at some point; for now, refer to the example plf file in the "lattice-surface" regression test.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1359 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-18 14:08:46 +00:00
hieuhoang1972
cd697c28ae
re-introduce konrad lexicalized reordering but fix bugs with help from philipp.
...
speed improvements by caching probabilities in Trans Opt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1338 1f5c12ca-751b-0410-a591-d2e778427230
2007-04-06 00:24:25 +00:00
hieuhoang1972
8566962ecc
output empty line even if no best hypothesis found
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1305 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-14 19:47:51 +00:00
hieuhoang1972
075681d6fc
visual studio proj file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1267 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 09:01:50 +00:00
hieuhoang1972
5f22fb13d3
make output of decimal places consistent by not format anywhere but in Main.cpp
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1266 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 00:43:45 +00:00
hieuhoang1972
2c9f1a13fe
make output of decimal places consistent by not format anywhere but in Main.cpp
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1265 1f5c12ca-751b-0410-a591-d2e778427230
2007-03-04 00:17:54 +00:00
phkoehn
f1d2bd0eb5
added option -include-alignment-in-n-best to include the word alignment for each sentence in the n-best list file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1246 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-26 20:59:41 +00:00
hieuhoang1972
62b4741de0
move calling InitializeBeforeSentenceProcessing() & CleanUpAfterSentenceProcessing() in Manager class
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1241 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-24 20:32:32 +00:00
hieuhoang1972
bef38f4006
code cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1234 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-23 00:00:09 +00:00
hieuhoang1972
c58393a4b4
verbose=0 nothing goes to stderr except for real, aborting errors
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1232 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-22 23:44:38 +00:00
hieuhoang1972
7ecb0ce66e
change unknown word processing to be closer to the way pharaoh does it - create unknown word whenever single word is not in translation table but penalise hypothesis for using it.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1227 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-21 19:48:53 +00:00
hieuhoang1972
f3cbacba3e
code cleanup - make FactorCollection and StaticData totally accessible only globally
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1218 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-16 18:08:37 +00:00
hieuhoang1972
e247f1da6f
fixed regression test failing. Number of features for generation models MUST be specified in ini file, no backward compatability hack
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1209 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-13 19:15:34 +00:00
hieuhoang1972
6b4dfc4db2
added #def to use hypo pool
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1206 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-12 11:05:13 +00:00
hieuhoang1972
006e2724e0
take out irstlm on VS build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1195 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-09 17:36:07 +00:00
hieuhoang1972
9cf7257d27
don't skip empty lines
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1169 1f5c12ca-751b-0410-a591-d2e778427230
2007-02-05 10:24:01 +00:00
hieuhoang1972
e7838339bb
exit/return from main()
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1141 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 16:21:28 +00:00
nicolabertoldi
be039bf84a
Reduced time to die!!!
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1139 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 14:47:13 +00:00
hieuhoang1972
e1823a52ac
prune arcList & LatticePathCollection (contenders for n-best paths)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1134 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-22 12:30:06 +00:00
hieuhoang1972
ff538c2e2f
fixed mem leak
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1131 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-21 13:38:03 +00:00
redpony
0f3ee4b814
If - is specified as the name of the n-best list file, write to std::cout and surpress the normal best hypothesis output.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1116 1f5c12ca-751b-0410-a591-d2e778427230
2007-01-08 14:46:48 +00:00
hieuhoang1972
dd721e1b4f
Mac xcode proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@997 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-22 15:19:28 +00:00
hieuhoang1972
7af5bb462e
dismantle IODevoce framework
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@992 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 23:06:30 +00:00
hieuhoang1972
c49a2e31bf
eclipse preferences. not sure if need to go into svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@990 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 19:59:20 +00:00
hieuhoang1972
a1f39c3ce7
lots of small changes and code clean up:
...
error catching/fail more gracefully on tables/lm load error & consistent user output
consistent debugging output
cleaned up timing functions
cleaned up mose/moses-cmd api calls/interaction
split up loading of all data in StaticData into separate fns
got binary phrase table to work under WIN32 & passed regression !!
added more comments
deleted phrase table filtering code
deleted mysql support
change calls to ToString() which might affect decoding to a call to a non-debugging fn instead, eg GetString()
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@988 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-21 19:35:37 +00:00
nicolabertoldi
5272e4d241
Modified output of feature scores.
...
Scores from Confusion Network input are output BEFORE any lexicon scores.
In nbest file, they are NOW labelled with "I:". Before they were "hidden" among other translation scores.
This change affect MERT, which will be changed ASAP.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@980 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-16 10:43:57 +00:00
hieuhoang1972
297280cb48
updated eclispe project file to work with calipso version
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@976 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-14 23:06:45 +00:00
hieuhoang1972
e9b38c2949
statically zlib on WIN32
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@975 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-14 21:34:24 +00:00
hieuhoang1972
244cd57aac
eclipse project file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@962 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-08 15:21:13 +00:00
hieuhoang1972
2789059b80
added internal, x-platform LM which exactly mimics SRILM
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@953 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-06 15:01:30 +00:00
hieuhoang1972
e8cd4e752f
changes to make LMs work in Windows
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@949 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-04 11:55:47 +00:00
hieuhoang1972
8d97bce927
solved bug in n-best list creation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@948 1f5c12ca-751b-0410-a591-d2e778427230
2006-11-03 18:44:14 +00:00
hieuhoang1972
e5203d2bcc
added comments
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@911 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-22 01:05:43 +00:00
hieuhoang1972
9b920e08a2
rename InputOutput to IODevice
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@906 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-21 16:31:45 +00:00
hieuhoang1972
7683d3523c
added comments
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@905 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-21 16:21:21 +00:00
hieuhoang1972
caf9d9a54a
visual studio project files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@894 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-17 12:15:51 +00:00
hieuhoang1972
d6f9458d59
code cleanup and commenting brought about when documenting for jhu report
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@886 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-17 11:07:17 +00:00
hieuhoang1972
63ad7063f4
xcode proj files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@880 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-12 11:46:57 +00:00
hieuhoang1972
0926bf40cc
taken boost out of eclipse project
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@843 1f5c12ca-751b-0410-a591-d2e778427230
2006-10-03 18:48:09 +00:00
hieuhoang1972
5cb31a4d90
delete zlib-win32 proj. library should be in default path
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@808 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:53:40 +00:00
hieuhoang1972
6f27c3da0e
put back Visual Leak Detector for Win32 build
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@807 1f5c12ca-751b-0410-a591-d2e778427230
2006-09-08 12:38:14 +00:00
phkoehn
1de5a36386
cleanup... renamed --report-source-word-span into --report-segmentation
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@802 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 19:51:07 +00:00
phkoehn
f084e13a1c
cleanup of verbose logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@800 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-30 17:03:27 +00:00
swadey
0ffbcca545
- Added necessary zlib-win32 implementation for winbloze
...
- update project files for vc++ and fixed minor code issues
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@796 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-24 20:11:08 +00:00
redpony
b7ffa5f8b9
make building moses/moses-cmd a single make command rather than two
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@794 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-23 15:18:53 +00:00
redpony
1700da00bf
remove .cvsignore files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@793 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:39:02 +00:00
redpony
1022363f39
remove acsite
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@788 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 15:06:24 +00:00
redpony
fe74de6b44
Remove files that are autogenerated
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@786 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:50:36 +00:00
redpony
75796cb419
remove misleading file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@785 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:34:50 +00:00
redpony
6eaba82546
remove references to boost, fix formatting, fix make-release-tarball to work with svn
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@784 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-21 14:24:09 +00:00
redpony
2e8001f428
prepare for public releases
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@781 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-20 16:24:39 +00:00
redpony
cc97567b2b
remove references to JHU fs
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@780 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:26:27 +00:00
redpony
b116321fd9
remove references to Mysql
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@779 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:20:23 +00:00
redpony
3fb417f914
remove references to boost
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@777 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-19 20:09:43 +00:00
hieuhoang1972
cc860098c3
remove mysql dependency
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@776 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-18 15:21:24 +00:00
hieuhoang1972
dbc8be5d85
eclipse proj file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@763 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 20:39:59 +00:00
mfederico
2a3037692b
Added decoding time computation.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@760 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 20:13:54 +00:00
mfederico
46e4537c4c
Added decoding time computation.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@758 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-15 18:31:16 +00:00
eherbst
54166381c9
*** empty log message ***
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@746 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 23:54:24 +00:00
mfederico
42d4f2e881
fixed check for n_gram.h in irstlm
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@741 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 23:32:01 +00:00
redpony
da207d0016
add optional LM statistics reporting. enable with '-L true' on command line
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@737 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-14 22:44:01 +00:00
ccorbett
4e3631e1b0
IOCommandLine.cpp, fixed minor NBestFile output error in LexicalReordering distortion
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@693 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 19:51:17 +00:00
hieuhoang1972
2a7179a8fa
choice of not labelling n-best output for wade shen's mert script
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@692 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 19:08:39 +00:00
ccorbett
7019abf652
reordering scores are now implemented for n-best lists
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@690 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 18:11:52 +00:00
hieuhoang1972
dfe2e58187
output trans & gen scores in order they were created
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@687 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-13 03:03:18 +00:00
zens
61294d90ad
- generate distinct nbest surface strings (if 3rd token of n-best-list is 'distinct')
...
- some sanity checks
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@674 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-12 00:06:55 +00:00
eherbst
5cb683cd7e
moved class InputType to InputType.h;
...
added more detailed statistics-keeping to SentenceStats;
added custom malloc/realloc (see Util.h);
some commenting
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@666 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 21:04:38 +00:00
redpony
8e986774e1
print input line number in logs
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@663 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 20:16:27 +00:00
redpony
8e4128beef
add dropped word analysis, fix potential out of memory crash
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@654 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 16:48:03 +00:00
hieuhoang1972
1fbdbbde21
visual studio proj file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@651 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-11 16:21:27 +00:00
redpony
eff4b3447e
FactorTypeSet->FactorMask
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@631 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 22:41:26 +00:00
redpony
5a0787310b
FactorTypeSet -> FactorMask
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@626 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 20:42:34 +00:00
phkoehn
525a181f12
re-organized parameter handling, now includes check for invalid parameters, reporting of parameter values, and a "help" function
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@616 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-10 04:20:06 +00:00
zens
b2041149f2
early pruning of path during confusion net exploration
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@594 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-09 19:14:43 +00:00
redpony
d4128a7f8c
N_BEST cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@564 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:48:59 +00:00
hieuhoang1972
5936477e7f
delete nbest config
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@563 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:36:00 +00:00
hieuhoang1972
ebc4b6bfb1
delete n-best config
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@562 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 18:16:01 +00:00
redpony
233c610cd8
get rid of last vestiges of conditional compilation for N_BEST support. there is virtually no overhead associated with this change and it makes the code/testing cleaner
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@561 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-08 17:49:07 +00:00
redpony
f83c8abd66
add detailed logging of 1-best translation output
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@550 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 23:44:32 +00:00
zens
6cfe732bff
- add some source files in Makefile.am
...
- bug fix: source / Manager get deleted in right order
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@535 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 21:18:13 +00:00
zens
8bf9742655
move CreateTranslationOptionCollection call into Manager
...
some code cleaning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@534 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-07 18:29:35 +00:00
hieuhoang1972
4a41245196
cvs headers
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@521 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 16:00:56 +00:00
hieuhoang1972
02ef374ebf
enable IRST LM in eclipse
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@520 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-05 02:31:25 +00:00
hieuhoang1972
21e44ec6c4
delete mysql support
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@497 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 20:21:26 +00:00
redpony
9fa3c9c792
add code for printing out information about a translation (ie, distortion, dropped words, etc)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@496 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 18:29:47 +00:00
zens
a7bd7ea3b6
- print path statistics for CN and Text input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@495 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 15:46:58 +00:00
bojar
12f50a5f26
Added labelling of scores in nbestlist and fixed mert to understand that.
...
Before release, these have to be checked:
- train-factored-phrase-model.perl (the whole process)
- mert on newly generated moses.ini with 2 weights for generation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@492 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-04 04:45:48 +00:00
redpony
b84426d1af
change message
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@477 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-03 00:20:53 +00:00
hieuhoang1972
7408c94cd1
eclipse project file
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@471 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-02 20:23:31 +00:00
hieuhoang1972
eacaf8404d
took out FactorType
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@451 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:12:58 +00:00
hieuhoang1972
15536efa03
took out FactorType
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@450 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 20:02:39 +00:00
zens
ff15ed0732
- remove some obsolete code
...
- optional future costs for distortion model
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@444 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 14:14:39 +00:00
hieuhoang1972
6bdf7eba18
memory pool cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@440 1f5c12ca-751b-0410-a591-d2e778427230
2006-08-01 03:36:36 +00:00
hieuhoang1972
33fa518c97
using mem pool. needs to be more finely tweaked to give good results
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@412 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-31 19:08:33 +00:00
hieuhoang1972
f403c2cbf6
getting ready to use mempool for Phrase
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@398 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:50:21 +00:00
hieuhoang1972
0a1e599120
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@395 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:27:40 +00:00
hieuhoang1972
a8b4a4db4d
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@394 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-30 02:14:41 +00:00
hieuhoang1972
4192b9050f
make mysql code work with new scxoring collection
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@384 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 16:28:56 +00:00
zens
dd124448c1
- bug fix and further cleanup
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@382 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 03:21:18 +00:00
redpony
ec776dd2b7
major score refactoring
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@371 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-29 01:11:45 +00:00
zens
dec0f5f703
print confusion net posterior in nbest list (if input is confusion net)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@368 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:57:31 +00:00
redpony
ecabcbf0e0
add score logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@367 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:42:17 +00:00
hieuhoang1972
1df79b9d75
deleted Arc & LatticeEdge classes
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@364 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 22:11:20 +00:00
zens
0e6517b428
- fixing already fixed bugs that have been re-introduced by someone
...
- moving some stuff from PhraseDictionaryTree to GenerateTuples
- removing some obsolete code
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@359 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 18:14:20 +00:00
hieuhoang1972
35f3c1b1b5
turned off profiling
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@349 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 03:18:18 +00:00
redpony
b48c33f1da
use new score bookkeeping for nbest lists
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@346 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-28 01:15:09 +00:00
hieuhoang1972
cca42f4ba9
cvs ignore
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@340 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 20:39:31 +00:00
hieuhoang1972
08a2d7e14d
cvs ignore
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@335 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 16:49:33 +00:00
hieuhoang1972
0c0ff800de
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@331 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 15:26:10 +00:00
redpony
14d342508e
preparation for new ScoreComponentCollection, which will be much more efficient
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@329 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-27 13:47:43 +00:00
zens
4022ae95bc
- print statistics for confusion nets
...
- small bug fixes
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@316 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:33:33 +00:00
hieuhoang1972
1ae613e79c
perf profiling turned on in eclipse in debug conf
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@315 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 20:24:37 +00:00
redpony
b7b03f9ff2
rename function
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@302 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 14:29:45 +00:00
bojar
b0f7cb32cb
Added -report-all-factors, so that stdout is more verbose.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@300 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-26 00:01:05 +00:00
phkoehn
f89ba84fdc
reset sentence counter after reading phrases from input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@293 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:53:50 +00:00
hieuhoang1972
c99e2c1786
Visual Studio issues
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@289 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:41:04 +00:00
bojar
88f4bced55
reimplemented future score matrix calculation, should be faster.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@288 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 21:17:12 +00:00
ccorbett
ee3e1e1576
Lexical reordering framework; confusion net still not working but Chris implied that was ok. All other regression tests passed
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@276 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 15:52:09 +00:00
redpony
c2be12bcd4
add irstlm support
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@273 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:42:49 +00:00
zens
a28dc42dd0
- fixed confusion net stuff (translations are identical, scores still different)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@270 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 14:08:21 +00:00
zens
162c8583c6
- TranslationOptionCollection...
...
* moved generic functions to base class
* todo: implement ProcessInitialTranslation and ProcessUnknownWord
for confusion nets
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@269 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 13:35:42 +00:00
hieuhoang1972
dd8a983149
merged up of chaching algorithm. lot6s of changed made to manager.cpp, TranslationOptColl.cpp, amongst other.
...
other code may be broken as a result
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@267 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 04:53:29 +00:00
zens
287d01fab1
- weight for confusion net scores
...
- bug fix in ranking of target phrases for confusion nets
- code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@266 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-25 00:24:18 +00:00
bojar
2e83536ef1
Moses accepts -report-source-span 1 for a mose verbose output.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@265 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-24 23:48:18 +00:00
bojar
90124bd403
(useless) optimization flag added
...
+ reporting number od hypotheses
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@259 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-24 17:59:35 +00:00
zens
81a63989fa
- do no read input phraes for confusion net input
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@257 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 22:19:02 +00:00
zens
47edc0599d
- removed some obsolete parts
...
- avoided some code duplication
- binary ttable is no longer a compiler switch:
use binary ttable if exists, otherwise use standard ttable
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@253 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 22:03:03 +00:00
zens
98ef97e803
- translation of confusion nets integrated (works only with binary phrase table)
...
- removed some obsolete stuff
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@250 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 21:09:23 +00:00
hieuhoang1972
a857773715
don't output if not surface factor
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@248 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 17:57:37 +00:00
zens
70682b48a1
- prepare I/O for Confusion Nets
...
- remove some of the dynamic casting stuff
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@245 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 17:43:42 +00:00
zens
c220c86501
- binary phrase table now fully supported
...
-> define preprocessor variable USEBINTTABLE
e.g. uncommenting the line in StaticData.cpp
or on the make command line
- some clean up
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@241 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 13:50:41 +00:00
zens
4c03fc1de8
- removed processPhraseTable stuff
...
- explicit dependency on moses library
-> automatically relink moses if libmoses.a changed
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@240 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 13:34:45 +00:00
zens
325353b0f4
- support for binary ttable in moses almost completed
...
- moved common part of CreateTranslationOptionCollection() for text and confusion net input
to base class
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@237 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-21 13:22:00 +00:00
eherbst
7a6600617e
minor cleaning-up
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@196 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-19 22:05:52 +00:00
zens
648bd1dfcd
- prepared confusion net input
...
-> new base class InputType is used throughout the decoder
instead of Sentence
Sentence and ConfusionNet derive from this class
-> Manager etc. do not know if the input is a sentence or a
confusion net (but could check if REALLY needed)
- two separate classes derived from TranslationOptionCollection:
one for text input and one for confusion net input
- score computation in PhraseDictionaryTree.cpp and some optimizations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@183 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-19 00:16:29 +00:00
eherbst
7beabbd9ed
adding source-word deletion (currently commented out) and unknown-word handling (also currently commented out)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@175 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-18 18:11:09 +00:00
hieuhoang1972
b6e9b01155
checking eclipse project files
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@172 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-18 17:27:47 +00:00
alex_const
bcb49a09c6
fixed bug in hypothesis backtracking
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@151 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-17 15:05:00 +00:00
redpony
bf423cb0d3
temporary "fix" (break fewer people)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@149 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-17 14:31:34 +00:00
hieuhoang1972
d655816734
for miscellaneous scripts and programs stuff
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@136 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-15 03:19:07 +00:00
zens
27dc2bfb7a
*** empty log message ***
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@131 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-15 00:13:27 +00:00
zens
34b6f1d349
prefix tree phrase table:
...
- access to tree structure
- tool for conversion
- some code cleaning / reformatting
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@129 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 23:50:58 +00:00
hieuhoang1972
78e1a8830d
commented out BackTrack
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@128 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 23:11:08 +00:00
hieuhoang1972
365460dff9
bug fixes & starting on translation option caching
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@125 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 22:21:54 +00:00
alex_const
2c0bfddfc2
Added hypothesis backtracking for the best hypothesis for verbose option 3.
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@123 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 21:51:05 +00:00
hieuhoang1972
afd1e85498
bug fixes & starting on translation option caching
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@115 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 18:13:50 +00:00
redpony
a08575e264
fix makefile stuff for moses-cmd
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@114 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 16:19:29 +00:00
eherbst
1bd381c35c
removing various junk I and a couple others CVSed accidentally
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@108 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 15:17:59 +00:00
eherbst
1ec33be9d6
modularized unknown-source-word handling (see UnknownWordHandler)
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@107 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 14:36:51 +00:00
hieuhoang1972
edc5548cfe
recommit config.in
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@103 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 14:01:52 +00:00
redpony
d7e5db0856
unify logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@102 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-14 13:31:06 +00:00
bojar
02a83cbc28
Never add a hypo with score worse than the worst in the (at least once pruned) stack, as it would get pruned anyway.
...
Renamed Add(hypo, beamthreshold) to AddPrune(hypo)
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@97 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-13 21:23:42 +00:00
bojar
572f3a2dbe
--enable-profiling option for ./configure
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@90 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-13 17:59:27 +00:00
redpony
d3f951ea85
add logging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@86 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-13 12:09:23 +00:00
hieuhoang1972
e338a6dbc0
variable number of score components for phrase trans
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@79 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 10:16:21 +00:00
hieuhoang1972
038ef552b0
ScoreComponentCollection to be map !
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@77 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 09:44:11 +00:00
hieuhoang1972
38e4001a75
ScoreComponentCollection o be set instead of map
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@72 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 06:51:28 +00:00
hieuhoang1972
3e0e05ecde
rolled back variable number of translation component scores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@69 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 06:38:12 +00:00
hieuhoang1972
563094e3f8
visual studio proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@64 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 01:37:33 +00:00
hieuhoang1972
abd7a65b26
visual studio proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@63 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 01:30:26 +00:00
hieuhoang1972
90b5dadfe0
visual studio proj
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@62 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-12 00:59:55 +00:00
hieuhoang1972
007dca2a99
ScoreType namespace
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@45 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-11 00:22:21 +00:00
hieuhoang1972
9d4778441d
Debugging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@40 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-10 21:27:24 +00:00
redpony
37456ad0f4
allow static linking
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@38 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-10 20:52:20 +00:00
redpony
9278b06622
fixes for automake
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@35 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-10 19:54:11 +00:00
hieuhoang1972
79ec2cf2a8
Debugging
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@27 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-09 23:56:40 +00:00
hieuhoang1972
822963842b
variable number of translation component scores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@24 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-09 21:37:49 +00:00
hieuhoang1972
df0d858673
variable number of translation component scores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@18 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-08 23:42:26 +00:00
hieuhoang1972
1b9437bfd5
variable number of translation component scores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@15 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-08 04:44:12 +00:00
hieuhoang1972
af6d8fdb53
variable number of translation component scores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@14 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-08 03:23:15 +00:00
hieuhoang1972
1138c0c0f7
variable number of translation component scores
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@8 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-07 16:46:30 +00:00
hieuhoang1972
dc1a0216ba
put into sourceforge
...
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@5 1f5c12ca-751b-0410-a591-d2e778427230
2006-07-04 18:04:38 +00:00