Commit Graph

1121 Commits

Author SHA1 Message Date
gembipom
b979f967d3 cube pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/grace_cube_pruning_gen@1453 1f5c12ca-751b-0410-a591-d2e778427230
2007-08-16 17:06:26 +00:00
gembipom
5325d7f72d latest cube pruning attempt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/grace_cube_pruning_gen@1452 1f5c12ca-751b-0410-a591-d2e778427230
2007-08-16 11:41:59 +00:00
gembipom
fb751c0ffc sorting for cube pruning
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/grace_cube_pruning_gen@1442 1f5c12ca-751b-0410-a591-d2e778427230
2007-08-02 16:09:01 +00:00
gembipom
399ee08ec6 cube pruning for FTM
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/grace_cube_pruning_gen@1441 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-30 13:36:08 +00:00
gembipom
308b8c7e70 cube pruning attempt
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/grace_cube_pruning_gen@1437 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-26 14:46:13 +00:00
hieuhoang1972
dcee06070f made a copy
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/branches/grace_cube_pruning_gen@1436 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-26 14:35:32 +00:00
hieuhoang1972
9eba034662 turn off debugging
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1435 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-25 10:05:34 +00:00
hieuhoang1972
1b09cb102b vs.net files & weird mem leak again
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1434 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-24 22:54:08 +00:00
hieuhoang1972
76fb5b8f51 code cleanup. moved DecodeGraph to its own class
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1433 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-24 22:34:55 +00:00
hieuhoang1972
1a3a444b92 code cleanup
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1432 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-24 21:48:06 +00:00
hieuhoang1972
09e5320e95 weird mem leak in vs.net
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1431 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-24 20:59:26 +00:00
hieuhoang1972
8db8e617de turn trans opt on by default
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1430 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-20 18:19:32 +00:00
hieuhoang1972
c9563bdcc8 cache for translation options for speed-up. default to true.
only works for sentence input

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1429 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-20 13:03:12 +00:00
phkoehn
fb606c3bf3 fixed memort blowup with caching bin ttable / bin reordering table
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1428 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-19 19:03:40 +00:00
hieuhoang1972
4a2982cd34 build with SRILM in windows under different configuration
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1427 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-17 20:45:51 +00:00
redpony
5266d85d97 prevent silent failure when there aren't enough distortion weights given with lexicalized reordering models
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1426 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-16 22:27:33 +00:00
hieuhoang1972
2beb0c44e9 mkdir before doing generation
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1425 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-14 09:54:05 +00:00
hieuhoang1972
dab6d309ec UINT32 for windows comp
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1424 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-10 13:18:09 +00:00
redpony
1147f71e48 fix for binary reordering format on 64-bit platforms. thanks to Jaakko Väyrynen for identifying the problem
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1423 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-10 12:44:40 +00:00
redpony
d8536d15b7 add lattice test, not just CN test
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1422 1f5c12ca-751b-0410-a591-d2e778427230
2007-07-03 15:40:26 +00:00
nicolabertoldi
75afdf04a5 I corrected direction of alignment
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1421 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-27 17:57:55 +00:00
nicolabertoldi
ac91cb78cc two additional (and simpler) ways of extracting alignments: source-to-target and target-to-source
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1420 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-27 16:34:14 +00:00
nicolabertoldi
7f9c2856c2 changes to reduce disk memory consumption during training
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1419 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-27 16:30:20 +00:00
phkoehn
960bebdd4a fixed clean script to handle '|'s
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1416 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-18 15:50:04 +00:00
redpony
c99167d709 reduce memory consumption by removing data members from Factor object. These were not used anywhere and are determined by context. Since the were not used, it is not even clear if they were being reliably set, so it's better to remove them.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1415 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-06 04:49:17 +00:00
redpony
c747cdd505 fix dumb error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1414 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-01 16:27:56 +00:00
redpony
1f050e198a fix compile error, enable optimizations
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1413 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-01 16:26:26 +00:00
redpony
564bb5a64e make scorer use compiler optimization
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1412 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-01 16:22:30 +00:00
jdschroeder
3586421b6a Changed IRSTLM machine-specific library path to use uname -m, matches with latest IRSTLM install code
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1411 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-01 13:37:10 +00:00
hieuhoang1972
a0b5ac8dcf change svn properties
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1410 1f5c12ca-751b-0410-a591-d2e778427230
2007-06-01 13:34:02 +00:00
jdschroeder
0bfb92cfe1 Deleted old xcode files.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1409 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:49:52 +00:00
hieuhoang1972
4fbed2c983 update eclipse project file for irstlm change
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1408 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:37:31 +00:00
hieuhoang1972
9aac5e70de update eclipse project file for irstlm change
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1407 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 13:34:48 +00:00
jdschroeder
b522eca41a Added Xcode 2.4 projects for moses and moses-cmd. Uses links to external srilm and irstlm libraries.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1406 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-29 09:03:00 +00:00
hieuhoang1972
559e839660 git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1405 1f5c12ca-751b-0410-a591-d2e778427230 2007-05-25 15:25:09 +00:00
hieuhoang1972
67f173ea12 build instructions for eclipse and visual studio
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1404 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-25 15:24:17 +00:00
phkoehn
b7862e7ed1 added images for report
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1403 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-24 22:31:54 +00:00
phkoehn
51dbc127d3 updated report: intro, conclusions, english-german experiments
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1400 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-24 15:08:51 +00:00
phkoehn
f7905984c5 added bib's to report
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1399 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-24 15:04:54 +00:00
jdschroeder
68c9468937 Added support for pharaoh-style XML tags in Sentence input to supplement phrase table translation options. Use command line flag -xml-input. Possible values are:
-inclusive (places XML options into mix with regular phrase table choices)
-exclusive (no phrase table entries that overlap any of the XML source words are allowed)
-ignore (XML markup is removed from input but not used during decoding)
-pass-through (default, previous moses behavior: XML data is erroneously treated as words)

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1398 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-24 13:23:36 +00:00
maurocettolo
bb76b16e88 updated interface to new irstlm toolkit, able to handle micro-macro tag maps
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1397 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-24 09:07:40 +00:00
nicolabertoldi
3544b51662 Added notes for compilation on Mac.
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1396 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-23 07:34:50 +00:00
nicolabertoldi
f77cda45c4 Removed irstlm stuff
Modified instructions
Changed configure.in to load a machine-dependent irstlm library


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1395 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-22 15:40:56 +00:00
hieuhoang1972
aa25c7341d fixed bug with non-ascii data, recieved from Jaakko Väyrynen
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1392 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-21 13:06:40 +00:00
hieuhoang1972
432484f16d assert number of phrase table weights
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1391 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 13:31:21 +00:00
hieuhoang1972
8525279d7d rename LatticePath class and associated classes to TrellisPath, to avoid confusion with WordLattice input
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1389 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 13:08:55 +00:00
hieuhoang1972
b5d97c620e code tidy up
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1388 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-16 12:52:49 +00:00
redpony
5c6e4850fc fix compile error
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1387 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 23:11:17 +00:00
abarun
4c2dcc23d7 Code for MBR decoding
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1386 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 22:20:08 +00:00
hieuhoang1972
af46795b3c visual studio compile errors
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@1385 1f5c12ca-751b-0410-a591-d2e778427230
2007-05-15 21:37:25 +00:00