moses-smt/mosesdecoder
1
1
Fork 0
mirror of https://github.com/moses-smt/mosesdecoder.git synced 2024-12-28 22:45:50 +03:00
Code Issues Packages Projects Releases Wiki Activity
2,207 Commits 136 Branches 26 Tags 147 MiB
21df1feb26
Commit Graph

2207 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
hieuhoang1972
21df1feb26 xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4006 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-10 01:01:09 +00:00
leven101
894b49a5b2 added LM updates to mosesserver (only for LanguageModelORLM) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4005 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-09 17:27:48 +00:00
hieuhoang1972
4bf85266d8 dont process unknown words for 1st or last place. They're the <s> & </s> and should only be handled by the glue rules 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4004 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-08 16:22:56 +00:00
leven101
ec04285270 hash file 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4003 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-08 15:45:08 +00:00
leven101
4ea818f34a Added wrapper files for online randomised LM prototype 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4002 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-08 15:05:19 +00:00
hieuhoang1972
0a04cb11bf added std::size_t for gcc 4.6 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4001 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-08 05:49:47 +00:00
hieuhoang1972
46c4dd441e loosen assert in case of rounding errors 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@4000 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-06 16:06:51 +00:00
hieuhoang1972
be91fa581f remove eclipse build instructions 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3999 1f5c12ca-751b-0410-a591-d2e778427230
 2011-06-02 07:09:28 +00:00
leven101
bcbc0c6e09 bug fix 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3998 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-31 12:04:40 +00:00
leven101
547a6cbf62 added ClearTransOptCache() to StaticData class and call it when updating suffix PTs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3997 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-31 09:43:17 +00:00
leven101
f64885599d added ClearTransOptCache() to StaticData class and call it when updating suffix PTs 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3996 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-31 09:42:27 +00:00
dowobeha
9112d9b749 Syntactic LM doesn't require boost. Enabling synlm no longer automatically enables boost or boost threads. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3995 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 16:35:42 +00:00
dowobeha
a040227376 Syntactic LM can now be enabled by passing --with-synlm to configure. The path to the ModelBlocks parser is now assumed to be synlm/hhmm, and no longer needs to be explicitly specified. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3994 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 15:48:28 +00:00
dowobeha
3135cf9e3f Added SynLM parser 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3993 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 15:48:17 +00:00
dowobeha
d12dd2b4d7 Added additional level 3 logging to help verify that Syntactic LM is being loaded and used 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3992 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 15:47:47 +00:00
dowobeha
e04e155986 Syntactic LM can now be loaded properly by StaticData. This change should have been merged earlier, but was omitted. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3991 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-24 15:47:35 +00:00
bhaddow
b5c14a88c2 Second try at fixing configure bug introduced with synlm 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3990 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-23 20:17:46 +00:00
bhaddow
77c0228c54 Make sure threaded moses is only on if --enable-threads is set. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3989 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-23 19:47:19 +00:00
heafield
e0d618528a Speed improvements mostly. Trie went from 803448 queries/s to 990520 queries/s by knowing what the bounds are in advance. Also, set read ahead for 
files.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3988 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-23 02:23:01 +00:00
hieuhoang1972
7408636328 add --MaxLinesGTDiscount to usage display 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3987 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-22 16:02:26 +00:00
heafield
606d3c72b3 Denis Filimonov points out that NFS really likes an msync before munmap. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3986 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-20 19:34:52 +00:00
hieuhoang1972
5a0210855d minor warning 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3985 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-20 02:49:38 +00:00
heafield
c74f5446c8 Unbreak the build. Sorry about that. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3981 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-17 17:02:10 +00:00
heafield
1e05ab182e Allow broken IRST ARPAs to still build but be passive-aggressive about it. 
Slight update to SRI wrapper that nobody uses anyway.  



git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3980 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-17 16:43:05 +00:00
dowobeha
2c9f74ef71 Documented minimum version requirements for autoconf and m4 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3979 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-16 14:26:56 +00:00
naditomeh
5019e98abe A minor issue when trying to output the search graph with one of these 
flags: output-search-graph[-extended].
An empty input sentence results in a segfault.
Fix:
after the line
const Hypothesis *prevHypo = hypo->GetPrevHypo();
test if prevHypo is null before using it.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3978 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-16 13:41:15 +00:00
dowobeha
79812e789c Added files to .gitignore 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3977 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 21:02:25 +00:00
dowobeha
cd017c1448 Added missing syntactic LM function declaration. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3976 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 20:58:03 +00:00
dowobeha
c5ea64f69b Added files to .gitignore 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3975 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 19:41:44 +00:00
dowobeha
bc3aa42b9b Re-added two lines from config.h.in that shouldn't have been removed. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3974 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 19:41:07 +00:00
dowobeha
9581b6aae2 Updated syntactic classes (cherry-picking from commit bf7a7bb8e7) 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3973 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 19:28:23 +00:00
dowobeha
9375aa8846 Reverting changes. Revision 3971 was a bad commit. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3972 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 18:27:30 +00:00
dowobeha
bb941c01f6 Merge branch 'master' into local-trunk 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3971 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-13 18:07:21 +00:00
lagunex
3e69fc929a The client.perl example now tests the report-all-factors option 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3957 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-11 10:22:24 +00:00
lagunex
a8adc0d6f7 The server accepts an optional "report-all-factors" input parameter (boolean) to write all factors into the output text parameter, simulating the standard behavior of the standalone option 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3956 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-11 10:18:57 +00:00
jhclark
fb1a668bba Allow absoultizing binary lexro models, too. We don't want them getting jealous of binarized phrase tables. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3955 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-05 00:54:14 +00:00
jhclark
da6e4935fd Return 0 on success and 1 on fail. Not the other way around. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3954 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-05 00:51:35 +00:00
hieuhoang1972
2af2ea4746 minor gcc error 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3953 1f5c12ca-751b-0410-a591-d2e778427230
 2011-05-01 11:39:52 +00:00
oliver-wilson
c45e757c1f Put back missing typedef that broke the build. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3952 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-20 08:11:04 +00:00
heafield
3274f72bfb More documentation 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3951 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-19 15:17:01 +00:00
naditomeh
83d02c11c6 Fix a segmentation fault produced when both 'constraint' and 
'translation-details' are used, and no hypothesis that matches the
reference translation is found.
The problem resulted from a missing check if a vector is empty before
incrementing its iterator.


git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3950 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-17 19:46:46 +00:00
bhaddow
a836747b4e Add note about autoconf 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3947 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-14 15:57:10 +00:00
pjwilliams
b186fcd2c7 Simple SCFG rule extraction speed-ups based on callgrind profile. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3946 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-07 11:03:23 +00:00
heafield
a3385c3905 Chris Dyer wanted #include <cstddef> for newer g++ 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3945 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-06 21:14:24 +00:00
pjwilliams
70d67ffd46 Chart decoder: include child hypothesis costs in estimates when 
pruning the ChartTranslationOptionList.

git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3943 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-04 20:43:02 +00:00
heafield
a7584f57d5 Don't malloc non-PODs without calling their constructor. Also, exception safety. 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3942 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-02 01:57:22 +00:00
hieuhoang1972
8c4692e581 warnings 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3941 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-01 23:37:20 +00:00
hieuhoang1972
0fdde952bc compiles with clang++ 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3940 1f5c12ca-751b-0410-a591-d2e778427230
 2011-04-01 23:31:11 +00:00
hieuhoang1972
6acbdcdd28 derivation of n-best list output 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3939 1f5c12ca-751b-0410-a591-d2e778427230
 2011-03-30 21:31:15 +00:00
hieuhoang1972
adc2ac2c6a xcode 
git-svn-id: https://mosesdecoder.svn.sourceforge.net/svnroot/mosesdecoder/trunk@3938 1f5c12ca-751b-0410-a591-d2e778427230
 2011-03-30 20:31:09 +00:00