Commit Graph

17477 Commits

Author SHA1 Message Date
Anoop Kunchukuttan
2cb12decc8 dynamic cast to SentenceWithCandidates (failed) 2020-10-04 22:43:48 +05:30
sid jain
125f33fa68 sMerge branch 'master' of https://machinetranslation.visualstudio.com/DefaultCollection/moses-mstranslator/_git/moses-mstranslator 2020-10-02 23:43:38 +05:30
Hieu Hoang
a269d24db2 InitializeForInput() 2020-10-01 10:39:47 -07:00
Hieu Hoang
2e94ba7a9f add input arg to CleanUpAfterSentenceProcessing 2020-10-01 10:33:59 -07:00
sid jain
4c7469dda1 merge
Merge branch 'master' of https://machinetranslation.visualstudio.com/DefaultCollection/moses-mstranslator/_git/moses-mstranslator
2020-10-01 22:46:29 +05:30
Hieu Hoang
95d93f8bd1 make sure InitializeForInput is called 2020-10-01 10:10:20 -07:00
Hieu Hoang
1adc2f9f94 InitializeForInput() 2020-10-01 10:03:32 -07:00
sid jain
7a14ab3fe4 Merge branch 'master' of https://machinetranslation.visualstudio.com/DefaultCollection/moses-mstranslator/_git/moses-mstranslator 2020-10-01 21:58:38 +05:30
Hieu Hoang
e971f23eee register MSPT 2020-10-01 08:53:24 -07:00
sid jain
530e177b01 Merge branch 'master' of https://machinetranslation.visualstudio.com/DefaultCollection/moses-mstranslator/_git/moses-mstranslator 2020-10-01 18:45:02 +05:30
Anoop Kunchukuttan
fa11ef6e94 basic parsing of input string 2020-10-01 16:48:19 +05:30
Anoop Kunchukuttan
e6f5d6f797 Merge branch 'master' changes 2020-10-01 09:15:07 +05:30
Anoop Kunchukuttan
d97c54b729 changes to handle part input 2020-10-01 08:38:30 +05:30
Hieu Hoang
d74ef34591 delete SentenceWithCandidates::XMLParse 2020-09-30 11:06:38 -07:00
Hieu Hoang
07716a821f Merge branch 'master' of vs-ssh.visualstudio.com:v3/machinetranslation/moses-mstranslator/moses-mstranslator 2020-09-30 10:37:46 -07:00
Hieu Hoang
ad829d3b3f compiles 2020-09-30 10:35:08 -07:00
Anoop Kunchukuttan
d325b0d274 restored build commands 2020-09-30 22:38:27 +05:30
Anoop Kunchukuttan
a6c60a6412 add SentenceWithCandidates class 2020-09-30 22:19:48 +05:30
sid jain
2fa5c1cfad sample 2020-09-30 21:38:43 +05:30
Anoop Kunchukuttan
c635efaf23 added to typedef 2020-09-30 21:34:53 +05:30
Anoop Kunchukuttan (STC INDIA)
2b6d72ccb9 corrected URL for cmph 2020-09-03 18:07:24 +05:30
Anoop Kunchukuttan (STC INDIA)
8fbb193b2b added cmph information 2020-09-03 18:00:48 +05:30
Anoop Kunchukuttan (STC INDIA)
f15249b14b added cgmanifest file 2020-09-03 16:57:11 +05:30
Anoop Kunchukuttan (STC INDIA)
1d2424cd68 Remove explicit component governance task 2020-09-03 09:38:42 +00:00
Anoop Kunchukuttan (STC INDIA)
0cc1727fb4 simplify moses build (no xmplrpc and cmph) 2020-09-03 14:40:32 +05:30
Anoop Kunchukuttan (STC INDIA)
1ec64c8816 add libssl-dev package installation to build pipeline 2020-09-03 14:24:46 +05:30
Anoop Kunchukuttan (STC INDIA)
e934151845 changes to xmlrpc build and link 2020-09-03 13:54:43 +05:30
Anoop Kunchukuttan (STC INDIA)
70b1a28d70 fix build errors 2020-09-03 13:18:46 +05:30
Anoop Kunchukuttan (STC INDIA)
7b4becfcdd fix errors in download of libraries 2020-09-03 13:17:17 +05:30
Anoop Kunchukuttan (STC INDIA)
af5cd8948c Merge branch 'master' of https://machinetranslation.visualstudio.com/DefaultCollection/moses-mstranslator/_git/moses-mstranslator 2020-09-03 13:05:11 +05:30
Anoop Kunchukuttan (STC INDIA)
70aebfcbfb fix errors in pipeline 2020-09-03 13:04:53 +05:30
Anoop Kunchukuttan (STC INDIA)
613a8e6bc7 Set up CI with Azure Pipelines
correct image [skip ci]
2020-09-03 07:27:47 +00:00
Anoop Kunchukuttan (STC INDIA)
33da1af73a added new pipelines 2020-09-03 12:55:22 +05:30
Anoop Kunchukuttan (STC INDIA)
5f1c2c2d80 Update azure-pipelines.yml for Azure Pipelines 2020-09-02 10:28:44 +00:00
Anoop Kunchukuttan (STC INDIA)
5ab839aa3e Update azure-pipelines.yml for Azure Pipelines 2020-09-02 10:28:05 +00:00
Anoop Kunchukuttan (STC INDIA)
fc1e484a8f Update azure-pipelines.yml for Azure Pipelines 2020-09-02 10:24:07 +00:00
Anoop Kunchukuttan (STC INDIA)
53ea29008f Updated azure-pipelines.yml 2020-09-02 10:20:39 +00:00
Anoop Kunchukuttan (STC INDIA)
04fe2f4c25 Set up CI with Azure Pipelines
[skip ci]
2020-09-02 10:17:33 +00:00
Hieu Hoang
83baf4daec add MSPT files 2020-08-05 10:23:03 -07:00
Hieu Hoang
e99d9a0d21 Merge github.com:hieuhoang/msmoses 2020-08-05 10:22:40 -07:00
Hieu Hoang
96fd873594 start MSPT 2020-08-05 10:07:49 -07:00
Kenneth Heafield
78ca5f3cc5 Allow Arabic letters to begin a fa sentence 2020-08-03 21:51:09 +01:00
Hieu Hoang
d65d392d46
Merge pull request #222 from cristinae/patch-1
adding rules for Catalan
2020-07-31 09:31:17 -07:00
Cristina España i Bonet
8d78dae634
adding rules for Catalan
special characters within words and contractions closer to French than to English
2020-07-31 15:22:47 +02:00
Barry Haddow
47915b561f escape ampersands 2020-06-30 08:10:56 +01:00
Hieu Hoang
d90a8df862
Merge pull request #221 from HjalmarrSv/master
Added some for sv
2020-06-01 17:19:36 -07:00
HjalmarrSv
b7038d5f24
Merge pull request #1 from HjalmarrSv/HjalmarrSv-patch-1
Update nonbreaking_prefix.sv
2020-05-23 17:46:04 +02:00
HjalmarrSv
da3768a296
Update nonbreaking_prefix.sv
Added Å Ä Ö, which are not unusual initials in names, e.g. Åke, Ärling, Östen.
Added some new, but mostly variations on the existing ones. Both a dot after each letter (or pair) and a dot only after last letter are accepted forms. A couple of decades ago, there had to be a space after the dot, which explains the third form.
The file for sv is much more useful with these few additions. Although, It is still far from complete.
Removed: G (occured twice).
In this list there is one item that is also a word, even when case is kept: tom.
If all words are in small case, then tex, mao, tom (again), may be confused with names, and iaf, etc with named entities.
2020-05-23 17:43:33 +02:00
Kenneth Heafield
89b9b4fba2 sentence splitter -k option to keep line boundaries 2020-03-19 15:44:41 +00:00
Kenneth Heafield
0a892749bc Add Pashto ؟ as a sentence splitting character 2020-03-19 12:06:50 +00:00