Commit Graph

63 Commits

Author SHA1 Message Date
Alexander Scharinger
21b330dad1 Github bridge: fix message about timeout 2021-03-27 22:45:49 +01:00
Alexander Scharinger
2646c63213 Github bridge: Refactor 2021-03-22 19:26:59 +01:00
Alexander Scharinger
52fba350d6 Github bridge: send message to user when waiting
When the Github GraphQL API rate limit is exhausted print a message at
the bottom of the terminal so the user knows why the import has been
paused.
2021-03-18 20:59:53 +01:00
Alexander Scharinger
93b14c509b Remove maps containing channels.
The old implementation of the github bridge used maps to store several
channels holding data obtained from the Github API. Removing the maps and
simply packing data and channels together in a struct and passing it
through one single channel makes the program simpler in terms of
concurrency and, additionally, enables the garbage collector to free the
memory gradually without any additional provisions.
2021-03-15 07:15:00 +01:00
Alexander Scharinger
9a8e487613 Fix errors: deadlock and empty titles 2021-03-15 07:14:40 +01:00
Alexander Scharinger
689b640bbb Deal with github bridge import rate limit 2021-02-28 21:03:10 +01:00
Alexander Scharinger
2d6f34acad Integrate new Github Bridge import 2021-01-24 21:37:44 +01:00
Michael Muré
fae3b2e7db
github: tighten the import matching 2020-03-28 17:08:27 +01:00
Michael Muré
893de4f5c0 identity: bring back the login to hold that info from bridges (purely informational) 2020-02-25 21:35:57 +01:00
Michael Muré
8ef6438fb4
Merge pull request #341 from MichaelMure/bridges-default-login
bridge: record the login used during the configure and use it as default credential
2020-02-23 19:20:45 +01:00
Michael Muré
f87d63b3c6
Merge pull request #331 from MichaelMure/webui/mutations
Webui: add comments
2020-02-23 14:49:09 +01:00
Michael Muré
0cebe1e57e
bridge: record the login used during the configure and use it as default credential
fix #338
2020-02-23 14:20:54 +01:00
Michael Muré
218d460590
webui: style SetStatus 2020-02-17 13:17:44 +01:00
Michael Muré
e231b6e839
bridges: pass the context to Init for when a client build process needs it 2020-02-15 15:46:36 +01:00
Michael Muré
fe3d5c95e4
bridges: massive refactor
- automatic flag validation and warning
- generalized prompt
- cleanups
2020-02-15 02:55:19 +01:00
Michael Muré
8773929f96
github: make sure to have a name 2020-02-08 22:04:25 +01:00
Michael Muré
646fd681ff
it compiles \o/ 2020-02-08 17:19:57 +01:00
Michael Muré
74e9114410
more more wip 2020-02-08 17:19:57 +01:00
Michael Muré
ae2f942ef9
more wip 2020-02-08 17:18:28 +01:00
Michael Muré
ee48aef489
github: warning when the comment to be edited is missing instead of failing
fix #286
2020-01-04 13:11:29 +01:00
Michael Muré
864d3ed335 bridge: allow to configure and pull without having set a user first
- init() only the importer or exporter as required
- assign a "default user" user Id to credentials at creation if no user has been set
- "bridge auth": also display the user
- "bridge auth show": adapt to a potential "default user" user Id
- "bridge configure": allow to run without a user set
- "bridge pull": allow to run without a user set
- "user adopt": replace "default user" by the actual user id when run
2019-12-25 23:25:39 +01:00
Michael Muré
f1ed857cbd
Merge pull request #271 from MichaelMure/bridge-credentials
bridge: huge refactor to accept multiple kind of credentials
2019-12-10 00:42:23 +01:00
Michael Muré
8f7f89561b
bridge: fix incorrect last import time on context cancel 2019-12-09 01:03:37 +01:00
Michael Muré
b92adfcb5f
bridge: huge refactor to accept multiple kind of credentials 2019-12-08 21:28:27 +01:00
amine
014e754fcd bridge/github: use core.ConfigKeyToken instead of keyToken 2019-11-23 19:20:55 +01:00
amine
d6d5978b6d bridge/launchpad: importer correctly emit NothingEvent 2019-11-19 20:33:20 +01:00
amine
87244d3c8d bridge/github: export correctly emit nothing events 2019-11-19 20:04:40 +01:00
amine
8b5685bb99 bridge/github: importer corectly emit events 2019-11-19 19:54:07 +01:00
amine
8ffe2a9b03 bridge/launchpad: add missing metadata
bridge: use a specific key for origin metadata
2019-11-19 19:16:16 +01:00
Amine Hilaly
df412430ab bridge/github: improve error handling and Nothing events
vendor: add package golang.org/x/sync/errgroup
2019-08-18 23:50:13 +02:00
Amine Hilaly
5ca326af83 bridge/core: add context.Context to ImportAll and ExportAll signatures
bridge/core: add ImportResult objects to stream import events

bridge/core: launchpad support asynchronous import

bridge/github: cancellable export and import functions

bridge/gitlab: cancellable export and import functions

commands: bridge pull/push gracefull kill

bridge/github: fix github import

bridge/github: use simple context for imports

bridge/core: name parameters in interfaces

github/core: Add EventError to export and import events types

bridge/gitlab: add context support in gitlab requests functions

bridge/gitlab: remove imported events count from importer logic

bridge/github: remove imported events count from importer logic

bridge/github: add context support in query and muration requets

bridge/github: fix bug duplicate editions after multiple calls

bridge/core: import import and export events String methods
bridge/gitlab: fix error handling in note import events

commands/bridge: Add statistics about imports and exports

bridge/gitlab: properly handle context cancellation

bridge/github: improve error handling

bridge: break iterators on context cancel or timeout

bridge: add context timeout support

bridge: improve event formating and error handling

commands: handle interrupt and switch cases

bridge/github: add export mutation timeouts

bridge: fix race condition bug in the github and gitlab importers
bridge/github: improve context error handling
2019-08-18 00:14:22 +02:00
Michael Muré
99b5c58d43 finish the refactoring for the dedicated identifier type 2019-08-12 16:12:14 +02:00
Michael Muré
612a29b031 fix everything following the hash-->id change 2019-08-08 19:06:13 +02:00
Amine Hilaly
9e611ee667
[bridge/github] import: avoid retrieving ghost email in userQuery
request

rename userQuery to ghostQuery
2019-07-06 16:20:05 +02:00
Amine Hilaly
4ad3d336c6
[bridge/github] use context.WithTimeout on all graphql queries 2019-06-24 21:32:38 +02:00
Amine Hilaly
07492fb72a
[bridge/github] importer: tag imported issues with origin metadata
[bridge/github] exporter: correct export signature and cache maps
2019-06-24 21:29:57 +02:00
Michael Muré
08c0e18ade cache: expose the operation when creating a new bug 2019-06-16 21:04:36 +02:00
Amine Hilaly
70268ff4ec
Change keyUser to keyOwner in Github bridge 2019-05-29 22:58:01 +02:00
Amine Hilaly
a6d85fbdbb
improve github importer and iterator
drop  and use query variables instead
initialize timeline query variables in the constructor
improve naming and add comments to public functions
2019-05-23 14:21:44 +02:00
Amine Hilaly
458f4da101
fix imported bugs count 2019-05-23 14:21:44 +02:00
Amine Hilaly
12f6fd61be
call NextIssueEdit from ensureIssue 2019-05-23 14:21:44 +02:00
Amine Hilaly
b6dfd45602
Fix importer/exporter design errors 2019-05-23 14:21:44 +02:00
Amine Hilaly
2e17f37175 Add unicode control characters test case
Move `cleanupText` to utils/text/transform.go
`text.Cleanup`: removing unicode control characters except for those allowed by `text.Safe`

Add golang.org/x/text dependencies

fix text.Cleanup

Fix import panic
2019-05-05 18:16:10 +02:00
Amine Hilaly
537eddb978 Fix import bug 2019-05-05 18:16:10 +02:00
Amine Hilaly
7d02963372 Add old importer comments in the iterator
Test operation authors
Fix typo in test repo url
2019-05-05 18:16:10 +02:00
Amine Hilaly
390ca86724 Improve naming and functions signatures
expose `NewIterator` in `github` package
remove `exist` in tests cases
skip tests when env var GITHUB_TOKEN is not given
2019-05-05 18:16:10 +02:00
Amine Hilaly
f7ea3421ca Add ForceLabelChange functionalities 2019-05-05 18:16:10 +02:00
Amine Hilaly
0d976f66e8 Add importer tests
Changes to Importer and exporter interface
Improve importer
Fix extra edits bug
2019-05-05 18:16:10 +02:00
Amine Hilaly
3bcaa35b5d Integrate iterator with importer 2019-05-05 18:16:10 +02:00
Michael Muré
b6bed784e5
github: fix potential bug due to var aliasing 2019-03-01 23:07:24 +01:00