Ghost/core/server
Nazar Gargol bbcc0f5178 Added batched members import API method
no issue

- New Member API batched import is meant to be a substitution to current import
with improved performance while keeping same behaviore. Current
import processes 1 record at a time using internal API calls and times
out consistently when large number of members has to be imported (~10k
records without Stripe).
- New import's aim is to improve performance and process >50K
records without timing out both with and without Stripe connected
members
- Batched import can be conceptually devided into 3 stages which have
their own ways to improve performance:
  1. labels - can be at current performance as number of
labels is usually small, but could also be improved through batching
  2. member records + member<->labels relations - these could
be performed as batched inserts into the database
  3. Stripe connections - most challanging bottleneck to solve because
API request are slow by it's nature and have to deal with rate limits of
Stripe's API itself
- It's a heavy WIP, with lots of known pitfalls which are marked with
TODOs. Will be solved iteratively through time untill the method can be
declared stable
- The new batched import method will be hidden behind 'enableDeveloperExperiments' flag to
allow early testing
2020-08-11 18:31:31 +12:00
..
adapters Moved core/server/lib/common/logging to core/shared/logging (#11857) 2020-05-28 19:30:23 +01:00
api Added batched members import API method 2020-08-11 18:31:31 +12:00
data Added migration to create indexes and constraints for member tables (#12108) 2020-08-06 14:57:05 +02:00
lib 🐛 Fixed srcset and sizes attributes being rendered when image resizing unavailable 2020-07-02 18:03:22 +01:00
models Reduced error level to default for not found post error 2020-08-03 23:16:53 +12:00
public Renamed members ssr + api endpoints 2020-04-30 19:00:37 +01:00
services Improved performance of sending newsletter emails (#12091) 2020-08-06 15:19:39 +02:00
translations Added an additional log to notify shutdown start 2020-08-10 14:53:05 +01:00
views Updated head to only output custom favicons (#11949) 2020-06-30 15:07:08 +01:00
web Added a server testmode to help test behaviour 2020-08-10 16:38:49 +01:00
analytics-events.js Moved config from server to shared (#11850) 2020-05-27 18:47:53 +01:00
ghost-server.js Added a server testmode to help test behaviour 2020-08-10 16:38:49 +01:00
index.js Refactored server announce functions to be clearer 2020-08-09 17:25:15 +01:00
overrides.js Disabled bluebird debug logs 2018-08-13 14:01:31 +02:00
update-check.js Moved core/server/lib/common/logging to core/shared/logging (#11857) 2020-05-28 19:30:23 +01:00