Ghost/ghost
Chris Raible 829a0fc7e9
Added email analytics throughput metrics (#21694)
ref
https://linear.app/ghost/issue/ENG-1508/add-custom-metrics-for-email-analytics-jobs

- With the experimental job queue, we're using email analytics as our
initial validation test case. We're hoping to see an improvement in
Ghost's throughput for ingesting email events. However, we don't
currently collect this data point, so it's kind of impossible to tell
right now if the job queue is making things better or not.
- This PR fixes that by adding two new prometheus metrics:
- `email_analytics_events_processed` — a counter incremented each time
an event is processed. Sometimes the event has already been processed in
the past, so this doens't always result in a new event being stored in
the DB.
- `email_analytics_events_stored` — a counter incremented each time an
event is stored in the DB. For example, if an email is opened 3 times by
the same recipient, this counter will only be incremented once.
- The metrics also have a label for the event type, so we can split out
opened events from delivered events. We can use the `rate()` function in
grafana to then get an `events ingested per second` metric, and compare
sites with/without the job queue enabled.
2024-11-21 17:30:43 -08:00
..
activitypub Initialised ActivityPub integration on boot (#21558) 2024-11-07 13:55:51 +00:00
adapter-cache-memory-ttl Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
adapter-cache-redis Added an optional timeout parameter to AdapterCacheRedis (#20131) 2024-05-02 20:39:23 -07:00
adapter-manager Update TryGhost packages 2024-08-05 12:12:34 +02:00
admin 🐛 Fixed Istanbul timezone (#21686) 2024-11-21 17:23:21 +00:00
announcement-bar-settings Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
api-framework Update TryGhost packages 2024-08-05 12:12:34 +02:00
api-version-compatibility-service Fixed handling requests with mismatching version and missing key 2024-05-02 13:03:26 +02:00
audience-feedback 🔒 Added uuid verification to member endpoints not requiring a session 2024-08-20 16:24:02 +02:00
bookshelf-repository 🐛 Fixed NQL filters for single letter slugs (#21340) 2024-10-17 15:35:26 +00:00
bootstrap-socket Update TryGhost packages 2024-08-05 12:12:34 +02:00
collections 🐛 Fixed NQL filters for single letter slugs (#21340) 2024-10-17 15:35:26 +00:00
constants Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
core Added email analytics throughput metrics (#21694) 2024-11-21 17:30:43 -08:00
custom-fonts Added Libre Baskerville font (#21539) 2024-11-06 15:27:47 +08:00
custom-theme-settings-service 🐛 Fixed NQL filters for single letter slugs (#21340) 2024-10-17 15:35:26 +00:00
data-generator Update TryGhost packages 2024-08-05 12:12:34 +02:00
domain-events Update TryGhost packages 2024-08-05 12:12:34 +02:00
donations Switched build and build:ts scripts 2024-09-02 15:20:03 +02:00
dynamic-routing-events Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
email-addresses Update dependency nodemailer to v6.9.16 2024-10-28 11:17:18 +00:00
email-analytics-provider-mailgun Reimplemented email analytics prioritizing email opens (#20914) 2024-09-05 08:10:07 -05:00
email-analytics-service Added metrics for job queue and email analytics (#21626) 2024-11-15 13:17:42 -06:00
email-content-generator Lazyloaded several required dependencies 2024-07-26 09:52:26 +02:00
email-events Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
email-service Added email analytics throughput metrics (#21694) 2024-11-21 17:30:43 -08:00
email-suppression-list Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
express-dynamic-redirects Optimized loading dynamic redirects 2024-10-14 17:16:49 +02:00
external-media-inliner Add Lexical support to the external-media-inliner (#19149) 2023-11-29 17:56:03 +00:00
extract-api-key Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
ghost Update nest monorepo to v10.4.4 2024-10-15 12:44:37 +02:00
html-to-plaintext Added in-reply-to support to comments API 2024-11-07 09:20:03 +00:00
i18n 🌐 Updated pt-BR translations (#21636) 2024-11-21 18:37:17 +00:00
identity-token-service Refactored identity token generation into separate service 2024-11-07 13:16:33 +07:00
importer-handler-content-files Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
importer-revue Update Koenig packages 2024-08-14 15:34:44 +01:00
in-memory-repository 🐛 Fixed NQL filters for single letter slugs (#21340) 2024-10-17 15:35:26 +00:00
job-manager Added metrics for job queue and email analytics (#21626) 2024-11-15 13:17:42 -06:00
link-redirects Updated documentation for LinkRedirects (#20378) 2024-06-12 23:27:15 +00:00
link-replacer Pinned dependencies (#20257) 2024-05-27 15:29:32 +00:00
link-tracking 🐛 Fixed NQL filters for single letter slugs (#21340) 2024-10-17 15:35:26 +00:00
magic-link Added Sentry message logging for generating magic links (#20789) 2024-08-20 08:38:12 +01:00
mail-events Switched build and build:ts scripts 2024-09-02 15:20:03 +02:00
mailgun-client Update dependency mailgun.js to v10.2.4 (#21685) 2024-11-21 16:54:50 +00:00
member-attribution Fixed extra arguments being supplied to function calls 2024-05-07 11:44:07 +02:00
member-events Added experimental background job queue (#20985) 2024-11-04 10:13:15 -06:00
members-api 🐛 Fixed malformed unsubscribe_url in members api response (#21437) 2024-10-28 15:36:05 -05:00
members-csv Update dependency pump to v3.0.2 2024-09-11 10:16:42 +00:00
members-events-service Added caching to LastSeenAtUpdater (#20964) 2024-09-13 00:54:43 -07:00
members-importer Update TryGhost packages 2024-08-05 12:12:34 +02:00
members-ssr Update TryGhost packages 2024-08-05 12:12:34 +02:00
mentions-email-report Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
milestones Update TryGhost packages 2024-08-05 12:12:34 +02:00
minifier 🐛 Fixed minifier for Windows users (#21311) 2024-11-21 00:00:29 +00:00
model-to-domain-event-interceptor Switched build and build:ts scripts 2024-09-02 15:20:03 +02:00
mw-api-version-mismatch Update TryGhost packages 2024-08-05 12:12:34 +02:00
mw-cache-control Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
mw-error-handler Update TryGhost packages 2024-08-05 12:12:34 +02:00
mw-session-from-token Update dependency express to v4.21.1 2024-10-08 21:53:17 +01:00
mw-update-user-last-seen Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
mw-version-match Update TryGhost packages 2024-08-05 12:12:34 +02:00
mw-vhost Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
nql-filter-expansions Switched build and build:ts scripts 2024-09-02 15:20:03 +02:00
oembed-service Not storing icons and thumbnails in case of mention (#21424) 2024-10-28 05:29:49 +00:00
offers Update TryGhost packages 2024-08-05 12:12:34 +02:00
package-json Update TryGhost packages 2024-08-05 12:12:34 +02:00
payments 🐛 Fixed Tips & Donations checkout error for sites with long titles 2024-09-03 21:08:24 +01:00
post-events Added unschedule bulk action to posts (#20945) 2024-09-24 15:32:45 +08:00
post-revisions Switched build and build:ts scripts 2024-09-02 15:20:03 +02:00
posts-service 🐛 Fixed NQL filters for single letter slugs (#21340) 2024-10-17 15:35:26 +00:00
prometheus-metrics Added metrics for job queue and email analytics (#21626) 2024-11-15 13:17:42 -06:00
recommendations 🐛 Fixed missing incoming recommendations (#21317) 2024-10-16 11:14:58 +02:00
referrers Configured all unit tests to use dot reporter 2023-10-05 12:24:24 +02:00
security Updated uuid to crypto.randomUUID() (#20821) 2024-09-12 09:09:30 +07:00
session-service Changed SSO adapter to automatically verify sessions (#21388) 2024-11-11 22:26:40 +00:00
settings-path-manager Update TryGhost packages 2024-08-05 12:12:34 +02:00
slack-notifications Update TryGhost packages 2024-08-05 12:12:34 +02:00
staff-service 🐛 Fixed words breaking to new line in emails on mobile (#21652) 2024-11-19 10:43:32 +00:00
stats-service Update dependency luxon to v3.5.0 2024-08-05 09:19:48 +02:00
stripe Lazyloaded dependencies 2024-10-10 13:38:56 +01:00
tiers Update TryGhost packages 2024-08-05 12:12:34 +02:00
tinybird Fix origin attribution in Tinybird analytics hits (#21187) 2024-10-02 17:27:43 +01:00
update-check-service Updated uuid to crypto.randomUUID() (#20821) 2024-09-12 09:09:30 +07:00
verification-trigger Update TryGhost packages 2024-08-05 12:12:34 +02:00
version-notifications-data-service Fixed handling requests with mismatching version and missing key 2024-05-02 13:03:26 +02:00
webmentions 🐛 Fixed missing incoming recommendations (#21317) 2024-10-16 11:14:58 +02:00
tsconfig.json Disabled TypeScript incremental building 2023-08-09 18:27:56 +02:00