This week’s system design briefer:
-
How does DNS work?
-
How Discord Shops Trillions Of Messages
-
Silicon Valley Financial institution (SVB) collapse
-
What’s new in GPT-4
-
Job openings
Straightforward SOC 2 compliance + AI-based RFP automation (Sponsored)
With a streamlined workflow and skilled steerage, automates the complete compliance course of, end-to-end.
What makes Secureframe totally different?
-
Get audit-ready and obtain compliance in weeks, not months with built-in remediation steerage and 100+ integrations.
-
Keep compliant with the most recent rules and necessities together with ISO 27001, GDPR, HIPAA, PCI, and different requirements.
-
and safety questionnaires with AI.
-
Trusted by hyper-growth organizations: AngelList, Ramp, Lob, Distant, and hundreds of different companies.
How does DNS work?
How Discord Shops Trillions Of Messages
The diagram beneath exhibits the evolution of message storage at Discord:
MongoDB ➡️ Cassandra ➡️ ScyllaDB
In 2015, the primary model of Discord was constructed on high of a single MongoDB duplicate. Round Nov 2015, MongoDB saved 100 million messages and the RAM couldn’t maintain the info and index any longer. The latency turned unpredictable. Message storage must be moved to a different database. Cassandra was chosen.
In 2017, Discord had 12 Cassandra nodes and saved billions of messages.
At the start of 2022, it had 177 nodes with trillions of messages. At this level, latency was unpredictable, and upkeep operations turned too costly to run.
There are a number of causes for the problem:
-
Cassandra makes use of the LSM tree for the interior knowledge construction. The…