Monolithic Architecture
Single executable;
simpler deployment but less flexible and harder to scale.
Event-driven Architecture
Components communicate via events/messages;
fits market data handling and reactive trading engines.
Service-Oriented Architecture
(SOA)
Services expose interfaces via well-defined protocols;
emphasizes interoperability.
Message/Event Bus
Central channel for decoupled components to publish/subscribe messages
Publish/Subscribe
(Pub/Sub)
Decouples producers and consumers
Ring Buffer
Data structure for buffering messages/events
Horizontal Scaling
Adding more machines or processes to handle load
Vertical Scaling
Increasing resources (CPU, memory) in a single node
Partitioning
Splitting data across multiple processing units
Load Balancing
Distributing requests/messages evenly across workers to maximize throughput.
Batching
Aggregating multiple operations to reduce overhead and improve throughput.
Idempotency
Operations can be repeated safely without changing result
Transmission Control Protocol
(TCP)
Reliable, ordered, connection-oriented protocol; ensures all packets arrive and in order.
Used for order routing or critical data transfer.
User Datagram Protocol
(UDP)
Fast Unreliable, connectionless protocol; no guarantee of delivery or order.
Commonly used for market data feeds in low-latency systems.
Inter-Process Communication
(IPC)
Mechanisms for processes to exchange data
SQL
(Structured Query Language)
Relational database querying language.
Good for structured, transactional data (positions, trades).
NoSQL
Non-relational databases;
optimized for large-scale, flexible data storage.
Examples: key-value stores for caching, document stores for logs.
Data Lake
Centralized repository for raw, unstructured or semi-structured data;
used for analytics, historical market data storage.
Data Warehouse
Structured storage optimized for reporting and analytics;
often built on cleaned, processed data for dashboards or regulatory reporting.
Real-time
Systems or processes that respond with minimal latency, often deterministic