Archive

The Dulin Report

Browsable archive from the WordPress export.

Results (69)

On the role of Distinguished Engineer and CTO Mindset Apr 27, 2025 The future is bright Mar 30, 2025 My giant follows me wherever I go Sep 20, 2024 On Amazon Prime Video’s move to a monolith May 14, 2023 One size does not fit all: neither cloud nor on-prem Apr 10, 2023 Some thoughts on the latest LastPass fiasco Mar 5, 2023 Comparing AWS SQS, SNS, and Kinesis: A Technical Breakdown for Enterprise Developers Feb 11, 2023 Why you should question the “database per service” pattern Oct 5, 2022 Stop Shakespearizing Sep 16, 2022 Monolithic repository vs a monolith Aug 23, 2022 All developers should know UNIX Jun 30, 2022 Scripting languages are tools for tying APIs together, not building complex systems Jun 8, 2022 Java is no longer relevant May 29, 2022 There is no such thing as one grand unified full-stack programming language May 27, 2022 Best practices for building a microservice architecture Apr 25, 2022 In most cases, there is no need for NoSQL Apr 18, 2022 What programming language to use for a brand new project? Feb 18, 2020 TDWI 2019: Architecting Modern Big Data API Ecosystems May 30, 2019 Returning security back to the user Feb 2, 2019 Microsoft acquires Citus Data Jan 26, 2019 Adobe Creative Cloud is an example of iPad replacing a laptop Jan 3, 2019 The religion of JavaScript Nov 26, 2018 Let’s talk cloud neutrality Sep 17, 2018 A conservative version of Facebook? Aug 30, 2018 On Facebook and Twitter censorship Aug 20, 2018 What does a Chief Software Architect do? Jun 23, 2018 Facebook is the new Microsoft Apr 14, 2018 Quick guide to Internet privacy for families Apr 7, 2018 Node.js is a perfect enterprise application platform Jul 30, 2017 Design patterns in TypeScript: Chain of Responsibility Jul 22, 2017 I built an ultimate development environment for iPad Pro. Here is how. Jul 21, 2017 Singletons in TypeScript Jul 16, 2017 The technology publishing industry needs to transform in order to survive Jun 30, 2017 Rather than innovating Walmart bullies their tech vendors to leave AWS Jun 27, 2017 Copyright in the 21st century or how "IT Gurus of Atlanta" plagiarized my and other's articles Mar 21, 2017 Emails, politics, and common sense Jan 14, 2017 Windows 10: a confession from an iOS traitor Jan 4, 2017 Collaborative work in the cloud: what I learned teaching my daughter how to code Dec 10, 2016 Don't trust your cloud service until you've read the terms Sep 27, 2016 I am addicted to Medium, and I am tempted to move my entire blog to it Sep 9, 2016 What I learned from using Amazon Alexa for a month Sep 7, 2016 Why I switched to Android and Google Project Fi and why should you Aug 28, 2016 In search for the mythical neutrality among top-tier public cloud providers Jun 18, 2016 Files and folders: apps vs documents May 26, 2016 What can we learn from the last week's salesforce.com outage ? May 15, 2016 Why it makes perfect sense for Dropbox to leave AWS May 7, 2016 JEE in the cloud era: building application servers Apr 22, 2016 Managed IT is not the future of the cloud Apr 9, 2016 JavaScript as the language of the cloud Feb 20, 2016 OAuth 2.0: the protocol at the center of the universe Jan 1, 2016 Operations costs are the Achille's heel of NoSQL Nov 23, 2015 IT departments must transform in the face of the cloud revolution Nov 9, 2015 Top Ten Differences Between ActiveMQ and Amazon SQS Sep 5, 2015 What Every College Computer Science Freshman Should Know Aug 14, 2015 Ten Questions to Consider Before Choosing Cassandra Aug 8, 2015 Your IT Department's Kodak Moment Jun 17, 2015 Smart IT Departments Own Their Business API and Take Ownership of Data Governance May 13, 2015 We Need a Cloud Version of Cassandra May 7, 2015 Building a Supercomputer in AWS: Is it even worth it ? Apr 13, 2015 Ordered Sets and Logs in Cassandra vs SQL Apr 8, 2015 Exploration of the Software Engineering as a Profession Apr 8, 2015 What can Evernote Teach Us About Enterprise App Architecture Apr 2, 2015 Microsoft and Apple Have Everything to Lose if Chromebooks Succeed Mar 31, 2015 Where AWS Elastic BeanStalk Could be Better Mar 3, 2015 Docker can fundamentally change how you think of server deployments Aug 26, 2014 Infrastructure in the cloud vs on-premise Aug 25, 2014 Cassandra: a key puzzle piece in a design for failure Aug 18, 2014 Cassandra: Lessons Learned Jun 6, 2014 Things I wish Apache Cassandra was better at Feb 12, 2014

Design patterns in TypeScript: Chain of Responsibility

July 22, 2017

In event-driven systems messages produced by one object can be handled by one or more other objects. None of the objects need to know of one another – all they need to share is a common mechanism for distributing messages. Messages are sent from one object to another making them part of a chain. This pattern is called “Chain of Responsibility.”

Chain of responsibility in TypeScript


Node.js – and TypeScript by association – have idiomatic support for asynchronous event-driven programming. The best way to implement this pattern is by utilizing the EventEmitter class.

EventEmitter acts as a message bus. Events can be emitted or sent and can be subscribed to. Objects emitting events are independent of objects subscribing to events. This message bus needs to be a Singleton since it is shared between event publishers and event subscribers.

Source: ChainOfResponsibility.ts


import {EventEmitter} from 'events';

var messageBus=new EventEmitter();

function messageConsumer(msg:Object) {
console.log(JSON.stringify(msg));
}

messageBus.on("topic", (msg) => {
messageConsumer(msg);
});

messageBus.emit("topic", {
payload: "Hello world"
});

Case study: equities trading system backend


Events are useful constructs that represent real-world business workflows. In an equities trading system, there is typically a front-end application that allows traders to enter orders. The orders are published on a message bus, and there are multiple consumers:

  1. Order Management System (OMS) whose purpose is to capture and track orders and executions of those orders. Large orders are rarely executed all in one shot – they are typically executed as some number of smaller parts.

  2. Compliance and reporting system whose purpose is to track everything that is happening and analyze data for potential patterns of fraud.


There can be many more participants in the ecosystems – market data, reporting, etc. For this article we’ll stick to a simple simulation of OMS and compliance.

Source: HFT.ts


import {EventEmitter} from 'events';

var messageBus=new EventEmitter();

interface Order {
orderId: number,
side:"Buy"|"Sell",
symbol:string,
quantity:number
}

interface Execution {
orderId: number,
executionId: number,
symbol: string,
quantity: number,
price: number
}

class OrderManagementSystem {


constructor() {
messageBus.on("order", (orderMessage) => {
this.processOrder(orderMessage as Order);
});
messageBus.on("execution", (executionMessage) => {
this.processExecution(executionMessage as Execution);
});
}

processOrder(order:Order) {
console.log(new Date().getTime()+":OMS:order:"+JSON.stringify(order));
var numberOfExecutions=10;
var quantityPerExecution=order.quantity/numberOfExecutions;
for (var i=0;i<numberOfExecutions;i++) {
messageBus.emit("execution", {
orderId:order.orderId,
executionId: i,
symbol: order.symbol,
quantity: quantityPerExecution,
price: 101.5

});
}
}

processExecution(execution:Execution) {
console.log(new Date().getTime()+":OMS:execution:"+JSON.stringify(execution));
}
}

class ComplianceSystem {
constructor() {
messageBus.on("order", (orderMessage) => {
this.trackOrder(orderMessage as Order);
});
messageBus.on("execution", (executionMessage) => {
this.trackExecution(executionMessage as Execution);
})
}

trackOrder(order:Order) {
console.log(new Date().getTime()+":COMPLIANCE:order:"+JSON.stringify(order));
}

trackExecution(execution:Execution) {
console.log(new Date().getTime()+":COMPLIANCE:execution:"+JSON.stringify(execution));
}
}

var oms=new OrderManagementSystem();
var compliance=new ComplianceSystem();


/**
* Simulate orders coming in from the front end
**/
for (var orderId=0;orderId<10;orderId++) {
messageBus.emit("order", {
orderId: orderId,
symbol: "MSFT",
quantity: 1000,
side: "Buy"
} as Order);
}

Node events implications for concurrency and parallelism


Even though Node supports asynchronous event processing, it is important to remember that there is a single CPU thread per Node process. That means that asynchronous processing of events does not necessarily happen in parallel.

To achieve true parallel event processing, Node.js offers cluster framework. This framework supports multiple forked Node processes running on the same physical machine to operate in parallel and take advantage of multi-core CPUs.

Event processing at scale


While cluster framework helps with taking advantage of multi-core CPUs, that is often not enough. In large enterprise systems, it is not uncommon to have both event publishers and event subscribers existing independently of one another. In a cloud environment, it is also possible to auto-scale event processors based on workload requirements.

Message queues are crucial for scalable event processing. While it is beyond the scope of this article to get into the details of message queues, here are some examples: