Archive

The Dulin Report

Browsable archive from the WordPress export.

Results (64)

Strategic activity mapping for software architects May 25, 2025 On the role of Distinguished Engineer and CTO Mindset Apr 27, 2025 The future is bright Mar 30, 2025 2024 Reflections Dec 31, 2024 My giant follows me wherever I go Sep 20, 2024 Are developer jobs truly in decline? Jun 29, 2024 Some thoughts on recent RTO announcements Jun 22, 2023 One size does not fit all: neither cloud nor on-prem Apr 10, 2023 Should today’s developers worry about AI code generators taking their jobs? Dec 11, 2022 Working from home works as well as any distributed team Nov 25, 2022 Why you should question the “database per service” pattern Oct 5, 2022 Good developers can pick up new programming languages Jun 3, 2022 There is no such thing as one grand unified full-stack programming language May 27, 2022 Peloton could monetize these ideas if they only listen May 15, 2022 Good idea fairy strikes when you least expect it May 2, 2022 Best practices for building a microservice architecture Apr 25, 2022 TypeScript is a productivity problem in and of itself Apr 20, 2022 In most cases, there is no need for NoSQL Apr 18, 2022 A year of COVID taught us all how to work remotely Feb 10, 2021 Making the best of remote work - Coronavirus blues Mar 16, 2020 TDWI 2019: Architecting Modern Big Data API Ecosystems May 30, 2019 Using Markov Chain Generator to create Donald Trump's state of union speech Jan 20, 2019 The religion of JavaScript Nov 26, 2018 Let’s talk cloud neutrality Sep 17, 2018 Fixing the Information Marketplace Aug 26, 2018 What does a Chief Software Architect do? Jun 23, 2018 I downloaded my Facebook data. Nothing there surprised me. Apr 14, 2018 Nobody wants your app Aug 2, 2017 Node.js is a perfect enterprise application platform Jul 30, 2017 Design patterns in TypeScript: Chain of Responsibility Jul 22, 2017 Singletons in TypeScript Jul 16, 2017 Rather than innovating Walmart bullies their tech vendors to leave AWS Jun 27, 2017 Architecting API ecosystems: my interview with Anthony Brovchenko of R. Culturi Jun 5, 2017 TDWI 2017, Chicago, IL: Architecting Modern Big Data API Ecosystems May 30, 2017 Collaborative work in the cloud: what I learned teaching my daughter how to code Dec 10, 2016 Don't trust your cloud service until you've read the terms Sep 27, 2016 In search for the mythical neutrality among top-tier public cloud providers Jun 18, 2016 What can we learn from the last week's salesforce.com outage ? May 15, 2016 Why it makes perfect sense for Dropbox to leave AWS May 7, 2016 JavaScript as the language of the cloud Feb 20, 2016 OAuth 2.0: the protocol at the center of the universe Jan 1, 2016 Our civilization has a single point of failure Dec 16, 2015 IT departments must transform in the face of the cloud revolution Nov 9, 2015 What Every College Computer Science Freshman Should Know Aug 14, 2015 Ten Questions to Consider Before Choosing Cassandra Aug 8, 2015 On Maintaining Personal Brand as a Software Engineer Aug 2, 2015 The Three Myths About JavaScript Simplicity Jul 10, 2015 Book Review: "Shop Class As Soulcraft" By Matthew B. Crawford Jul 5, 2015 Attracting STEM Graduates to Traditional Enterprise IT Jul 4, 2015 Your IT Department's Kodak Moment Jun 17, 2015 The longer the chain of responsibility the less likely there is anyone in the hierarchy who can actually accept it Jun 7, 2015 Big Data is not all about Hadoop May 30, 2015 Smart IT Departments Own Their Business API and Take Ownership of Data Governance May 13, 2015 The Clarkson School Class of 2015 Commencement speech May 5, 2015 Building a Supercomputer in AWS: Is it even worth it ? Apr 13, 2015 Ordered Sets and Logs in Cassandra vs SQL Apr 8, 2015 What can Evernote Teach Us About Enterprise App Architecture Apr 2, 2015 Microsoft and Apple Have Everything to Lose if Chromebooks Succeed Mar 31, 2015 Software Engineering and Domain Area Expertise Nov 7, 2014 Wall St. wakes up to underinvestment in OMS Aug 21, 2014 Software Engineers Are Not Doctors Aug 3, 2014 Cassandra: Lessons Learned Jun 6, 2014 Java, Linux and UNIX: How much things have progressed Dec 7, 2010 Eminence Grise: A trusted advisor May 13, 2009

In most cases, there is no need for NoSQL

April 18, 2022

Over the years, I learned the hard way that, with the exception of a few niche use cases, NoSQL databases such as AWS DynamoDB or Apache Cassandra are not always a good idea.



Here is why.



With a traditional SQL-based relational database, you design your data model to represent your business objects. Your queries can then evolve and can be ad-hoc. You can even create views, materialized or otherwise, to facilitate even more complex analytical queries.



DynamoDB does not offer the flexibility of traditional SQL. While your data model can evolve and you are not tied to a rigid schema, you have to design your data model around the queries you plan to run. 



The problem with that approach is that it is very rare for end-users to say with certainty what they want. Over time their needs change, and so do the queries they want to run. Changes to the storage model in DynamoDB involve running massive data reloads -- or complex code for backward compatibility.



Meanwhile, the ability to get to the application’s data, build reports, and run analytical queries is critical to the developer and business user productivity. It can mean a difference between delivering features in days vs. weeks.



Not all developers are created equal. SQL is a widely accepted and simple query language that business users should be capable of learning and using. Yet, many have trouble with even the most straightforward SQL. 



Introducing a whole new mechanism for querying their data, even if it is as mockingly similar to SQL as PartiQL, could be a problem. Traditional SQL databases have well-established libraries and toolsets. 



It is worth noting that DynamoDB now supports ACID transactions now as well. Still, I am here to argue that most enterprise application workloads will never reach the physical limitations of traditional RDBMS databases.




Conclusion




NoSQL technology is constantly evolving, as are traditional databases and managed cloud services. What I see happening is a convergence of functionality. There is a lot of cross-pollination of ideas going on in the industry, with NoSQL databases adopting some of the SQL functionality (think: PartiQL and SQL) and SQL databases adopting some of the NoSQL functionality (think: PostgreSQL NoSQL features). It is essential to keep a cool head and not jump on any new tech without understanding your use cases and skillsets.