Archive

The Dulin Report

Browsable archive from the WordPress export.

Results (46)

On the role of Distinguished Engineer and CTO Mindset Apr 27, 2025 The future is bright Mar 30, 2025 2024 Reflections Dec 31, 2024 Working from home works as well as any distributed team Nov 25, 2022 Good developers can pick up new programming languages Jun 3, 2022 In most cases, there is no need for NoSQL Apr 18, 2022 Kitchen table conversations Nov 7, 2021 Returning security back to the user Feb 2, 2019 Let’s talk cloud neutrality Sep 17, 2018 What does a Chief Software Architect do? Jun 23, 2018 Leaving Facebook and Twitter: here are the alternatives Mar 25, 2018 When politics and technology intersect Mar 24, 2018 Nobody wants your app Aug 2, 2017 The technology publishing industry needs to transform in order to survive Jun 30, 2017 Rather than innovating Walmart bullies their tech vendors to leave AWS Jun 27, 2017 I tried an Apple Watch for two days and I hated it Mar 30, 2017 Copyright in the 21st century or how "IT Gurus of Atlanta" plagiarized my and other's articles Mar 21, 2017 Emails, politics, and common sense Jan 14, 2017 Here is to a great 2017! Dec 26, 2016 What I learned from using Amazon Alexa for a month Sep 7, 2016 Amazon Alexa is eating the retailers alive Jun 22, 2016 In Support Of Gary Johnson Jun 13, 2016 Why it makes perfect sense for Dropbox to leave AWS May 7, 2016 JEE in the cloud era: building application servers Apr 22, 2016 In memory of Ed Yourdon Jan 23, 2016 Operations costs are the Achille's heel of NoSQL Nov 23, 2015 Banking Technology is in Dire Need of Standartization and Openness Sep 28, 2015 I Stand With Ahmed Sep 19, 2015 Top Ten Differences Between ActiveMQ and Amazon SQS Sep 5, 2015 What Every College Computer Science Freshman Should Know Aug 14, 2015 On Maintaining Personal Brand as a Software Engineer Aug 2, 2015 Social Media Detox Jul 11, 2015 The Three Myths About JavaScript Simplicity Jul 10, 2015 Your IT Department's Kodak Moment Jun 17, 2015 Big Data is not all about Hadoop May 30, 2015 Smart IT Departments Own Their Business API and Take Ownership of Data Governance May 13, 2015 Building a Supercomputer in AWS: Is it even worth it ? Apr 13, 2015 Microsoft and Apple Have Everything to Lose if Chromebooks Succeed Mar 31, 2015 Why I am Tempted to Replace Cassandra With DynamoDB Nov 13, 2014 Software Engineering and Domain Area Expertise Nov 7, 2014 Docker can fundamentally change how you think of server deployments Aug 26, 2014 Wall St. wakes up to underinvestment in OMS Aug 21, 2014 "Hello, World!" Using Apache Thrift Feb 24, 2013 Thoughts on Wall Street Technology Aug 11, 2012 Happy New Year! Jan 1, 2012 Eminence Grise: A trusted advisor May 13, 2009

In most cases, there is no need for NoSQL

April 18, 2022

Over the years, I learned the hard way that, with the exception of a few niche use cases, NoSQL databases such as AWS DynamoDB or Apache Cassandra are not always a good idea.



Here is why.



With a traditional SQL-based relational database, you design your data model to represent your business objects. Your queries can then evolve and can be ad-hoc. You can even create views, materialized or otherwise, to facilitate even more complex analytical queries.



DynamoDB does not offer the flexibility of traditional SQL. While your data model can evolve and you are not tied to a rigid schema, you have to design your data model around the queries you plan to run. 



The problem with that approach is that it is very rare for end-users to say with certainty what they want. Over time their needs change, and so do the queries they want to run. Changes to the storage model in DynamoDB involve running massive data reloads -- or complex code for backward compatibility.



Meanwhile, the ability to get to the application’s data, build reports, and run analytical queries is critical to the developer and business user productivity. It can mean a difference between delivering features in days vs. weeks.



Not all developers are created equal. SQL is a widely accepted and simple query language that business users should be capable of learning and using. Yet, many have trouble with even the most straightforward SQL. 



Introducing a whole new mechanism for querying their data, even if it is as mockingly similar to SQL as PartiQL, could be a problem. Traditional SQL databases have well-established libraries and toolsets. 



It is worth noting that DynamoDB now supports ACID transactions now as well. Still, I am here to argue that most enterprise application workloads will never reach the physical limitations of traditional RDBMS databases.




Conclusion




NoSQL technology is constantly evolving, as are traditional databases and managed cloud services. What I see happening is a convergence of functionality. There is a lot of cross-pollination of ideas going on in the industry, with NoSQL databases adopting some of the SQL functionality (think: PartiQL and SQL) and SQL databases adopting some of the NoSQL functionality (think: PostgreSQL NoSQL features). It is essential to keep a cool head and not jump on any new tech without understanding your use cases and skillsets.