Any have experiences with Big Table? good or bad (bads always
more interesting)
I hope this message finds you well. We are at an important crossroads in
our project, and your expertise could provide valuable insights to help
make a pivotal decision.
We are currently running a high-load application on Google Cloud's
Postgres, which services between 10,000 to 15,000 queries per second and
adds approximately 10 million new records per day. Our database currently
stores about 4TB of data. However, we are facing some scaling issues,
particularly related to online operations such as detaching a partition,
which tend to lock and impact our service.
Our intention is to increase our operation scale 10-fold by the end of this
year, which will undeniably require a more robust and scalable database
solution. We have three potential options: transitioning to Oracle on
Oracle Cloud Infrastructure (OCI), Yugabute or moving to Google's Bigtable.
Personally, I lean towards Oracle, given its proven capability for handling
heavy loads and providing fine-grained control over queries. Also, Oracle
offers comprehensive monitoring and debugging tools, which would be
beneficial for managing the anticipated growth of our workload.
However, we understand the importance of making an informed decision and
are therefore eager to hear your thoughts.
Could you please provide your professional opinions on the potential pros
and cons of these three options, primarily Big Table, particularly in terms
of their capacity to handle our projected growth, ease of migration,
reliability, and cost-effectiveness?
Your insights will be instrumental in determining the best path forward for
our project.
Thank you in advance for your time and insights.
