By Using Kafka we can easily horizontally scale our application to do asynchronous pagination in ElasticSearch.
Let’s say you have an ElasticSearch Index of 1,000,000 documents and you need to run an operation on those documents.
One way of overcoming the problem is to use search_after. …
Here I'm trying to come up with a best practice solution for Maven-based applications CI/CD pipeline automation. As the number of your microservices increases, the challenge of deployments for versus versions of apps increases.
Note: Gitflow is a well-known git process but is not suitable when you have multiple versions in production at the same time. (custom versions depending on your VIP clients profile)
GitFlow is one way of overcoming this issue. You can have multiple development processes and at the same time, you can have release or deployment in parallel.
Here I’m using GitLab as my code-repo and CI/CD…
With the help of this maven-plugin, you can create your own private Maven Repository with the essential features. There are many commercial products out there, for example, Nexus, JFrog, and etc.., but the drawback is they required more resources (compute and storage) and some are costly. Where you can simply set up in your AWS cloud with much much less cost.
In databases, change data capture (CDC) is a set of software design patterns used to determine and track the data that has changed so that action can be taken using the changed data.
In this example, I’m going to demonstrate the scenario in which you are going to capture data changes from Postgres (Logical Replication enabled) into the Kafka cluster.
Strimzi is an open-source project that provides container images and operators for running Apache Kafka on Kubernetes and OpenShift. You can find more information on strimzi.io
Debezium’s PostgreSQL connector captures row-level changes in the schemas of a PostgreSQL database. PostgreSQL…
In this page I’m going to explain, How your spring boot application can interact with multiple data-sources not necessarily same type (Postgres for this demo) But it can be applicable across the other relational databases. There are cases that you need to have multiple datasources from different vendors, but the general concept is similar, and this example can be useful with little bit of changes in the project configuration (application.yml)
For this demo I choose PostgresSql Data Replication case, which is common in high load database with high traffic in Application.
There are times that even having the best DataBase…