Skip to content

Receives data from a data-generator-service using Apache Kafka and collects it for analytics. The simple client of this app is the data-info-service

Notifications You must be signed in to change notification settings

Serheev/data-handler-service

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Data handle service

Receives data from Data generator service with Apache Kafka.

Next, data is processed by Client info service.

Usage

To start an application you need to pass variables to .env file.

You can find Docker compose file in docker/docker-compose.yaml.

Application is running on port 8082.

All insignificant features (checkstyle, build check, dto validation) are not presented.

Just after startup application will try to connect to Apache Kafka and begin to listen topics from KAFKA_SUBSCRIBED_TOPICS.

Docker

You can run all applications via docker-compose.yaml from docker folder.

It contains all needed configs.

NOTE: after Debezium connect is started, apply source config manually.

cd /on-startup/

curl -i -X POST -H "Accept:application/json" -H \
"Content-Type:application/json"  http://localhost:8083/connectors/ -d \
@postgres-connector.json

Note that all services must be in the same network to communicate with each other.

Debezium needs different group id than Kafka uses, so default values from .env are 1 and 2.

Debezium is configured to push messages to data topic due to routing in configuration.

About

Receives data from a data-generator-service using Apache Kafka and collects it for analytics. The simple client of this app is the data-info-service

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published