DS Work

Introduction

Work of the Tópicos Especiais em Redes e Sistemas Distribuídos (Special Topics in Networks and Distributed Systems) discipline that uses Docker Compose to orchestrate four interconnected Docker containers.

The system is composed of the containers: producer; queue; consumer; and db (database).

Work architecture:

The API used in the project was the Instagram Profile. The API takes an Instagram userName and returns that user's real name and profile picture.

Containers

The db container is running on a postgres image and the others containers on Node images. All requests are made using Axios.

All containers run on the "net" network, created in Docker Compose. They can be accessed via http://localhost:port.

producer

The producer sends to the queue all the userNames that are in the assets/data.txt file.

This server run on port 3010.

queue

When the queue container receives a userName, it sends it to the consumer until the queue is empty.

This server run on port 3011.

consumer

The consumer receives the userName from the queue and sends it to the API, if there is no problem it saves it in the database in the format: [userName, realName, imageLink].

This server run on port 3012.

db

Finally, the consumer saves the data in the container table db (instagram_profile) that has the fields: user_name; real_name; and img.

How to use

Requirements

docker compose

Run

Clone this repository:

git clone https://github.com/renansilva15/ds-work 

Go to consumer/src/consumer.js and change the API_KEY. You can get a new key here.

After change the API_KEY, go to docker-compose.yml folder and run the command below in the terminal:

docker compose up

Finally make a GET request to the producer, it will send all userNames in the assets/data.txt file to the queue.

Producer link:

http://localhost:3010

---

Made with ❤️ by brunowanderson7 and renansilva15