IoT project with sets of infrastructure containing IoT center providing monitoring, real time data streaming, analytical environment, IoT sensors, boards and instructions.

Custom Spark Docker Environment, Spark Local and Standalone, also MySQL and Jupyterlab.

This set of code and instructions has the porpouse to instanciate a compiled environment with set of docker images like airflow webserver, airflow scheduler, postgresql, pyspark, Data Pipeline cons…

If you are looking for a tool which can provide you an unified platform with task job scheduler (Talend, Windows Batch Scripts, Linux Bash Scripts, Python Scripts, Spark Jobs, etc) and also a syste…

Python Agent for Extract, Transform and load Talend Remote Engine log files into Elasticsearch + Kibana Dashboards