Description

Harbor Conduit is an internal automation orchestration platform built on Apache Airflow to centralize and manage institutional automation workflows across the college.

Prior to its implementation, automation scripts were scattered across systems, lacked version control, and operated with limited visibility. Failures often go unnoticed until users reported it. Harbor Conduit consolidates these workflows into a unified scheduling and monitoring framework, providing structured logging, dependency management, and real-time execution visibility.

As part of this modernization initiative, all scripts were migrated into GitHub for version control and collaborative development. The platform was containerized using a custom Docker Compose configuration and integrated into a CI/CD pipeline that builds and deploys Docker images automatically. Using Watchtower, running containers are automatically updated to the latest validated image versions, ensuring consistent and streamlined deployments.

The platform was designed to be language-agnostic, enabling existing and new automation scripts written in Golang, PHP, and Python to be integrated into Airflow DAGs without requiring rewrites. This allowed legacy and modern services to coexist within a standardized orchestration environment.