This document contains all data-related resources for the Analytics Engine (Phase 1).
ERIN:
Construct server application to facilitate:
Construct program functions to:
Create browser-based UI for manual reporting and control of data analysis
The Data Analytics engine is the primary data science application. It resides inside of the VPN. It writes data from the data warehouse server to the data analysis server(s). It performs all analysis and integration of other data, including user data, into coherent data sets.
Ubuntu Server
Rust Axum Application with Static React.js UI
Planning
The API gateway is the server-based program that manages the ingest of data via API from various resources. It resides outside of the VPN, but has access to the Data Warehouse Database in that VPN.
Ubuntu Server
Python 3 application
v0.01 (Beta)
The Data Warehouse is the primary database(s) responsible for receiving ingested third party data, as well as its normalization. That data is then made available to the Data Analytics Engine, which extracts this data for downstream usage
Ubuntu Server
Postgresql Database
v0.01 (Beta)
The data analytics databases(s) receive data from the data analytics engine, both as analytics generated from its analysis, as well as copies of segment data from the data warehouse(s)
Ubuntu Server
Postgresql Database
Planning