Team experience · AI & servers
An AI platform for a government service in a closed network
- What we did
- A chat with a language model, answers from internal documents and image generation, running on the client’s servers without internet access.
- Our role
- Our infrastructure engineer was responsible for the infrastructure and model deployment within the project team.
Document assistant
Offline network · your serversModel in your networkDatabases are backed up every night. Copies are kept for 30 days on a separate server inside the network. Recovery is checked once a month.
Databases are backed up every night. Copies are kept for 30 days on a separate server inside the network.
4.2. Database backups
Database backups are made every night and kept for 30 days on a separate server inside the network.
4.3. Recovery from backup is checked once a month.
4.2. Database backups
Database backups are made every night and kept for 30 days on a separate server inside the network.
4.3. Recovery from backup is checked once a month.
The task
Give staff AI tools while models and data stay inside the organisation’s perimeter.
What we did
- A chat with a language model and answers from internal documents with search in PostgreSQL (pgvector).
- Single sign-on through Keycloak, plus digital signature and eGov Mobile sign-in.
- An image generation service on NVIDIA L40S GPUs.
- Kubernetes on Talos Linux and Cilium; builds and releases through GitLab CI to two separate environments.
- Model weights and packages come through an internal Nexus mirror, so the servers do not need internet access.
Databases are backed up every night. Copies are kept for 30 days on a separate server inside the network.
4.2. Database backups
Database backups are made every night and kept for 30 days on a separate server inside the network.
4.3. Recovery from backup is checked once a month.
Contribution
Our infrastructure engineer was responsible for the infrastructure and model deployment within the project team.
Result
Models and data stay inside the client’s perimeter.
Who it is for
For government bodies and companies that cannot send data to external AI services.
Stage
Built · team experience