TomSecSECURITY / SYSTEMS
TOMSEC / NAVIGATION

Choose a system to explore.

~/search
← ~/PROJECTS
Infrastructure / StorageOperating

Offline Knowledge Server

Offline reference access shifts the problem from a live website to local dataset integrity, disk capacity and a service that can reliably open its library.

KiwixDockerLinuxZIM datasetsStorage

02 / Problem

Problem

Large offline reference collections need enough persistent storage and a catalogue that corresponds to usable content. A running web server alone does not establish that every dataset is intact.

03 / Objectives

Objectives

Keep reference material available locally, manage the library without disturbing other services and investigate corrupted content at the dataset level.

04 / ARCHITECTURE

Follow the components.

  1. Reference reader
  2. Kiwix service
  3. Library catalogue
  4. ZIM datasets
  5. Persistent storage

05 / Implementation

Implementation

Kiwix Serve runs in Docker with its library catalogue and ZIM datasets on the persistent storage disk. The homelab includes library rebuild and dataset redownload tooling. The current collection occupies about 214 GB and is explicitly included in shared-storage capacity planning.

06 / SECURITY

Security boundaries

  • Private service addresses and dataset filesystem details are not published.
  • Existing reference data remains separate from upload quota trees.
  • No dataset was deleted to make room for another service.

07 / Testing

Testing

The current inspection confirmed the Kiwix container is running and measured the existing dataset footprint without altering it. Historical corrupted-content troubleshooting is part of the project, but this session did not reread or checksum the entire collection.

08 / Challenges

Challenges

A damaged large dataset can require substantial download time and temporary capacity. Repair planning must account for those costs while preserving working reference content and unrelated applications.

09 / Lessons

Lessons

Offline availability still depends on local storage health. Check the catalogue, the serving process and the content separately; do not treat container uptime as a complete content-integrity test.