Home

Project Status

This document outlines the total project progress status.

• Library
  • Rust
  • C/C++
  • Go
• Security
  • Authentication
    • Custom
    • LDAP(?)
  • TLS
• Reliability
  • Worker-Worker intermediate data exchange
  • Task Restarts
  • Master state saving
  • Master redundancy
  • Re-run tasks with inaccessible intermediate data.
• Performance
  • Combiner function
  • Configurable input file splitting
  • Over-scheduling of slow tasks
  • Multi-core workers
  • Multiple simultaneous jobs
  • Persistent running library for multiple tasks of the same job.
  • Job and Task Priorities
• Deployments
  • Docker Swarm(?)
  • Kubernetes(?)
• Monitoring
  • Prometheus metrics
  • Master status page
• User Experience
  • CLI
  • Dashboard
    • Scheduling new jobs
    • Visualisation