Distributed inference · self-hosted
The AI datacenter
your organization
already owns.
Nodea turns the workstations already sitting in your office — laptops, desktops, idle GPUs — into a private, self-hosted network for AI inference. No new hardware. No prompts leaving your network.
The problem
Every completion is either a cloud invoice, or capacity you already paid for.
Renting inference
- Billed per token, indefinitely
- Prompts and data leave your network
- Capacity you don't own or control
- Generic shared hardware
Idle workstations
- Hardware already purchased and depreciating
- Inference runs on-premises, on your machines
- Fleet you already manage and secure
- Spare memory sitting unused all day
The platform
A network where every laptop is an inference node, and your org is the datacenter operator.
How it works
From idle machine to inference node, in four steps.
Install
The Nodea desktop app runs on macOS, Windows or Linux — on hardware the org already owns.
Register
The workstation opens a gRPC stream and reports its free memory as a device identity.
Assign
The backend matches a model to that memory footprint and pushes a load-model command.
Serve
The model runs locally on the workstation; generated tokens stream back to the requester in real time.
Under the hood
One wire protocol. Three platforms.
Model placement
The network fits the model to the machine — automatically.
Llama-3.2-1B
2 GB free memoryLightweight, fast — runs on almost anything in the fleet.
Gemma-2-2B
4 GB free memoryBalanced performance and capability for everyday completions.
DeepSeek-R1-Distill-8B
8 GB free memoryReserved for the beefier workstations — advanced reasoning.
Adoption
Point your existing stack at it. Nothing else changes.
Visibility
You can see the fleet you're running.
Every registered workstation, with real-time connection status.
Tokens served today and over time, broken down by machine.
Usage charted over time across the whole organization.
Every organization already owns an idle AI datacenter — in its employees' laptops.
Nodea turns it into a private, cost-efficient, OpenAI-API-compatible inference cloud you already control.