Orange Pi closes the year by unveiling new details about the Orange Pi AI Station, a compact board-level edge computing platform built around the Ascend 310 series processor. The system targets high-density inference workloads with large memory options, NVMe storage support, and extensive I/O in a small footprint.
The AI Station is powered by an Ascend 310 series processor integrating 16 CPU cores clocked at up to 1.9 GHz, along with 10 AI cores running at up to 1.08 GHz and 8 vector cores operating at up to 1 GHz.
Holy shit this is cool. No price or reviews yet though, but will be keeping my eyes out. Sounds great for my k8s cluster
This is a review: I have the Orange PI AI studio thing, 96gb ram and two NPUs, using gpustack, the best I’ve gotten is qwen3-30b-a3b with around a 100k context window - runs at 25-28tps
There are some weird quirks with it, I’ve mostly been constrained to using MindIE as a backend which doesn’t support all models. I’ve tried vLLM but it tends to crash and complain it can’t talk to both NPUs.
Overall I’m pretty happy with it though
