Real-time AI on a plain CPU: how far can you get without a GPU?
A 2-core CPU with no GPU ran a mid-size object detector at a steady 30 FPS with 19 ms end-to-end
A 2-core CPU with no GPU ran a mid-size object detector at a steady 30 FPS with 19 ms end-to-end
A server has 32 occupied admission slots. Its queue is bounded. HTTP/2 flow control may be doing exactly what it
Part 2 of gRPC Under Pressure | An experiment in pending-work admission, transient latency, and the waiting we do not
Part 1 of gRPC Under Pressure – what happens when transport flow control and application capacity tell different stories. The