OSv Unikernel — Optimizing Guest OS to Run Stateless and Serverless Apps in the Cloud

Unikernels have been demonstrated to deliver excellent performance in terms of throughput and latency, while providing high isolation. However they have also been shown to underperform in some types of workloads when compared to a generic OS like Linux. In this presentation, we demonstrate that certain types of workloads – web servers, microservices, and other stateless and/or serverless apps – can greatly benefit from OSv optimized networking stack and other features. We describe number of experiments where OSv outperforms Linux guest: most notably we note 1.6 throughput (req/s) and 0.6 latency improvement (at p99 percentile) when running nginx and 1.7 throughput (req/s) and 0.6 latency improvement (at p99 percentile) when running simple microservice implemented in Golang.
We also show that OSv’ small kernel, low boot time and memory consumption allow for very high density when running server-less workloads. The experiment described in this presentation shows we can boot 1,800 OSv microVMs per second on AWS c5n.metal machine with 72 CPUs (25 boots/sec on single CPU) with guest boot time recorded as low as 8.98ms at p50 and 31.49ms at p99 percentile respectively.
Lastly we also demonstrate how to automate the build process of the OSv kernel tailored exactly to the specific app and/or VMM so that only the code and symbols needed are part of the kernel and nothing more. OSv is an open source project and can be found at https://github.com/cloudius-systems/osv.


19 Minutes
Waldek Kozaczuk

Waldek Kozaczuk, OSv Committer

Waldek Kozaczuk is a software developer and architect. During the day he is busy designing and building components of the video supply chain for CNN at WarnerMedia. During the night he is busy improving OSv, an open-source versatile modular unikernel designed to run a single unmodified Linux application securely on top of a hypervisor. He has been contributing to the project ince 2016, when he first got exposed to and fascinated by OSv. Three years ago he was nominated as one of its committers. In that time, he has contributed over 500 patches, which most notably involved enhancing OSv to run on AWS firecracker (http://blog.osv.io/blog/2019/04/19/making-OSv-run-on-firecraker/) and improving ARM port.

Register for 2 days of keynotes & interactive tech talks on all things P99.

Virtual Event

October 19-20, 2022

Share on social with #p99conf and a link to p99conf.io for a chance to win $500.