Building a 10x More Efficient Edge Platform

Painful cold boots, terrible auto-scale times, minutes-long waits for compute nodes to be up: these are standard headaches that cloud engineers have to deal with, and work-around, on a daily basis. Much of this stems from the fact that cloud infrastructure relies on technology that was never intended to be reactive in millisecond scales, or at least within the round-trip time of a user request.

In this talk, Felipe will show how building an edge platform based on technology *intended* to be fast and reactive can lead to substantial gains in both the efficiency of running the platform and the user experience when using it. First, Felipe will demonstrate how leveraging unikernels built with the Unikraft Linux Foundation project can lead to (cold) boot times of as little as 2 ms. This, coupled with a fast VMM (FireCracker), and the fact that the images consume little memory (a few MBs) means that 10-50K of them can be run on a single, inexpensive server. Even better: fast suspend/resume times mean that instances can be suspended when idle, and then resumed just-in-time, as the next request comes in — all transparent to the user.

Felipe will show extensive benchmarks (cold boot times, latency, throughput, memory consumption, etc.) from such technology to give a taste of what future cloud platforms could (and should) look like. Felipe will wrap up the talk by showing how Unikraft integrates with the wider tooling ecosystem (e.g., Kubernetes).

19 minutes
Register now to access all 50+ P99 CONF videos and slide decks.
Watch this session from the P99 CONF livestream, plus get instant access to all of the P99 CONF sessions and decks.

Felipe Huici, CEO and Co-Founder of Unikraft UG

Dr. Felipe Huici is CEO and Co-Founder of Unikraft UG, a start-up dedicated to lightweight and open source virtualization technologies and to significantly lowering cloud infrastructure bills. In addition, Felipe is a chief researcher at NEC Laboratories Europe in Heidelberg, Germany where his main research and interests lie in the areas of high performance software systems, in particular virtualization, specialization and security. He has published in several top tier conferences such as SOSP, ASPLOS, OSDI, Eurosys, SIGCOMM, NSDI and CoNEXT. Finally, Felipe is one of the founders of the maintainers of the Linux Foundation Unikraft open source project.

P99 CONF OCT. 23 + 24, 2024

Register for Your Free Ticket