Rust

Rust + WebAssembly: Building Infrastructure for Large Language Model Ecosystems

This is a talk at the track “The Programming Languages Shaping the Future of Software Development” at QCon 2023 Beijing on Sept 6th, 2023. The session aims to address the challenges faced by the current mainstream Python and Docker approach in building infrastructure for large language model(LLM) applications. It introduced the audience to the advantages of the Rust + WebAssembly approach, emphasizing its potential in addressing the performance, security, and efficiency concerns associated with the traditional approach.…

Build the future of cloud computing with WasmEdge via GSoC

Google Summer of Code 2023 is accepting applications with WasmEdge as a featured open source project with two available projects. By participating, you'll have the opportunity to work on WasmEdge and contribute to the evolution of cloud computing. GSoC is a global, online mentoring program that introduces new contributors to open source software development. Through GSoC, you will gain valuable experience in real-world software development while being compensated for your efforts and time!…

WasmEdge Community Meeting: Wasi-crypto, Wasi-nn Proposal & India Devs Community

The WasmEdge maintainers host a monthly community meeting on the first Tuesday every month to share technical and community updates. On 5th July, the WasmEdge community discussed the runtime's implementation of wasi-nn and wasi-crypto proposals and the developer evangelizing in India for WasmEdge. Full video here. It's worth mentioning that all the speakers in WasmEdge July community meeting are from the community. Anyone interested is more than welcome to speak and discuss!…

LFX Mentorship: Becoming an Open Source Contributor to Exciting CNCF Projects

This article is by gusye1234, a LFX mentorship mentee for WasmEdge project, who is implementing the wasi-nn proposal. Hi, I'm gusye1234, an MSc. Computer Science student from China. My contributions to WasmEdge mainly focus on the wasi-nn proposal. I have completed the first milestone of the wasi-nn project. There is more to achieve and future work left to do, like supporting more types of AI models for WasmEdge.…

How to Extend WebAssembly with Host Functions

By DarumaDocker，WasmEdge Contributor in charge of the development of WasmEdge-bindgen WebAssembly was developed for the browser. It gradually gain popularity on the server-side, but a significant disadvantage is its incomplete functionality and capability. The WASI proposal was initiated to solve these problems. But the forming and implementation of a standard is usually slow. What if you want to use a function urgently? The answer is to use the Host Function to customize your WebAssembly Runtime.…

eBPF and WebAssembly: whose VM reigns supreme?

The two hottest lightweight code execution sandboxes / VMs in the cloud-native world today are eBPF and WebAssembly. They both run high-performance bytecode programs compiled from C, C++, and Rust. The biggest difference, however, is that eBPF runs inside the Linux kernel while WebAssembly runs in the user space. eBPF has some programming restrictions that makes it safe for kernel use cases (eg no infinite loops). But that also means that eBPF is Turing incomplete.…

Manage WebAssembly Apps Using Container and Kubernetes Tools

Developers can leverage container tools such as Kubernetes, Docker and CRI-O to deploy, manage, and run lightweight WebAssembly applications. In this article, we will demonstrate how Kubernetes ecosystem tools work with WasmEdge WebAssembly applications. Compared with Docker, WebAssembly could be 100x faster at startup, have a much smaller memory and disk footprint, and have a better-defined safety sandbox. However, the trade-off is that WebAssembly requires its own language SDKs, and compiler toolchains, making it a more constrained developer environment than Docker.…

Rust and WebAssembly Serverless functions in Vercel

Vercel is a leading platform for developing and hosting Jamstack applications. Unlike traditional web apps, where the UI is dynamically generated at runtime from a server, a Jamstack application consists of a static UI (in HTML and JavaScript) and a set of serverless functions to support dynamic UI elements via JavaScript. There are many benefits to the Jamstack approach. But perhaps one of the most significant benefits is performance. Since the UI is no longer generated at runtime from a central server, there is much less load on the server and we can now deploy the UI via edge networks such as CDNs.…

WebAssembly Serverless Functions in Netlify

Netlify is a leading platform for developing and hosting Jamstack applications. In fact, the term Jamstack was coined by Netlify founder Mathias Biilmann in 2015. Netlify also hosts the annual Jamstack Conf. A Jamstack application consists of a static UI (in HTML and JavaScript) and a set of serverless functions to support dynamic UI elements via JavaScript. There are many benefits to the Jamstack approach. But perhaps one of the most significant benefits is performance.…

AI Inference for Real-time Data Streams with WasmEdge and YoMo

YoMo is a programming framework enabling developers to build a distributed cloud system (Geo-Distributed Cloud System). YoMo's communication layer is made on top of the QUIC protocol, which brings high-speed data transmission. In addition, it has a built-in Streaming Serverless “streaming function”, which significantly improves the development experience of distributed cloud systems. The distributed cloud system built by YoMo provides an ultra-high-speed communication mechanism between near-field computing power and terminals. It has a wide range of use cases in Metaverse, VR/AR, IoT, etc.…