how-to

How do I create a GGUF model file?

The llama2 family of LLMs are typically trained and fine-tuned in PyTorch. Hence, they are typically distributed as PyTorch projects on Huggingface. However, when it comes to inference, we are much more interested in the GGUF model format for three reasons. Python is not a great stack for AI inference. We would like to get rid of PyTorch and Python dependency in production systems. GGUF can support very efficient zero-Python inference using tools like llama.…

How to Extend WebAssembly with Host Functions

By DarumaDocker，WasmEdge Contributor in charge of the development of WasmEdge-bindgen WebAssembly was developed for the browser. It gradually gain popularity on the server-side, but a significant disadvantage is its incomplete functionality and capability. The WASI proposal was initiated to solve these problems. But the forming and implementation of a standard is usually slow. What if you want to use a function urgently? The answer is to use the Host Function to customize your WebAssembly Runtime.…

Manage WebAssembly Apps Using Container and Kubernetes Tools

Developers can leverage container tools such as Kubernetes, Docker and CRI-O to deploy, manage, and run lightweight WebAssembly applications. In this article, we will demonstrate how Kubernetes ecosystem tools work with WasmEdge WebAssembly applications. Compared with Docker, WebAssembly could be 100x faster at startup, have a much smaller memory and disk footprint, and have a better-defined safety sandbox. However, the trade-off is that WebAssembly requires its own language SDKs, and compiler toolchains, making it a more constrained developer environment than Docker.…

👏 Get a Free Raspberry Pi Kit- Wave 2

No purchase necessary. Learning and coding are mandatory! Offer ends on September 30th 2020. Learn to create a high performance Node.js application. In the process, you will learn how to write simple functions in the Rust programming language. Share your source code and learning experience to the community via social media. We will send you a FREE Raspberry Pi kit ($25). You can use it as a personal dev server.…

👏 Get a Free Raspberry Pi Kit

No purchase necessary. Learning and coding are mandatory! Offer ends on Aug 31st, 2020. Learn to create a high performance Node.js application. In the process, you will learn how to write simple functions in the Rust programming language. Share your source code and learning experience to the community via social media. We will send you a FREE Raspberry Pi kit ($25). You can use it as a personal dev server.…

Access operating system resources from WebAssembly

The WebAssembly VM provides a sandbox to ensure application safety. However, this sandbox is also a very limited “computer” that has no concept of file system, network, or even a clock or timer. That is very limiting for the Rust programs running inside WebAssembly. If WASM+WASI existed in 2008, we wouldn't have needed to created Docker. That's how important it is. Webassembly on the server is the future of computing.…

⚙️ Machine Learning: K-means clustering and visualization

Machine learning uses statistics to find patterns in data, and then applies those patterns to act on new data. It is the driving force behind many Internet services. For example, machine learning could figure out the kind of food you like based on your personal history, and then recommend related restaurants to you. Machine learning is both computationally intensive and time sensitive, performance matters. The lingua franca of machine learning is Python.…

🦀 Rust Functions in Node.js

In the getting started with Rust functions in Node.js, we showed you how to compile high performance Rust functions into WebAssembly, and call them from Node.js applications. With JSON support, JavaScript code can call Rust functions with any number of input parameters and return any number of return values of any type. That allows us to take advantage of a large number of Rust libraries and crates in the ecosystem.…

The Storage Interface in SSVM

The SSVM storage interface provides a Rust API that allows programs to persist arbitrary data into a key value store. The data store is configured and started by the SSVM and hence is transparent to the Rust application. Rust developers can view this as an abstract storage space for application data. The storage interface provides much higher performance and data throughput than using WASI calls to access database on the file system or via network.…

🔐 Encryption and decryption

One of the frequently performed computing tasks is public key encryption and decryption. Rust and C++ code vastly outperforms JavaScript code in these tasks. In this tutorial, let's use pure Rust implementation of the RSA algorithm as an example to show how to perform public key encryption and decryption in a Node.js web service. In the getting started with Rust functions in Node.js, we showed you how to compile high performance Rust functions into WebAssembly, and call them from Node.…