Similarity Search - opportunity for PMEM

Similarity Search - opportunity for PMEM

At a high level, computing solves problems. These problems, even though different and individual, are sometimes somehow related. A new algorithmic challenge can usually be solved by bringing it down to a well-defined problem with an existing solution. Today, we will be talking about one of such …

Read More
Basic asynchronous hashmap with Miniasync library

Basic asynchronous hashmap with Miniasync library

Miniasync library provides a framework for the composition and execution of asynchronous tasks in C. To accommodate different user-defined tasks and various types of data that they take in, libminiasync makes use of macros. Using libminiasync for the first time can be challenging. There are multiple …

Read More
Upcoming asynchronous interfaces in PMDK libraries

Upcoming asynchronous interfaces in PMDK libraries

In the previous article, I wrote about a new upcoming Xeon platform feature, Data Streaming Accelerator (DSA) - a memory-to-memory DMA engine, and what opportunities and challenges it presents. I outlined the approach we are taking in Persistent Memory Development Kit (PMDK) to expose asynchronous …

Read More
Leveraging asynchronous hardware accelerators for fun and profit

Leveraging asynchronous hardware accelerators for fun and profit

One of the greatest benefits of Persistent Memory is that it’s directly accessible by the CPU. But that can also be one of its downsides for specific use cases. For example, if you want to use PMem as an ultra-fast storage device with low access latency. PMem as storage impedance mismatch The …

Read More
Introduction to pmemstream

Introduction to pmemstream

What is pmemstream? Libpmemstream implements a pmem-optimized log data structure and provides stream-like access to data. It presents a contiguous logical address space, divided into regions, with log entries of arbitrary size. We intend for this library to be a foundation for various, more complex …

Read More