Work

A High-Performance Sketch With Dynamic Memory Allocation for Priority-Oriented Data Stream Processing

Year: 2025

Type: article

Abstract: Sketch is widely used in many traffic estimation tasks due to its good balance among accuracy, speed, and memory usage. In scenarios with priority flows, priority-aware sketch, as an emerging method, provides differentiated detection accuracy for flows of different priorities, optimizing resource allocation and improving the detection accuracy of high-priority flows. However, existing priority-aware sketches methods struggle to effectively handle the dynamic changes in flow priority distribution in realworld detection environments, leading to wasted or insufficient storage space. To address this issue, this paper proposes a new priority-aware sketch with Dynamic Memory Allocation called DMA-Sketch. It dynamically adjusts the detection framework based on flow priority distribution information and adaptively allocates appropriate memory space to each storage region. The experimental results show that DMA-Sketch improves the overall priority accuracy, high-priority accuracy and throughput by up to 1.33×, 16.39× and 1.88×, respectively, under the scenarios with changing flow priority distribution over the state-of-the-art schemes.

Source: IEEE Transactions on Computers

DOI: 10.1109/tc.2025.3643356

Authors: Jinbin Hu, Houqiang Shen, Jiawei Huang, R. Simon Sherratt, Jin Wang

Institutions: Changsha University of Science and Technology, Central South University, University of Reading, Hunan University of Science and Technology

Language: English

Topic: Network Packet Processing and Optimization

Subfield: Hardware and Architecture

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funders: National Natural Science Foundation of China, Natural Science Foundation of Hunan Province

Awards: G1171972333, G3468037009, 数据中心容损RDMA网络高性能传输关键技术研究, G5998922274, G6396608774