Dynamic shared memory architecture, systems, and optimizations for high performance and secure virtualized cloud

Virtualization;Memory management;Shared memory

Zhang, Qi ; Liu, Ling Computer Science Pu, Calton Ahamad, Mustaque Blough, Douglas M. Lofstead, Jay ; Liu, Ling

University:Georgia Institute of Technology

Department:Computer Science

关键词: Virtualization;    Memory management;    Shared memory;   

Others  :  https://smartech.gatech.edu/bitstream/1853/59793/1/ZHANG-DISSERTATION-2017.pdf

美国|英语

来源: SMARTech Repository

【 摘 要 】

Dynamic memory consolidation is an important enabler for high performance virtualmachine (VM) execution in virtualized Cloud. Efficient just-in-time memory balancing requires three core capabilities: (i) Detecting memory pressure across VMs hosted on aphysical machine; (ii) Allocation of memory to respective VMs; (iii) Enabling fast recovery upon making newly allocated memory available at the high pressure VMs. Although the Balloon driver technology facilitates the second task, it remains difficult toaccurately predict the VM memory demands at affordable overhead, especially under unpredictable and changing workloads. Furthermore, no prior study analyzed the effect ofslow response of VM execution to the newly available memory due to paging based application recovery. In this dissertation research, I have made four original contributions to dynamic shared memory management in terms of architecture, systems and optimizations for improving VM execution performance and security. First, we designed and developed MemPipe, a shared memory inter-VM communication channel for fast inter-VM network I/O. MemPipe increases the shared memory utilization by adaptively adjusting the sharedmemory size according to workloads demands. It also reduces the inter-VM network communication overhead by directly copying the packets from the sender VM's user space to the shared memory area. Second, we developed iBalloon, a light-weight andtransparent prediction based facility to enable automated or semi-automated ballooning with more customizable, accurate, and efficient memory balancing policies among VMs. Third, we developed MemFlex, a novel shared memory swapping facility that can effectively utilizes host idle memory by a hybrid memory swap-out model and a fast swap-in optimization. Fourth, we introduced SecureStack, which is a kernel backed tool to prevent the sensitive data on the function stack from being illegally accessed by the untrusted functions. SecureStack introduces three procedures to protect, restore, and clear the stack in a reliable and low cost manner. It is highly transparent to the users and does not bring any new vulnerability to the existing system. The above research developmentsare packaged into MemLego, a new memory management framework for memory-centric computing in the big data era.