Live Deduplication Storage of Virtual Machine Images in an Open-Source Cloud - Middleware 2011
Conference Papers Year : 2011

Live Deduplication Storage of Virtual Machine Images in an Open-Source Cloud

Chun-Ho Ng
  • Function : Author
  • PersonId : 1018134
Mingcao Ma
  • Function : Author
  • PersonId : 1018135
Patrick Lee
  • Function : Author
  • PersonId : 1009259
John Lui
  • Function : Author
  • PersonId : 1009262

Abstract

Deduplication is an approach of avoiding storing data blocks with identical content, and has been shown to effectively reduce the disk space for storing multi-gigabyte virtual machine (VM) images. However, it remains challenging to deploy deduplication in a real system, such as a cloud platform, where VM images are regularly inserted and retrieved. We propose LiveDFS, a live deduplication file system that enables deduplication storage of VM images in an open-source cloud that is deployed under low-cost commodity hardware settings with limited memory footprints. LiveDFS has several distinct features, including spatial locality, prefetching of metadata, and journaling. LiveDFS is POSIX-compliant and is implemented as a Linux kernel-space file system. We deploy our LiveDFS prototype as a storage layer in a cloud platform based on OpenStack, and conduct extensive experiments. Compared to an ordinary file system without deduplication, we show that LiveDFS can save at least 40% of space for storing VM images, while achieving reasonable performance in importing and retrieving VM images. Our work justifies the feasibility of deploying LiveDFS in an open-source cloud.
Fichier principal
Vignette du fichier
978-3-642-25821-3_5_Chapter.pdf (234.32 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01597754 , version 1 (28-09-2017)

Licence

Identifiers

Cite

Chun-Ho Ng, Mingcao Ma, Tsz-Yeung Wong, Patrick Lee, John Lui. Live Deduplication Storage of Virtual Machine Images in an Open-Source Cloud. 12th International Middleware Conference (MIDDLEWARE), Dec 2011, Lisbon, Portugal. pp.81-100, ⟨10.1007/978-3-642-25821-3_5⟩. ⟨hal-01597754⟩
183 View
223 Download

Altmetric

Share

More