Proposals

Hot and cold data management in filesystem

Session information has not yet been published for this event.

*
Presentation
Scheduled: Wednesday, November 3, 2010 from 1:30 – 2:15pm in President's Ballroom

One Line Summary

Hot and cold data migration over hybrid storage in btrfs

Abstract

Many enterprise storage solution providers today now offer enterprises cutting-edge hybrid storage, which is a new innovation that integrate solid state drives with traditional disks. That is a way to boost performance
without having to make a big investment into new infrastructure. How to manage data more efficiently over hybrid storage to exploit SSD high performance from applications becomes a key issue. Very often applications that require high performance – extremely fast access to data – and they may have data that don’t have such immediate access needs. However, Linux treats all data equally the same when placing them on underlying devices. So this talk will focus on technology that could improving application performance by automatically sort through the data, determine what is hot and what is cold, and automatically migrate the data without user or administrator intervention.

Btrfs is the filesystem that could support multiple devices, and have the framework set up to easily relocate data from on device to another. So it’s quite nature to have this done in btrfs.

The talk will discuss about the ideas to how to locate those frequent accessed data (hot data) and rarely being accessed data (cold data), and how to transparently migrate hot data to fast device (SSD). We will also discuss about the major challenging we faced, and what things are still left unsolved.

Tags

Linux, filesystem, btrfs, hybrid storage, data migration

Presentation Materials

slides

Speaker

Leave a private comment to organizers about this proposal