SDN helps Big Data to optimize storage

SDN helps Big Data to optimize storage

For access to this article, please select a purchase option:

Buy chapter PDF
(plus tax if applicable)
Buy Knowledge Pack
10 chapters for £75.00
(plus taxes if applicable)

IET members benefit from discounts to all IET publications and free access to E&T Magazine. If you are an IET member, log in to your account and the discounts will automatically be applied.

Learn more about IET membership 

Recommend Title Publication to library

You must fill out fields marked with: *

Librarian details
Your details
Why are you recommending this title?
Select reason:
Big Data and Software Defined Networks — Recommend this title to your library

Thank you

Your recommendation has been sent to your librarian.

Distributed key-value stores have become the sine qua non for supporting today's large-scale web services. The extreme latency and throughput requirements of modern web applications are driving the use of distributed in-memory object caches. Similarly, the use of persistent object stores has been growing rapidly as they combine key advantages such as HTTP-based RESTfulAPIs, high availability, elasticity with a pay-as-you-go pricing model that allows applications to scale as needed. Consequently, there is an urgent need for optimizing the emerging software defined cloud data centers to efficiently support such applications at scale. In this chapter, we discuss different techniques to optimize the Big Data processing and data management using key-value stores and software defined networks in virtualized cloud data centers. Specifically, we explore two key questions. (1) How do cloud services users, i.e., tenants, get the most bang-for-the-buck with a distributed in-memory key-value store deployment in a shared multitenant environment? (2) How do tenants enhance cloud object store's capabilities through fine-grained resource management to effectively meet their SLAs while maximizing resource efficiency? Moreover, we also present the state of the art in this domain and provide a brief analysis of desirable features. We then demonstrate through experiments the impact of SDN-based Big Data storage management solution on improving performance and overall resource efficiency. Finally, we discuss open issues in SDN-based Big Data I/O stacks and future directions.

Chapter Contents:

  • 13.1 Software defined key-value storage systems for datacenter applications
  • 13.2 Related work, features, and shortcomings
  • 13.2.1 Shortcomings
  • Default configuration
  • FavorsSmall configuration
  • FavorsLarge configuration
  • 13.3 SDN-based efficient data management
  • 13.4 Rules of thumb of storage deployment in software defined datacenters
  • 13.4.1 Summary of rules-of-thumb
  • 13.5 Experimental analysis
  • 13.5.1 Evaluating data management framework in software defined datacenter environment
  • Overview of CAST framework design
  • Methodology
  • Effectiveness for general workload
  • Effectiveness for data reuse
  • 13.5.2 Evaluating micro-object-store architecture in software defined datacenter environment
  • Overview of MOS micro-object-store architecture
  • Methodology
  • Performance evaluation
  • 13.6 Open issue and future directions in SDN-enabled Big Data management
  • 13.6.1 Open issues in data management framework in software defined datacenter
  • Analytics workloads with relatively fixed and stable computations
  • Dynamic vs. static storage tiering
  • 13.6.2 Open issues in micro-object-store architecture in software defined datacenter environment
  • Limitation on number of microstores
  • Online optimizations of microstores
  • 13.7 Summary
  • References

Inspec keywords: software defined networking; storage management; cloud computing; Web services; cache storage; computer centres

Other keywords: storage optimization; Web services; fine-grained resource management; cloud object store capabilities; pay-as-you-go pricing model; distributed key-value stores; throughput requirements; SLAs; extreme latency; distributed in-memory key-value store deployment; Web applications; SDN-based Big Data storage management solution; HTTP-based RESTfulAPIs; virtualized cloud data centers; Big Data processing; resource efficiency maximization; shared multitenant environment; persistent object stores; software defined cloud data centers; SDN-based Big Data I/O stacks; distributed in-memory object caches

Subjects: File organisation; Semiconductor storage; Information networks; Computer networks and techniques; Internet software; Computer communications

Preview this chapter:
Zoom in

SDN helps Big Data to optimize storage, Page 1 of 2

| /docserver/preview/fulltext/books/pc/pbpc015e/PBPC015E_ch13-1.gif /docserver/preview/fulltext/books/pc/pbpc015e/PBPC015E_ch13-2.gif

Related content

This is a required field
Please enter a valid email address