Introspection is the prerequisite of autonomic behavior, the first step towards performance improvement and resource usage optimization for large-scale distributed systems. In grid environments, the task of observing the application behavior is assigned to monitoring systems. However, most of them are designed to provide general resource information and do not consider specific information for higher-level services. More precisely, in the context of data-intensive applications, a specific introspection layer is required to collect data about the usage of storage resources, data access patterns, etc ; This paper discusses the requirements for an introspection layer in a data management system for large-scale distributed infrastructures. We focus on the case of BlobSeer, a large-scale distributed system for storing massive data. The paper explains why and how to enhance BlobSeer with introspective capabilities and proposes a three-layered architecture relying on the MonALISA monitoring framework. ; We illustrate the autonomic behavior of BlobSeer with a self-configuration component aiming to provide storage elasticity by dynamically scaling the number of data providers. Then we propose a preliminary approach for enabling self-protection for the BlobSeer system, through a malicious client detection component. The introspective architecture has been evaluated on the Grid?5000 testbed, with experiments that prove the feasibility of generating relevant information related to the state and behavior of the system.
Aug 24, 2018
Aug 24, 2018
|Bringing introspection into BlobSeer: towards a self-adaptive distributed data management system||Aug 24, 2018|
Li, Jiangrong Li, Junmin Xia, Zhile Korbicz, Józef - red. Uciński, Dariusz - red.
Afifi, Larbi Magri, El Mostafa El Jai, Abdelahaq Korbicz, Józef - red. Uciński, Dariusz - red.
Ztot, Karima Zerrik, El Hassan Bourray, Hamid Korbicz, Józef - red. Uciński, Dariusz - red.
Piórkowski, Adam Werewka, Jan Korbicz, Józef - red. Uciński, Dariusz - red.
Zerrik, El Hassan Bourray, Hamid Ben Hadid, Samir Korbicz, Józef - red. Uciński, Dariusz - red.
Klamka, Jerzy Korbicz, Józef - red. Uciński, Dariusz - red.
Rachik, Mostafa Lhous, Mustapha El Kahlaoui, Ouafa Labriji, Elhoussine Jourhmane, Hasna Korbicz, Józef - red. Uciński, Dariusz - red.
Qaraai, Youssef Bernoussi, Abdes Samed Korbicz, Józef - red. Uciński, Dariusz - red.