Digital Library of Zielona Góra contains 9 272 digital objects
Object
Title: Parallelizing user-defined functions in the ETL workflow using orchestration style sheets
Contributor:
Gamper, Johann - ed. ; Wrembel, Robert - ed.
Subtitle:
Group publication title:
Abstract:
Today`s ETL tools provide capabilities to develop custom code as user-defined functions (UDFs) to extend the expressiveness of the standard ETL operators. However, while this allows us to easily add new functionalities, it also comes with the risk that the custom code is not intended to be optimized, e.g., by parallelism, and for this reason, it performs poorly for data-intensive ETL workflows. In this paper we present a novel framework, which allows the ETL developer to choose a design pattern in order to write parallelizable code and generates a configuration for the UDFs to be executed in a distributed environment. ; This enables ETL developers with minimum expertise in distributed and parallel computing to develop UDFs without taking care of parallelization configurations and complexities. We perform experiments on large-scale datasets based on TPC-DS and BigBench. The results show that our approach significantly reduces the effort of ETL developers and at the same time generates efficient parallel configurations to support complex and data-intensive ETL tasks.
Publisher:
Zielona Góra: Uniwersytet Zielonogórski
Resource Identifier:
DOI:
Pages:
Source:
AMCS, volume 29, number 1 (2019) ; click here to follow the link
Language:
License CC BY 4.0:
Rights:
Biblioteka Uniwersytetu Zielonogórskiego
Object collections:
- Repository > Faculties > Faculty of Computer, Electrical and Control Engineering
- Repository > Types of work > Articles
- Repository > Scientific journals and UZ publishing series > International Journal of Applied Mathematics and Computer Science (AMCS) > International Journal of Applied Mathematics and Computer Science (AMCS) (2019)
Last modified:
Jul 14, 2025
In our library since:
Jul 10, 2025
Number of object content hits:
18
All available object's versions:
https://zbc.uz.zgora.pl/repozytorium/publication/100935
Show description in RDF format:
Show description in OAI-PMH format:
-
-
-
-
-
-
-
-
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 29, number 1 (2019)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 29, number 2 (2019)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 29, number 3 (2019)
-
International Journal of Applied Mathematics and Computer Science (AMCS), volume 29, number 4 (2019)
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
| Edition name | Date |
|---|---|
| Parallelizing user-defined functions in the ETL workflow using orchestration style sheets | Jul 14, 2025 |
Objects Similar
González-Vélez, Horacio Kontagora, Maryam Korbicz, Józef (1951- ) - red. Uciński, Dariusz - red.
