Query Optimization in Distributed Heterogeneous Data Stream Systems
Data stream systems support queries on continuously arriving data. They provide similar query facilities like relational database systems. However, data stream systems continuously evaluate the queries on the arriving data and discard the data afterwards. Thus, it is possible to process high volumes...
Gorde:
| Egile nagusia: | |
|---|---|
| Formatua: | Online |
| Hizkuntza: | ingelesa |
| Argitaratua: |
FAU University Press
2025
|
| Gaiak: | |
| Sarrera elektronikoa: | ONIX_20251215T160703_9783961474523_3 |
| Etiketak: |
Etiketarik gabe, Izan zaitez lehena erregistro honi etiketa jartzen!
|
| _version_ | 1869522657648574464 |
|---|---|
| author | Pollner, Niko |
| author_browse | Pollner, Niko |
| author_facet | Pollner, Niko |
| author_sort | Pollner, Niko |
| collection | Directory of Open Access Books |
| description | Data stream systems support queries on continuously arriving data. They provide similar query facilities like relational database systems. However, data stream systems continuously evaluate the queries on the arriving data and discard the data afterwards. Thus, it is possible to process high volumes of rapidly arriving data. Application examples are the monitoring of IT infrastructure or the processing of data from wireless sensor networks in wildland or animal surveillance scenarios. Compared to centralized data stream systems, distributed data stream systems can lower the resource demand, improve the performance and increase the lifetime of wireless sensor networks. This is particularly true if the data sources are already distributed and the hosts of the data sources take part in query processing. In my dissertation, I investigate the interdependencies of logical query optimization and the assignment of operators to hosts for distributed data stream systems on heterogeneous hosts. In particular, I discuss the mathematical representation of selected optimization goals and constraints like resource limits for cost-based query optimization. I propose a technique to estimate whether logical query optimization steps may interfere with the subsequent assignment of operators to hosts. Well-known heuristic algorithms are adapted to the optimization problem of assigning operators to hosts. An evaluation compares the different algorithms. Moreover, I propose an algorithm for load balancing by multiple instantiation of operators. |
| format | Online |
| id | doab-20.500.12854ir-170213 |
| institution | Directory of Open Access Books |
| language | eng |
| publishDate | 2025 |
| publishDateRange | 2025 |
| publishDateSort | 2025 |
| publisher | FAU University Press |
| publisherStr | FAU University Press |
| record_format | ojs |
| spelling | doab-20.500.12854ir-1702132025-12-16T05:23:21Z Query Optimization in Distributed Heterogeneous Data Stream Systems Pollner, Niko Drahtloses Sensorsystem Organic Computing Quadratische Optimierung Optimierung Abfrageverarbeitung Verteiltes System Datenstrommanagementsystem Heuristik thema EDItEUR::U Computing and Information Technology::UN Databases::UNK Distributed databases thema EDItEUR::P Mathematics and Science::PB Mathematics::PBU Optimization thema EDItEUR::U Computing and Information Technology::UK Computer hardware::UKL Interrelated smart technologies thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTR Distributed systems Data stream systems support queries on continuously arriving data. They provide similar query facilities like relational database systems. However, data stream systems continuously evaluate the queries on the arriving data and discard the data afterwards. Thus, it is possible to process high volumes of rapidly arriving data. Application examples are the monitoring of IT infrastructure or the processing of data from wireless sensor networks in wildland or animal surveillance scenarios. Compared to centralized data stream systems, distributed data stream systems can lower the resource demand, improve the performance and increase the lifetime of wireless sensor networks. This is particularly true if the data sources are already distributed and the hosts of the data sources take part in query processing. In my dissertation, I investigate the interdependencies of logical query optimization and the assignment of operators to hosts for distributed data stream systems on heterogeneous hosts. In particular, I discuss the mathematical representation of selected optimization goals and constraints like resource limits for cost-based query optimization. I propose a technique to estimate whether logical query optimization steps may interfere with the subsequent assignment of operators to hosts. Well-known heuristic algorithms are adapted to the optimization problem of assigning operators to hosts. An evaluation compares the different algorithms. Moreover, I propose an algorithm for load balancing by multiple instantiation of operators. 2025-12-16T05:23:20Z 2025-12-16T05:23:20Z 2025-12-15T15:08:41Z 2021 book ONIX_20251215T160703_9783961474523_3 https://library.oapen.org/handle/20.500.12657/109172 9783961474523 9783961474516 https://directory.doabooks.org/handle/20.500.12854/170213 eng FAU Studien aus der Informatik open access image/jpeg Attribution 4.0 International https://library.oapen.org/bitstream/20.500.12657/109172/1/9783961474523.pdf FAU University Press 10.25593/978-3-96147-452-3 10.25593/978-3-96147-452-3 2c600dea-eece-4066-87be-da335e323fdb 9783961474523 9783961474516 255 Erlangen open access |
| spellingShingle | Drahtloses Sensorsystem Organic Computing Quadratische Optimierung Optimierung Abfrageverarbeitung Verteiltes System Datenstrommanagementsystem Heuristik thema EDItEUR::U Computing and Information Technology::UN Databases::UNK Distributed databases thema EDItEUR::P Mathematics and Science::PB Mathematics::PBU Optimization thema EDItEUR::U Computing and Information Technology::UK Computer hardware::UKL Interrelated smart technologies thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTR Distributed systems Pollner, Niko Query Optimization in Distributed Heterogeneous Data Stream Systems |
| title | Query Optimization in Distributed Heterogeneous Data Stream Systems |
| title_full | Query Optimization in Distributed Heterogeneous Data Stream Systems |
| title_fullStr | Query Optimization in Distributed Heterogeneous Data Stream Systems |
| title_full_unstemmed | Query Optimization in Distributed Heterogeneous Data Stream Systems |
| title_short | Query Optimization in Distributed Heterogeneous Data Stream Systems |
| title_sort | query optimization in distributed heterogeneous data stream systems |
| topic | Drahtloses Sensorsystem Organic Computing Quadratische Optimierung Optimierung Abfrageverarbeitung Verteiltes System Datenstrommanagementsystem Heuristik thema EDItEUR::U Computing and Information Technology::UN Databases::UNK Distributed databases thema EDItEUR::P Mathematics and Science::PB Mathematics::PBU Optimization thema EDItEUR::U Computing and Information Technology::UK Computer hardware::UKL Interrelated smart technologies thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTR Distributed systems |
| topic_facet | Drahtloses Sensorsystem Organic Computing Quadratische Optimierung Optimierung Abfrageverarbeitung Verteiltes System Datenstrommanagementsystem Heuristik thema EDItEUR::U Computing and Information Technology::UN Databases::UNK Distributed databases thema EDItEUR::P Mathematics and Science::PB Mathematics::PBU Optimization thema EDItEUR::U Computing and Information Technology::UK Computer hardware::UKL Interrelated smart technologies thema EDItEUR::U Computing and Information Technology::UT Computer networking and communications::UTR Distributed systems |
| url | ONIX_20251215T160703_9783961474523_3 |
| work_keys_str_mv | AT pollnerniko queryoptimizationindistributedheterogeneousdatastreamsystems |