"You should know your queries!" is the long version of the project title. It means that you should not just want tho have a database, but you should also think about the evaluations (which are written down as queries) that you actually would like to do with that database. The creation of a database is quite an effort, regarding not only the deployment of the software on a computer, but even more the capture of all the data to fill it. This effort should be spent with a goal in mind. The project will therefore collect queries, which can then even be used to automatically design a database. This saves resources on one hand, but on the other also supports the privacy goal of data minimization.
The world of data-management systems has become a bit confusing during the last years. Next to the well-established relational database systems, so-called NoSQL systems have been developed, which pretend to cope with much larger data volumes. At the same time, they can only offer limited functionality with respect to efficient data access and can only give reduced consistency guarantees. That raises the question when to stick to a relational database and when to move to a NoSQL system. This project collects the criteria that allow to make such a decision on a well-founded basis.
Within the framework of the EFRE-E|ASY-Opt subproject, the potential of data mining methods in the area of manufacturing is being investigated. Especially the training of Deep-Learning models is a computationally intensive task, which may take hours or several days. The training time can be shortened considerably by using an already trained model, as long as the goal and source task are closely related. This connection is not yet fully understood.
The aim of this research project is to implement a system called REAPER (Reusable Neural Network Pattern Repository) to support data scientists in storing and reusing already trained deep learning models.
The goal of this project is to provide novel hardware and optimisation techniques for scalable, high-performance processing of Big Data. We particularly target huge datasets with flexible schemas (row-oriented, column-oriented, document-oriented, irregular, and/or non-indexed) as well as data streams as found in click-stream analysis, enterprise sources like e-mails, software logs and discussion-forum archives, as well as produced by sensors in the Internet of Things (IoT) and in Industrie 4.0. In this realm, the project investigates the potential of hardware-reconfigurable, FPGA-based Systems-on-Chip (SoCs) for near-data processing where computations are pushed towards such heterogeneous data sources. Based on FPGA technology and in particular thier dynamic reconfiguration, we propose a generic architecture called ReProVide for low-cost processing of database queries.
Within the project SIML (Schema Inference and Machine Learning), methods of topological data analysis and unsupervised learning are combined, applied and further developed in order to derive a conceptual schema from unstructured, multivariant data.
DSAM is a middleware
for managing global data-stream queries.
These queries are distributed to heterogeneous platforms
including self-contained data-stream management systems
and sensor networks.
The project's main goal is to automatically
distribute and deploy
a platform-independent model,
i.e. a global query,
to heterogeneous and distributed stream-processing components.
Queries are defined
in a declarative abstract query language.
They are partitioned
according to cost models
and topological constraints.
DSAM then generates queries
in the target systems' query language,
each implementing a partial query.
For sensor networks,
we additionally adopt source-code generation.
Further challenges are
efficient metadata management and
decentralized query management,
especially in the context of wireless sensor networks.
- Klaus Meyer-Wegener
- Melanie Bianca Sigl
- Luciano Melodia
- Thomas Niko Pollner
- Sebastian Herbst
- Peter Schwab
- Stefan Wildermann
- Jürgen Teich
- Andreas Becher
- Lekshmi Beena Gopalakrishnan Nair
- Julian Rith
- Richard Lenz