Header

UZH-Logo

Maintenance Infos

Stream Processing: The Matrix Revolutions


Pernischova, Romana; Ruosch, Florian; Dell' Aglio, Daniele; Bernstein, Abraham (2018). Stream Processing: The Matrix Revolutions. In: 12th International Workshop on Scalable Semantic Web Knowledge Base Systems, Monterey, CA, USA, 9 October 2018 - 9 October 2018, 15-27.

Abstract

Analyzing data streams is a vital task in data science. Often, data comes in different shapes such as triples, tuples, relations, or matrices. Traditional stream processing systems, however, only process data in one of these formats.
To enable the processing of streams combining different shapes of data, we developed a system that parses SPARQL queries using the Apache Jena parser and transforms them to Apache Flink topologies. With a custom data type and tailored functions, we enabled the integration of matrices in Jena and therefore allowed to mix graphs, relational, and linear algebra in an RDF graph. This provided a proof of concept that queries may be written for static data and – with the usage of the streaming engine Flink – can easily be run on data streams, even if they contain multiple of the aforementioned types.

Abstract

Analyzing data streams is a vital task in data science. Often, data comes in different shapes such as triples, tuples, relations, or matrices. Traditional stream processing systems, however, only process data in one of these formats.
To enable the processing of streams combining different shapes of data, we developed a system that parses SPARQL queries using the Apache Jena parser and transforms them to Apache Flink topologies. With a custom data type and tailored functions, we enabled the integration of matrices in Jena and therefore allowed to mix graphs, relational, and linear algebra in an RDF graph. This provided a proof of concept that queries may be written for static data and – with the usage of the streaming engine Flink – can easily be run on data streams, even if they contain multiple of the aforementioned types.

Statistics

Downloads

65 downloads since deposited on 04 Sep 2018
65 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Conference or Workshop Item (Paper), refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Informatics
Dewey Decimal Classification:000 Computer science, knowledge & systems
Language:English
Event End Date:9 October 2018
Deposited On:04 Sep 2018 14:17
Last Modified:29 Nov 2018 17:41
Publisher:CEUR-WS.org
OA Status:Green
Free access at:Official URL. An embargo period may apply.
Official URL:http://ceur-ws.org/Vol-2179/SSWS2018_paper2.pdf
Other Identification Number:merlin-id:16474

Download

Download PDF  'Stream Processing: The Matrix Revolutions'.
Preview
Content: Published Version
Filetype: PDF
Size: 266kB