In-Stream Processing blueprint: building cloud ready, enterprise grade reliable and scalable, 100% open source service (Anton Ovchinnikov, SECR-2016)

Короткая ссылка: 20161028AD-

Speaker: Anton Ovchinnikov

In-Stream Event Processing is a new approach for building near real time big data systems with rapidly growing user base and applications like clickstream analytics, preventive maintenance or fraud detection. Maturity of some open source projects enables building an enterprise grade In-Stream Processing service in-house. However the open source world comprises of many competing projects of different maturity, having different perspectives so the task to select effective and efficient projects is not straightforward. In the talk I’ll present a blueprint of an In-Stream Processing Service, enterprise grade reliable and scalable, cloud ready, build from 100% open source components.
What will you learn?

Conceptual architecture for In-Stream Processing.

A reference architecture based on Apache Kafka, Spark Streaming, Cassandra and Redis.

Operational configuration aspects to ensure scalability and reliability for every component of the architecture.

Target audience: developers, architects and technical managers who are working on real time big data projects, considering them in near future or just curious about them.
Translation of talk «Потоковая обработка больших данных — эталонная архитектура сервиса из компонентов со 100% открытым исходным кодом, готового к развертыванию в облаках, с масштабируемостью и надежностью уровня предприятия (Антон Овчинников, SECR-2016)».