Processing 1 billion rows per second
Hans-Jürgen Schönig has been in professional PostgreSQL for over 16 years now and has dealt with customers around the globe. His company Cybertec Schönig & Schönig GmbH offers professional services for PostgreSQL, which includes training, 24x7 support, as well as consulting.
Everybody is talking about Big Data and about processing large amounts of data in real time or close to real time. However, to process a lot of data there is no need for commercial software or for some NoSQL stuff. PostgreSQL can do exactly what you need and process A LOT of data in real time. During our tests we have seen that crunching 1 billion rows of data in realtime is perfectly feasible, practical and definitely useful. This talk shows, which things has to be changed inside the PostgreSQL and what we learned when processing so much data for analytical purposes.
- 50 min
- PGConf US 2017
- Use Cases