ksql

Optimizing Public Transportation (Udacity)

Nov 2, 2019
Development, Data Streaming
kafka, kafka-python, ksql, kafka-REST-proxy, development

Simulate and display the status of train lines in real time by construction of a streaming event pipeline around Apache Kafka and its ecosystem using public data from the Chicago Transit Authority. Architecture # Creating Kafka Producers # To create a Kafka Producer we must define a model and schema and then configure the kafka producer to emit some events. Producer # A producer partitioner maps each message to a topic partition, and the producer sends a produce request to the leader of that partition. ...