Install librdkafka:
brew install librdkafka
$ echo '{"test": 1, "a": 3, "c": 4}' | python example.py keys
PYSPARK_PYTHON=python spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.3.0 --py-files streamprocessor/ example_spark.py
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Install librdkafka:
brew install librdkafka
$ echo '{"test": 1, "a": 3, "c": 4}' | python example.py keys
PYSPARK_PYTHON=python spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.3.0 --py-files streamprocessor/ example_spark.py