Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cleanup KafkaUtils and upgrade to Kafka 10 #5

Open
jtbarbetta opened this issue Oct 24, 2016 · 1 comment
Open

Cleanup KafkaUtils and upgrade to Kafka 10 #5

jtbarbetta opened this issue Oct 24, 2016 · 1 comment
Assignees

Comments

@jtbarbetta
Copy link

We need Kafka 10+ for MessageBroker so we also need to upgrade KafkaUtils to use new org.apache.spark.streaming.kafka010 package that corresponds.

@jtbarbetta jtbarbetta self-assigned this Oct 24, 2016
@jtbarbetta
Copy link
Author

jtbarbetta commented Nov 21, 2016

On the client-side of EclairJS we ran into a classloader issue within Toree the prevented us from upgrading to version 10 of the kafka-streaming package in KafkaUtils. For our 0.9 release we had to write our own custom KafkaUtils/kafka receiver. Once the Toree issue is resolved we can try using org.apache.spark.streaming.kafka010 again, thus leaving this opened unti then.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant