Kafka support and multitenant awareness

[michaelfortin]

No description provided.

[CLAassistant]

Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
_{You have signed the CLA already but the status is still pending? Let us recheck it.}

[mostafa]

Hey @michaelfortin,

Thanks for your contribution. I love it.

Is this ready for review? I guess not yet due to the following:

1. There seems to be merge conflicts that need to be resolved. I can't run tests because of it.
2. CLA is not signed yet.
3. No PR description.
4. Everything is committed in two commits.
5. Commits are not signed.
6. I still don't know what the multi-tenancy is for.

BTW, I already skimmed the code and it looks good with some minor tweaks.

[michaelfortin]

Hi @mostafa ,

For our usecase, we are ingesting logs from different clients. Multi tenancy is for preventing logs from different clients from correlating with each other.

Thanks for your feedback! I will clean up this PR in July when I'll have more time to work on this project.

[mostafa]

@michaelfortin Thank you! 🙏 It's worth considering a few different ways of implementing multi-tenancy before settling on one implementation. Let's discuss multi-tenancy in a separate issue/PR.