Functional test with Behave (python) + Apache Kafka

At x.com we use Apache Spark to generate analytics reports, I developed a batch ETL called “djobi”, a java program, that take data, apply transformations and write somewhere.

Today I have added a Kafka output, and wrote func. tests with Behave, a Python library (https://github.com/behave/behave).

I use Python library: https://kafka-python.readthedocs.io/

And here the code: