You don't have to use bin/kafka-server-start.sh script. There is script called start-kafka.sh in wurstmeister/kafka image. Here is how I did it in one of my projects:
docker-compose.yml
zookeeper:
container_name: zookeper
image: wurstmeister/zookeeper:3.4.6
ports:
- "2181:2181"
kafka:
container_name: kafka
build:
context: .
dockerfile: kafka.Dockerfile
image: kafka-service
ports:
- "9092:9092"
kafka.Dockerfile
FROM wurstmeister/kafka:2.11-2.0.0
COPY wait-for-it.sh /wait-for-it.sh
RUN chmod +x /wait-for-it.sh
CMD ["/wait-for-it.sh", "zookeper:2181", "--", "start-kafka.sh"]
Here in dockerfile, I essentially say: "Wait for zookeeper, he has to be up first,then you can start, then after him, run start-kafka.sh". You can download wait-for-it.sh script here: https://github.com/vishnubob/wait-for-it/blob/master/wait-for-it.sh
PS: You can see the essential information of any image using the following command:
docker inspect <image-name>
would you please write the equivalent docker-compose.yml file of the commands found in kafka official site?
Take a look at edited answer. You are missing CMD part of the dockerfile.
how about image: kafka-service?
kafka-image is built from kafka.Dockerfile. I included dockerfile because I had to enrich that official kafka image with wait-for-it.sh script since official kafka image doesn't include that script. You can go without that script ( CMD ["start-kafka.sh"] ), but I dont know what will happen if kafka start before zookeper.
I don't understand what is your question. If the question is how to write python producer, I don't know that, I am not familiar with python. If you are asking how to start kafka, I already answered, if you don't understand, clarify which part you don't understand so I can help a little bit more. If you want to run console producer, you can look at step 4. here kafka.apache.org/quickstart