project: Python and Kafka

Tags python kafka
Hard Prerequisites
IMPORTANT: Please review these prerequisites, they include important information that will help you with this content.
  • TOPICS: Python and Kafka

  • The first step is to create an “app” on twitter. https://developer.twitter.com/en/apps

    And then in your virtualenv, install these dependencies:

    pip install kafka-python
    pip install python-twitter
    pip install tweepy
    

    Create a topic. Pick something you are interested in. For example you might want to collect tweets about data-engineering, covid-19, or space travel. Whatever you want :)

    Write a script that will print tweets to standard out, and also publish them to kafka.

    Make sure that you follow good practices - don’t hard-code any secret information (like your passwords) and don’t hard-code configuration either (it should come from your environmental variables)


    RAW CONTENT URL