Apache Flink Quickstart

Overview

This guide helps you quickly set up and run an Apache Flink streaming application on your local machine.

---

Prerequisites

• Java 11 or higher
  Install with Homebrew:

  brew install openjdk@11
  echo 'export PATH="/usr/local/opt/openjdk@11/bin:$PATH"' >> ~/.zshrc
  echo 'export JAVA_HOME="/usr/local/opt/openjdk@11"' >> ~/.zshrc
  source ~/.zshrc

• Python3 (if using PyFlink)

• Docker (this is optional for running flink inside containers)

Installation and Usage

1. Downloading Flink

wget https://dlcdn.apache.org/flink/flink-2.1.0/flink-2.1.0-bin-scala_2.12.tgz
tar -xzf flink-2.1.0-bin-scala_2.12.tgz
cd flink-2.1.0

2. Starting Flink locally

./bin/start-cluster.sh

3. Running a sample job

./bin/flink run examples/streaming/WordCount.jar

4. Verifying the output logs

tail log/flink-*-taskexecutor-*.out

5. Viewing activity in the Flink UI

http://localhost:8081/

Using PyFlink to run a sample job

1. Install PyFlink

pip install apache-flink

2. Run a PyFlink job

python examples/python/word_count.py

3. Stopping Flink cluster

./bin/stop-cluster.sh

Image of Flink UI when submitting a job