hehety/digger repository overview

⁠Digger is a powerful and flexible web crawler implemented by pure golang https://docs.diggerit.me/⁠

Supported architectures: amd64, arm, arm64

⁠Issues

Where to file issues: https://github.com/hetianyi/digger/issues⁠

⁠How to use this image

Start manager

docker run --name manager \
       -p 9012:9012 \
       -e DIGGER_DATABASE="postgres://postgres:123456@<db_host>:5432/digger?sslmode=disable" \
       -e DIGGER_REDIS="redispass@<redis_host>:6379#0" \
       hehety/digger \
       digger manager

Environment variables used by manager:

• DIGGER_PORT
• DIGGER_LOG_LEVEL
• DIGGER_LOG_DIR
• DIGGER_DATABASE
• DIGGER_REDIS
• DIGGER_UI_DIR

Start worker

docker run --name worker \
       -e DIGGER_ID=1 \
       -e DIGGER_MANAGER="<manager_host>:9012" \
       hehety/digger \
       digger worker

Environment variables used by manager:

• DIGGER_ID
• DIGGER_MANAGER
• DIGGER_LABELS
• DIGGER_LOG_LEVEL