athrvk/sitemap-crawler repository overview

⁠Sitemap Crawler

Sitemap Crawler is a web service that fetches the sitemap of a given domain. It's built using Express.js, Cheerio, and React.

⁠Features

• Fetches and displays the sitemap of a specified domain
• Customizable crawl depth
• Option to include parent paths
• Web-based user interface

⁠Usage

You can also run Sitemap Crawler using Docker. Pull the image from Docker Hub:

docker pull athrvk/sitemap-crawler:latest

⁠Running with Docker

Run the Docker container:

docker run --pull=always -p 3000:3000 athrvk/sitemap-crawler:latest

Then access the application at http://localhost:3000