Sign inSign up

nopenix/json-scraper

By nopenix

Updated about 3 years ago

Scrapes Particular values from a Json Response

Image
0

471

nopenix/json-scraper repository overview

GitHub Workflow Status GitHub issues Docker Stars GitHub Repo stars GitHub top language

json-scraper

Information about the Container

Purpose

Scrapes Particular values from a Json Response

Container Name

nopenix/json-scraper

Based on

mcr.microsoft.com/powershell:lts-alpine-3.17

docker-compose.yml
version: "3"

services:
  scraper:
    image: nopenix/json-scraper
    restart: unless-stopped
    volumes: 
      - .\scraper.ps1:/app/scraper.ps1 # This is for Developing purpose! please comment this out in productive envoronments
    environment:
      SCRAPER_CYCLE_PAUSE: 1
      DB_SERVER_HOSTNAME: db
      DB_SERVER_PORT: 3306
      DB_SERVER_USERNAME: root
      DB_SERVER_PASSWORD: changemeplz
      DB_SERVER_DATABASE: scraper
      #DB_SERVER_TABLENAME_TARGETS: 
      #DB_SERVER_TABLENAME_RESULTS:  

  db:
    image: mariadb
    command: mysqld --character-set-server=utf8 --collation-server=utf8_unicode_ci
    restart: always
    environment:
      MYSQL_ROOT_PASSWORD: changemeplz
      TZ: Europe/Berlin
    volumes:
      - mariadb:/var/lib/mysql

  phpmyadmin:
    image: phpmyadmin
    restart: always
    ports:
      - 80:80
    environment:
      PMA_ARBITRARY: 0
      PMA_HOST: db
      PMA_PORT: 3306

volumes:
  mariadb:
Environment Variables
VariablePurpose
SCRAPER_CYCLE_PAUSEPause in Minutes between Scraping runs
DB_SERVER_HOSTNAME
DB_SERVER_PORT
DB_SERVER_USERNAME
DB_SERVER_PASSWORD
DB_SERVER_DATABASE
DB_SERVER_TABLENAME_TARGETSOptional. The Default Tablename for the Targetlist is scraper_targets_json
DB_SERVER_TABLENAME_RESULTSOptional. The Default Tablename for the scraped results is scraper_results
Requirements
  • MySQL/MariaDB Server
  • Connection to the targets which you want to scrape
Tags

No Tags, only :latest

Updates

The Container gets automatically updated, build and pushed every Sunday.

Tag summary

Content type

Image

Digest

sha256:f6c908c92

Size

92.1 MB

Last updated

about 3 years ago

docker pull nopenix/json-scraper