microscaling/queue-demo repository overview

⁠Microscaling Queue Demos

Supporting demo images and config for the Microscaling Engine⁠ from Microscaling Systems⁠. Used to show how the engine can scale a queue to maintain a target length.

⁠Docker with NSQ

Used for the microscaling/queue-demo⁠ Docker image.

Simple demo for showing how the Microscaling Engine⁠ can scale a queue to maintain a target length. Demo currently supports NSQ⁠ (more queues will be added soon). It is implemented in Ruby and intended to be run as a Docker container.

Full instructions for running the demo are at app.microscaling.com⁠.

Each Docker command is shown along with its environment variables and default values.

⁠Kubernetes with NSQ

• Clone this repository
• Register at app.microscaling.com⁠ and get your user ID
• Edit kubernetes/microscaling-deployment.yml and set your user ID
• Create deployments and nsq service

$ kubectl create -f kubernetes/nsq-deployment.yml
$ kubectl create -f kubernetes/nsq-svc.yml
$ kubectl create -f kubernetes/consumer-deployment.yml
$ kubectl create -f kubernetes/producer-deployment.yml
$ kubectl create -f kubernetes/remainder-deployment.yml
$ kubectl create -f kubernetes/microscaling-deployment.yml

• View the demo⁠
• Remove the demo

$ kubectl delete deployment microscaling consumer producer remainder nsq
$ kubectl delete service nsq

Note: your cluster will need the kube-dns⁠ addon as its used for service discovery to access the NSQ service.

⁠Marathon with Azure Storage Queue

The marathon-install and marathon-uninstall commands creates the Marathon demo apps using its REST API. See this blog post⁠ for more details. To run the commands you need Ruby but there are no other dependencies.

⁠marathon-install

Creates the demo apps using the Marathon REST API. You can register at app.microscaling.com⁠ to get your install command.

⁠marathon-uninstall

Deletes the demo apps using the Marathon REST API.

⁠consumer

The default Docker command that adds items to the queue.

MSS_QUEUE_ENDPOINT    127.0.0.1:4150
MSS_TOPIC_NAME        microscaling-demo
MSS_CHANNEL_NAME      microscaling-demo
MSS_CONSUMER_SLEEP_MS 300

⁠producer

The producer command removes items from the queue.

MSS_QUEUE_ENDPOINT    127.0.0.1:4150
MSS_TOPIC_NAME        microscaling-demo
MSS_PRODUCER_SLEEP_MS 100

⁠Development

Use Docker Compose to develop and test changes to the demo. From the current directory run the up command.

$ docker-compose up