I’ve refreshed my stack and am rebuilding the cluster. I’m using Hypriot for the linux distribution, but I’m a smart sysadmin (read lazy) and don’t want to manually add them each time. Also, I want to make a script so that I can quickly rebuild. This is inspired by Let Docker Swarm all over your …
Category Archive: cloud-in-a-box
Apr 21
‘Piping’ Hot Docker Containers
One of the possibly lesser used flags for docker run is -a which allows you to attach the container’s STDIN, STDOUT or STDERR and pipe it back to the shell which invoked the container. This allows you to construct pipelines of commands, just as you can with UNIX processes. For instance, using UNIX commands to …
Apr 15
Swarming Raspberry Pi: Private Registry for Swarm Images
Some more backstory on the Pi Swarm I was really excited when Amazon announced their Lambda offering. I thought that it was an awesome idea, but for the lack of an open solution and that it locked you into javascript. I believe that using Docker, we can have a relatively simple Amazon Lambda work-alike which …
Apr 12
Docker Workers Scale Nicely with Multiple Cores
Disclaimer: The title might be a bit misleading. For this workload, it’s scaling pretty much linearly. Other workloads might scale differently. I was running a quick-ish test on a Pi to see how long it would take to churn through 50GB compressed data. This processing consists of: Determining the files to be processed — this …
Apr 07
Swarming Raspberry Pi: Of Network Bondage
Apologies to W. Somerset Maugham for the title. For my Cloud in a Box, I want the Data hosts, at the least to have “more” network I/O capability, whether it be for a Docker Registry or other data. (As an aside, I am playing with doing substructure matching of chemical compounds and/or other Cheminformatics with …
Apr 05
SSD on a Raspberry Pi
As a part of building out the Cloud in a Box, I wanted some storage for Docker images, as well as data. Based upon my previous experience, I believed that a SSD would be faster than a Micro SD, but I hadn’t tested it as yet. The challenge from Dieter Reuter (@Quintus23M), asking how I’d …
Apr 03
Swarming Raspberry Pi: Docker Swarm Discovery Options
Docker Swarm supports a variety of methods for discovering swarm members. Each has arguments in its favor. In this post I shall discuss the various methods and thoughts regarding each. Background I originally started with the idea of having a portable cluster, a “cloud in a box” if you will, so that I could go …
Mar 29
Swarming Raspberry Pi, Part 2: Registry & Mirror
This episode will consist of a quick aside to build a Docker Registry Mirror. Previous: Part 1 Why Do We Need a Mirror?? The Docker Registry is, to my mind, one of the greatest contributors to the rapid growth of Docker. Having a central location for images encourages sharing and re-use. Obviously some images are …
Mar 23
Shrinking Docker Images
Size does matter. Docker images can become quite large as each RUN generates a new layer which becomes part of the image, even if it’s not in the final container. This wastes disk space and network bandwidth. The following are some steps for shrinking the size of a docker container in which builds have been …
Mar 22
Registrator for Pi: /gliderlabs/registrator ported to Pi
I’ve made a port of gliderlabs/registrator to the raspberry pi. The repository for the Pi port is at: nimblestratus/registrator. At first glance, the part I find most interesting is the size of the resulting image — ~12M. I firmly believe it’s a direct result of starting from Alpine Linux. This will definitely warrant further investigation. …