TL;DR — When using AUFS in a memory constrained environment, Java can spawn (lots!) of Zombies. A workaround is to change the storage driver to the device mapper. In working on the Hadoop in a box CDH cluster with Cloudera Manager, I’ve discovered a few interesting things about AUFS. These experiences are with Ubuntu 14.04 …
Category Archive: howto
Feb 11
Docker: Could not find container for entity id
I had an instance where the docker filesystem ran out of space. After cleaning up with docker rm and docker rmi, I got:
1 2 |
Could not find container for entity id |
I followed iwidanalage‘s suggestion from “Creating fail with Could not find container for entity id after upgrading to 1.9.0 · Issue #17691 · docker/docker”
1 2 3 4 5 6 7 |
cd /var/lib/docker sudo sqlite3 linkgraph.db update edge set name='some-random-container-name' where name='failing-container-name'; .quit |
After this, it worked.
Jan 28
Cloudera Manager, Embedded DB and Docker
If you ever see a message like:
1 2 |
could not open session |
on startup and the Cloudera manager won’t start, it’s because you did not start the container in privileged mode:
1 2 |
docker run -d --hostname=master --privileged=true --name=master cdh-master |
Oct 08
Solving File Filtering Problems with this One Weird Trick
I was asked an interesting question — how to create a regular expression which would allow a user to specify an arbitrary case insensitive series of strings, all of which must be on a line, as well as a series of strings which must not be on a line in order to filter logs. In …
Oct 02
Looking Inside a JVM: -XX:+PrintFlagsFinal
Java’s twenty years old now — next year Duke can have Irish Coffee! Seriously, though, in that time there’s been a lot of changes to the Java Virtual Machine (JVM). What once was true may no longer be the case. In digging into an issue I discovered a nice feature of the JVM which enables …
Sep 14
Creating Mini Sagas
Sep 07
Viewing Raspberry Pi Config Variables and More
Sometimes it’s helpful to see if a particular parameter is set or not on the raspberry pi. This is where vcgencmd. However, vcgencmd is useful for many other things.
Sep 07
Troubleshooting MicroSD Card Problems
The Computer employs Troubleshooters, whose job is to go out, find trouble, and shoot it. — Paranoia While re-imaging the MicroSD cards for my cluster, I ran into a few issues — nothing insurmountable, but I figured that I would share them to help others….. MicroSD cards generally come with an adapter to allow them …
Apr 09
Abusing Awk
Almost ashamed to admit I did this, yet it’s still kinda cool. I use awk for a lot of commandline parsing; I learned it back in 1989…. before perl was much of a thing. For some problems, awk “just works”. So I was wanting to count the number of instances of ‘A’ in a collection …
Apr 06
Why it’s Important to use TLS with Docker Swarm
There is nothing wrong with your docker host. Do not attempt to adjust the picture. We are controlling transmission. If we wish to make it louder, we will bring up the volume. If we wish to make it softer, we will tune it to a whisper. We will control the horizontal. We will control the …