Apr 07
Cloudera Manager is fairly opinionated. In its defence, it pretty much needs to be given that it needs to wrangle multiple underlying Open Source projects. Each of these, in turn, have their own quirks and opinions. The following is a description of how to recover a Cloudera Manager cluster post disaster, assuming that you have …
Mar 30
I’ve been rewriting a cleanroom version of the hadoop-in-a-box — just about finished. And, truth be told, the code, all in all, is a bit tighter than the original encumbered version. However, I ran into an interesting feature of Volumes — I had thought perhaps to optimize things a bit, but it caused some unexpected …
Mar 17
TL;DR: Java and cgroups/Docker memory constraints don’t always behave as you might expect. Always explicitly specify JVM heap sizes. Also be aware that kernel features may not be enabled. And Linux… lies. I’ve recently discovered an interesting “quirk” in potential interactions between Java, cgroups, Docker, and the kernel which can cause some surprising results. Unless …
Mar 15
TL;DR — When using AUFS in a memory constrained environment, Java can spawn (lots!) of Zombies. A workaround is to change the storage driver to the device mapper. In working on the Hadoop in a box CDH cluster with Cloudera Manager, I’ve discovered a few interesting things about AUFS. These experiences are with Ubuntu 14.04 …
Mar 10
While learning how the configuration worked — in particular which arguments to pass in order to set non-default values, I discovered that I could lose changes by following these steps: Use the GUI to set a value and save it. This is just so that you can find the variable. Keep the GUI open. Dump …
Feb 11
I had an instance where the docker filesystem ran out of space. After cleaning up with docker rm and docker rmi, I got:
|
1 2 |
Could not find container for entity id |
I followed iwidanalage‘s suggestion from “Creating fail with Could not find container for entity id after upgrading to 1.9.0 · Issue #17691 · docker/docker”
|
1 2 3 4 5 6 7 |
cd /var/lib/docker sudo sqlite3 linkgraph.db update edge set name='some-random-container-name' where name='failing-container-name'; .quit |
After this, it worked.
Sep 21
TL;DR The F5 BigPipe LTM uses HTTP/0.9 to send its HTTP monitoring requests by default. Wildfly 9.0 does not like this; moving to a monitor request of HTTP/1.1 fixed the problem. Caution: LTM 10.2.x and 11.x do not append a CR/LF to the end unless you are using Basic Authentication. This is contrary to previous …
Sep 18
I recently discovered a really interesting tool for producing videos of screen captures, optionally with webcam inserts. It’s called Open Broadcaster Software and it works on Linux, Windows, and there is a beta version for Apple OSX. It seems that it was originally intended for streaming to websites, but it has a lot more features …
Sep 07
The Computer employs Troubleshooters, whose job is to go out, find trouble, and shoot it. — Paranoia While re-imaging the MicroSD cards for my cluster, I ran into a few issues — nothing insurmountable, but I figured that I would share them to help others….. MicroSD cards generally come with an adapter to allow them …
Apr 19
Generally smaller Docker containers are preferred to larger ones. However, a smaller container is not always as performant as a larger one. By using a (slightly) larger container, performance improved over 30x. TL;DR The grep included in busybox is painfully slow. When doing using grep to process lots of data, add a (real) grep to …
© 2008-2016 by Matthew K. Williams
Ramblings by Matt Williams is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at http://matthewkwilliams.com.
Powered by WordPress and the Graphene Theme.
