*nix

Job: Open Source automation guy needed

Since we have been too busy for a long time, we need two extra hands.

We are currently 3 people, 2 of them Expert Open Source technicians - so it's a technician run company - no unrealistic project managers here - we hope ;)

You would be working on developing EnableIT's own operations environment, which is 100% automated by Puppet, scripts (bash, perl, ruby, python etc.) and monitoring using Icinga/Nagios and graphite/grafana.

Elasticsearch graphs

After having worked with Elasticsearch and thrown quite a lot of data at it (we add about 100 million documents a day), I have built a very nice set of graphs, that helps me visualize problems and activity in the cluster, and figured I'd share them to hopefully give some inspiration :)

p.s. the jvm_heap_usage graphs - the two lines which are very jumpy, are the ones I switched to using G1 Garbage Collector, which does seem to be of help when you're running close to your heap limit :) 

p.s. view image alone, to see it in full size.

Unix and automation/puppet mand søges..

Da vi alt for længe, har haft alt for travlt, søger EnableIT ApS en medarbejder til at afhjælpe det "problem" :)

Vi er idag 2 personer (ejerne) og du vil altså være den første medarbejder (men i og med ejerne er teknikere, så er der ikke nogen urealistiske forventninger her - håber vi :)

Arbejdsformen vil være blandet, mellem opgaver som konsulent for forskellige kunder, og udvikling af EnableIT's eget Puppet miljø - der driver forskellige kunders serverpark.

Securing elasticsearch (and solr) and other REST interfaces..

I use Logstash. Since v1.2.2 (with a few fixes, which made it actually handle webserver access logs properly :) - It's been a fun tool to do amazing things with. That and elastic search with the Kibana interface..

Only problem is that default kibana setup, just accesses elasticsearch directly (port 9200) - and elasticsearch has NO concept of users, authorization etc.

ie. EVERYONE can DELETE your data.. or modify them. or..

NemID på hardware - guide

UPDATE: Så fik jeg også afprøvet kortet med NemID - se pkt. 5
UPDATE 2: Christian har åbenbart flyttet/slettet sit indlæg.
UPDATE3: nemid har ændret url til softwaren
UPDATE4: tilføjet doku. for Ubuntu 13.10

Nå - så fik jeg endelig tid til at prøve at få NemID på hardware til at fungere på min Linux og det var tilstrækkeligt besværligt, til jeg lige ville skrive en opsummering :)

Jeg kører Kubuntu 12.04 LTS (precise pangolin) - men guiden burde kunne bruges, evt. med små versionsændringer i f.ex. boost pakkerne der installeres.

simple carbon-cache data check

Here's a simple script I use to check if updates are coming into carbon (graphite storage backend) as expected:

Do you have People redundancy?

As an Operations consultant, I always see people focus on redundancy on all levels... Except for documentation.

For some reason everyone says, there should be documentation, but never ends up being usable documentation. Either it's too much, too little or something else :)

graph it

I've been setting up automated (with puppet) graphing of a lot of servers, incl. graphs for applications like varnish, mysql, memcache etc. (using diamond graphite collector).

I created a graph over varnish hitrates and shared it with the developer of the site running behind that varnish-farm (at that time it was 67% and slowly decreasing).

Here's what happened then :)

Puppet: Need major version fact

I've often needed to seperate settings pr. a distros major relase in puppet.

f.ex. CentOs-6 is different than CentOs-5 -  but there's no difference between v5.6 and 5.7.

Unfortunately there's no fact in puppet that gives this. I've had an $osversion fact - which simply concat'ed $operatingsystem and $lsbmajdistrelease - but that last fact depends on lsbdistrelease - which depends on lsb_release, which on Red Hat 6 is delivered by redhat-lsb package - which pulls in ~90 packages!

Puppet foredrag

Så fik jeg holdt mit foredrag hos DKUUG om  system konfigurationsværktøjet Puppet - og der var forbavsende (for mig :) mange der mødte op.

Til dem der skulle have lyst så har jeg vedhæftet slides i PDF format og DKUUG vil vist have en video med foredraget oppe på et tidspunkt.