Installing QGis Server on Ubuntu Saucy

I thought it would nice to have an easy simple GIS data server set up, so here are some notes on installing QGis Server on Ubuntu 13.10 (saucy).
I have a quite powerful server sitting in my office, serving my main website and a few other things, but it is not under heavy load, and it has plenty of disk space - so why not install QGis Server to play with and see how it goes?
I first installed the packages according to this tutorial, using the packages provided by Canonical. I found that this is an older version of QGis (1.7) and I had to do some figuring out to get the cgi module running well with Apache. After I have figured out that the fcgid module loaded properly I still had the problem that the actual fcgi program did not execute, but it was offered as a download. This is the httpd.conf setting that fixed it for me:
<IfModule fcgid_module>
FcgidIdleTimeout 60
FcgidMinProcessesPerClass 2
FcgidMaxProcessesPerClass 20
Alias /map/ /usr/lib/cgi-bin/
<Directory /usr/lib/cgi-bin/>
AddHandler fcgid-script .fcgi
SetHandler fcgid-script
AllowOverride None
Options +ExecCGI
Order allow,deny
Allow from all
</Directory>
</IfModule>
Now, after playing with it a bit and noticing that there was some compatibility issues + newer features in later QGis server that would be interesting, I decided to install using the qgis.org package.
I started off with the instructions specified by Anita Graser in a blog post, but there were some things that didn't work as they should, here is what I used:
sudo add-apt-repository "deb http://qgis.org/debian saucy main"
gpg --keyserver keyserver.ubuntu.com --recv BBA6491F47765B75
gpg --export --armor BBA6491F47765B75 | sudo apt-key add -
sudo apt-get update
# the command below lists which packages need to be upgraded
sudo apt-get -V -s upgrade
sudo apt-get dist-upgrade