[PROBLEM] update/Upgrade after clean install is broken

[gobo]

I botched my previous install and tried to do a clean new install. I downloaded the latest beta2 image, and dd'd that onto a SD-card.

Initially I used the menu to update all available packages, this did not really go that well, as it kept saying there were updates available, and eventually it even froze.
I rebooted my pi and it booted into XBMC. So I ssh'ed in, exited the menu and tried to perform the regular
"apt-get update; apt-get upgrade". This did not work out so well.

Terminal

xbian@xbian ~ $ sudo apt-get update
Hit http://xbian.brantje.com stable Release.gpg
Hit http://xbian.brantje.com stable Release
Hit http://mirrordirector.raspbian.org wheezy Release.gpg
Hit http://mirrordirector.raspbian.org wheezy Release
Hit http://xbian.brantje.com stable/main armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/main armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/contrib armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/non-free armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/rpi armhf Packages
Ign http://xbian.brantje.com stable/main Translation-en_GB
Ign http://xbian.brantje.com stable/main Translation-en
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-en
Ign http://mirrordirector.raspbian.org wheezy/main Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/main Translation-en
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-en
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-en
Reading package lists... Done
xbian@xbian ~ $ sudo apt-get upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages have been kept back:
xbian-package-cec xbian-package-usbmount xbian-package-xbmc xbian-update
The following packages will be upgraded:
apt apt-utils file gnupg gpgv initramfs-tools kpartx libapt-inst1.5 libapt-pkg-dev libapt-pkg4.12 libc-bin
libc-dev-bin libc6 libc6-dev libcurl3 libcurl3-gnutls libexpat1 libgnutls26 libjbig0 libmagic1 libmicrohttpd-dev
libmicrohttpd10 libmysqlclient18 libpython2.7 libsmbclient libssh-4 libssl1.0.0 libwbclient0 locales lsb-base
lsb-release multiarch-support mysql-common openssh-client openssh-server openssl perl perl-base perl-modules
python2.7 python2.7-minimal samba samba-common samba-common-bin ssh tzdata udisks wget xbian-package-firmware
xbian-package-initramfs-tools xbian-package-kernel xbian-package-samba xbian-package-vnc-server
xbian-package-zram-swap
54 upgraded, 0 newly installed, 0 to remove and 4 not upgraded.
Need to get 50.8 MB/68.8 MB of archives.
After this operation, 6,977 kB of additional disk space will be used.
Do you want to continue [Y/n]? y
Get:1 http://xbian.brantje.com/ stable/main xbian-package-firmware armhf 1.4.14-0 [3,235 kB]
Get:2 http://mirrordirector.raspbian.org/raspbian/ wheezy/main perl-base armhf 5.14.2-21+rpi2+deb7u1 [1,469 kB]
Get:3 http://xbian.brantje.com/ stable/main xbian-package-samba armhf 2.0.0-4 [1,642 B]
Get:4 http://xbian.brantje.com/ stable/main xbian-package-zram-swap armhf 1.0-4.8a [3,478 B]
Get:5 http://mirrordirector.raspbian.org/raspbian/ wheezy/main perl-modules all 5.14.2-21+rpi2+deb7u1 [3,442 kB]
Get:6 http://xbian.brantje.com/ stable/main xbian-package-vnc-server armhf 1.0.2 [10.1 kB]
Get:7 http://mirrordirector.raspbian.org/raspbian/ wheezy/main perl armhf 5.14.2-21+rpi2+deb7u1 [3,661 kB]
Get:8 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libc-dev-bin armhf 2.13-38+rpi2+deb7u1 [222 kB]
Get:9 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libc6-dev armhf 2.13-38+rpi2+deb7u1 [2,425 kB]
Get:10 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libc-bin armhf 2.13-38+rpi2+deb7u1 [1,202 kB]
Get:11 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libc6 armhf 2.13-38+rpi2+deb7u1 [4,113 kB]
Get:12 http://mirrordirector.raspbian.org/raspbian/ wheezy/main ssh all 1:6.0p1-4+deb7u1 [1,244 B]
Get:13 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libapt-pkg4.12 armhf 0.9.7.9+rpi1+deb7u1 [858 kB]
Get:14 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libapt-pkg-dev armhf 0.9.7.9+rpi1+deb7u1 [186 kB]
Get:15 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libapt-inst1.5 armhf 0.9.7.9+rpi1+deb7u1 [164 kB]
Get:16 http://mirrordirector.raspbian.org/raspbian/ wheezy/main gpgv armhf 1.4.12-7+deb7u3 [205 kB]
Get:17 http://mirrordirector.raspbian.org/raspbian/ wheezy/main gnupg armhf 1.4.12-7+deb7u3 [1,887 kB]
Get:18 http://mirrordirector.raspbian.org/raspbian/ wheezy/main apt armhf 0.9.7.9+rpi1+deb7u1 [1,242 kB]
Get:19 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libssl1.0.0 armhf 1.0.1e-2+rvt+deb7u6 [1,050 kB]
Get:20 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libgnutls26 armhf 2.12.20-8+deb7u1 [601 kB]
Get:21 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libcurl3 armhf 7.26.0-1+wheezy8 [315 kB]
Get:22 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libcurl3-gnutls armhf 7.26.0-1+wheezy8 [306 kB]
Get:23 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libexpat1 armhf 2.1.0-1+deb7u1 [116 kB]
Get:24 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libmicrohttpd-dev armhf 0.9.20-1+deb7u1 [153 kB]
Get:25 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libmicrohttpd10 armhf 0.9.20-1+deb7u1 [50.4 kB]
Get:26 http://mirrordirector.raspbian.org/raspbian/ wheezy/main mysql-common all 5.5.35+dfsg-0+wheezy1 [84.4 kB]
Get:27 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libmysqlclient18 armhf 5.5.35+dfsg-0+wheezy1 [628 kB]
Get:28 http://mirrordirector.raspbian.org/raspbian/ wheezy/main samba-common all 2:3.6.6-6+deb7u2 [213 kB]
Get:29 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libwbclient0 armhf 2:3.6.6-6+deb7u2 [90.6 kB]
Get:30 http://mirrordirector.raspbian.org/raspbian/ wheezy/main samba armhf 2:3.6.6-6+deb7u2 [3,301 kB]
Get:31 http://mirrordirector.raspbian.org/raspbian/ wheezy/main lsb-base all 4.1+Debian8+rpi1+deb7u1 [26.9 kB]
Get:32 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libsmbclient armhf 2:3.6.6-6+deb7u2 [1,259 kB]
Get:33 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libssh-4 armhf 0.5.4-1+deb7u1 [115 kB]
Get:34 http://mirrordirector.raspbian.org/raspbian/ wheezy/main samba-common-bin armhf 2:3.6.6-6+deb7u2 [2,683 kB]
Get:35 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libjbig0 armhf 2.0-2+deb7u1 [31.6 kB]
Get:36 http://mirrordirector.raspbian.org/raspbian/ wheezy/main file armhf 5.11-2+deb7u3 [51.7 kB]
Get:37 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libmagic1 armhf 5.11-2+deb7u3 [199 kB]
Get:38 http://mirrordirector.raspbian.org/raspbian/ wheezy/main apt-utils armhf 0.9.7.9+rpi1+deb7u1 [371 kB]
Get:39 http://mirrordirector.raspbian.org/raspbian/ wheezy/main wget armhf 1.13.4-3+deb7u1 [749 kB]
Get:40 http://mirrordirector.raspbian.org/raspbian/ wheezy/main multiarch-support armhf 2.13-38+rpi2+deb7u1 [151 kB]
Get:41 http://mirrordirector.raspbian.org/raspbian/ wheezy/main tzdata all 2013i-0wheezy1 [450 kB]
Get:42 http://mirrordirector.raspbian.org/raspbian/ wheezy/main initramfs-tools all 0.115~bpo70+1 [92.6 kB]
Get:43 http://mirrordirector.raspbian.org/raspbian/ wheezy/main python2.7-minimal armhf 2.7.3-6+deb7u2 [1,681 kB]
Get:44 http://mirrordirector.raspbian.org/raspbian/ wheezy/main python2.7 armhf 2.7.3-6+deb7u2 [2,687 kB]
Get:45 http://mirrordirector.raspbian.org/raspbian/ wheezy/main libpython2.7 armhf 2.7.3-6+deb7u2 [1,069 kB]
Get:46 http://mirrordirector.raspbian.org/raspbian/ wheezy/main lsb-release all 4.1+Debian8+rpi1+deb7u1 [26.8 kB]
Get:47 http://mirrordirector.raspbian.org/raspbian/ wheezy/main udisks armhf 1.0.4-7wheezy1 [247 kB]
Get:48 http://mirrordirector.raspbian.org/raspbian/ wheezy/main kpartx armhf 0.4.9+git0.4dfdaf2b-7~deb7u2 [34.7 kB]
Get:49 http://mirrordirector.raspbian.org/raspbian/ wheezy/main locales all 2.13-38+rpi2+deb7u1 [5,710 kB]
Get:50 http://mirrordirector.raspbian.org/raspbian/ wheezy/main openssh-server armhf 1:6.0p1-4+deb7u1 [315 kB]
Get:51 http://mirrordirector.raspbian.org/raspbian/ wheezy/main openssh-client armhf 1:6.0p1-4+deb7u1 [950 kB]
Get:52 http://mirrordirector.raspbian.org/raspbian/ wheezy/main openssl armhf 1.0.1e-2+rvt+deb7u6 [700 kB]
Fetched 50.8 MB in 46s (1,103 kB/s)
Create a snapshot of '/tmp/btrfs-snap/root/@' in '/tmp/btrfs-snap/root/@btrfs-auto-snap_apt-run-2014-04-13-1331'
@btrfs-auto-snap_apt-run-2014-04-13-1331, 1 created snapshots, 0 destroyed snapshots, 0 warnings.
Extracting templates from packages: 100%
Preconfiguring packages ...
(Reading database ... 31224 files and directories currently installed.)
Preparing to replace perl-base 5.14.2-21+rpi2 (using .../perl-base_5.14.2-21+rpi2+deb7u1_armhf.deb) ...
Unpacking replacement perl-base ...
Setting up perl-base (5.14.2-21+rpi2+deb7u1) ...
(Reading database ... 31224 files and directories currently installed.)
Preparing to replace perl-modules 5.14.2-21+rpi2 (using .../perl-modules_5.14.2-21+rpi2+deb7u1_all.deb) ...
Unpacking replacement perl-modules ...
Setting up perl-modules (5.14.2-21+rpi2+deb7u1) ...
(Reading database ... 31224 files and directories currently installed.)
Preparing to replace perl 5.14.2-21+rpi2 (using .../perl_5.14.2-21+rpi2+deb7u1_armhf.deb) ...
Unpacking replacement perl ...
Processing triggers for man-db ...
Setting up perl (5.14.2-21+rpi2+deb7u1) ...
(Reading database ... 31224 files and directories currently installed.)
Preparing to replace libc-dev-bin 2.13-38+rpi2 (using .../libc-dev-bin_2.13-38+rpi2+deb7u1_armhf.deb) ...
Unpacking replacement libc-dev-bin ...
Preparing to replace libc6-dev:armhf 2.13-38+rpi2 (using .../libc6-dev_2.13-38+rpi2+deb7u1_armhf.deb) ...
Unpacking replacement libc6-dev:armhf ...
Preparing to replace libc-bin 2.13-38+rpi2 (using .../libc-bin_2.13-38+rpi2+deb7u1_armhf.deb) ...
Unpacking replacement libc-bin ...
Setting up libc-bin (2.13-38+rpi2+deb7u1) ...
(Reading database ... 31224 files and directories currently installed.)
Preparing to replace libc6:armhf 2.13-38+rpi2 (using .../libc6_2.13-38+rpi2+deb7u1_armhf.deb) ...
Unpacking replacement libc6:armhf ...
Processing triggers for man-db ...
Setting up libc6:armhf (2.13-38+rpi2+deb7u1) ...
(Reading database ... 31224 files and directories currently installed.)
Preparing to replace xbian-package-firmware 1.4-7 (using .../xbian-package-firmware_1.4.14-0_armhf.deb) ...
Unpacking replacement xbian-package-firmware ...
Setting up xbian-package-firmware (1.4.14-0) ...
(Reading database ... 31273 files and directories currently installed.)
Preparing to replace xbian-package-initramfs-tools 1.3.1-5b (using .../xbian-package-initramfs-tools_1.3.3-4b_armhf.deb) ...
Unpacking replacement xbian-package-initramfs-tools ...
Replacing files in old package xbian-update ...
Preparing to replace xbian-package-kernel 1.3-5.5 (using .../xbian-package-kernel_1.3-6.10_armhf.deb) ...
Unpacking replacement xbian-package-kernel ...
Setting up xbian-package-kernel (1.3-6.10) ...
Setting up xbian-package-initramfs-tools (1.3.3-4b) ...
Installing new version of config file /etc/default/xbian-initramfs ...
(Reading database ... 31537 files and directories currently installed.)
Preparing to replace libapt-pkg4.12:armhf 0.9.7.9+rpi1 (using .../libapt-pkg4.12_0.9.7.9+rpi1+deb7u1_armhf.deb) ...
Unpacking replacement libapt-pkg4.12:armhf ...
E: Sub-process /usr/bin/dpkg exited unexpectedly
xbian@xbian ~ $ sudo apt-get update
[sudo] password for xbian:
Hit http://xbian.brantje.com stable Release.gpg
Hit http://xbian.brantje.com stable Release
Hit http://mirrordirector.raspbian.org wheezy Release.gpg
Hit http://mirrordirector.raspbian.org wheezy Release
Hit http://xbian.brantje.com stable/main armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/main armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/contrib armhf Packages
Hit http://mirrordirector.raspbian.org wheezy/non-free armhf Packages
Ign http://xbian.brantje.com stable/main Translation-en_GB
Hit http://mirrordirector.raspbian.org wheezy/rpi armhf Packages
Ign http://xbian.brantje.com stable/main Translation-en
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/contrib Translation-en
Ign http://mirrordirector.raspbian.org wheezy/main Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/main Translation-en
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/non-free Translation-en
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-en_GB
Ign http://mirrordirector.raspbian.org wheezy/rpi Translation-en
E: dpkg was interrupted, you must manually run 'sudo dpkg --configure -a' to correct the problem.
xbian@xbian ~ $ sudo dpkg --configure -a
Processing triggers for initramfs-tools ...
update-initramfs: Not updating initramfs.
Processing triggers for install-info ...
Setting up libc-dev-bin (2.13-38+rpi2+deb7u1) ...
Setting up libapt-pkg4.12:armhf (0.9.7.9+rpi1+deb7u1) ...
Processing triggers for xbian-package-initramfs-tools ...
Setting up libc6-dev:armhf (2.13-38+rpi2+deb7u1) ...
xbian@xbian ~ $ sudo apt-get upgrade
Reading package lists... Done
Building dependency tree
Reading state information... Done
You might want to run 'apt-get -f install' to correct these.
The following packages have unmet dependencies:
libapt-pkg-dev : Depends: libapt-pkg4.12 (= 0.9.7.9+rpi1) but 0.9.7.9+rpi1+deb7u1 is installed
E: Unmet dependencies. Try using -f.
xbian@xbian ~ $ ^C
xbian@xbian ~ $ sudo apt-get -f install
Reading package lists... Done
Building dependency tree
Reading state information... Done
Correcting dependencies... Done
The following packages were automatically installed and are no longer required:
apt-show-versions libapt-pkg-perl
Use 'apt-get autoremove' to remove them.
The following extra packages will be installed:
libapt-inst1.5 libapt-pkg-dev
The following packages will be upgraded:
libapt-inst1.5 libapt-pkg-dev
2 upgraded, 0 newly installed, 0 to remove and 45 not upgraded.
Need to get 0 B/350 kB of archives.
After this operation, 2,048 B of additional disk space will be used.
Do you want to continue [Y/n]? y
Create a snapshot of '/tmp/btrfs-snap/root/@' in '/tmp/btrfs-snap/root/@btrfs-auto-snap_apt-run-2014-04-13-1355'
@btrfs-auto-snap_apt-run-2014-04-13-1355, 1 created snapshots, 0 destroyed snapshots, 0 warnings.
E: Sub-process /usr/bin/dpkg exited unexpectedly

[mk01]

@gobo

yes. you are doing "ok". simply the actual (by actual I mean the one on the image) version of dpkg, or dpkglibs or apt, or aptlibs or similar is not perfect. together with some parameters in /etc/sysctl.d/xbmc.conf (using memory to limit) can end up with this kind of error specially on 256MB models.

good part is that once you install newer version of dpkg* apt*, you are fine again and all works as should. mostly working steps are this:
1) remove /etc/sysctl.d/xbian.conf
2) reboot
3) try again
4) if still not, try creating /etc/sysctl.d/xbian.conf with only one setting
vm.min_free_kbytes = 16384
5) if 16384 still crashes dpkg, try 32768 or even 65536. (you have to reload setting from this file by "sudo sysctl -p /etc/sysctl.d/xbian.conf"

just update all packages available, xbian will even put back the deleted file and all should be working. there are some more details on WIKI we are rebuilding - but updates should be covered.