Forum

Forum > Software > Installation > Distribution upgrade to Buster fails
Full Version: Distribution upgrade to Buster fails
You're currently viewing a stripped down version of our content. View the full version with proper formatting.
Pages: 1 2 3 4 5

jakenl

3rd Nov, 2019, 04:55 AM
Hi, after an image backup, I tried the Buster distribution upgrade. After finishing with an error (nginx, E: subproces /user/bin/dpkg returned an error), I did from the command line an apt-get upgrade, which fixed the nginx update. It also suggested me to do an apt autoremove some unused packages.

I rebooted afterwards.
the Xbian logo with install info comes up
The Kodi Splash screen comes up, but with a little text showing that holding the shift key and ??? on an USB keyboard with point you towards the cli.
After some waiting, it seems to finish a process in the CLI regardless and waits for user input to log in.
I logged in with a mini -usb keyboard and did a reboot.

Xbian start screen
Kodi splash screen, for a long time
Xbian start screen again with 'Loading...'
After a minute or what, it goes back to the CLI and asks for user login credentials.

I can access the shared folders over smb (therefore have access to kodi.log), but I can't login through SSH.

This morning I had the same (although I than did the apt-get stuff after the failure)

kodi log file (Click to View)

jakenl

3rd Nov, 2019, 09:20 AM
In the above shared log file, this part attracts my attention, although i can't find a solution yet:

ERROR: open_restricted - failed to open /dev/input/event0 (Permission denied)
2019-11-02 19:33:36.829 T:1880157552 ERROR: open_restricted - failed to open /dev/input/event1 (Permission denied)
2019-11-02 19:33:36.830 T:1880157552 ERROR: open_restricted - failed to open /dev/input/event2 (Permission denied)
2019-11-02 19:33:36.831 T:1880157552 ERROR: open_restricted - failed to open /dev/input/event3 (Permission denied)


Update: in /var/log/upstart/xbmc.log I found this: segmentation fault

Deletion of profile.xml in xbian/.kodi/userdata didn't help

Altogether I think that this distribution upgrade corrupted more than one thing

jakenl

5th Nov, 2019, 04:54 AM
I have tried many things and at the end I decided to go back to Stretch, for the time being.

I checked the sources.list and xbian.list. Both were pointing towards Buster
I checked the xbmc.log file and it states 'segmentation fault'
SSH doesn't work anymore, so I need to use an USB keyboard and work on the HDMI-screen (this works)
Service xbmc restarts fails
I checked the cmdline.txt, but that looked original
I checked config.txt and no different than normal
Same thing for /etc/fstab
I tried to reboot without additional USB-sticks, USB-keyboard and network cable: no difference

I changed the xbian.list to 'staging'. This generated a whole new list of upgradeable packages, including an alpha version of Kodi 19. I expected this to run, but the same result as mentioned in the previous posts, no change to be seen there.

The only thing I can guess now, is that it have to do with me booting from an USB-stick on my RPI3 instead of from a SD-card. Maybe the script can't handle that.

With the time spent, I might be better of with a fresh Buster image and reinsert my 'xbian-backup-home'. Would that work? I will also need to reinstall some other stuff that I run on the side on this RPI, but if I have documented everything properly for myself, it might save time at the end.

Nachteule

6th Nov, 2019, 02:56 AM
If upgrade fails, it is very important to figure out why it fails

You can find complete log in file /tmp/aptstatus

So I assume that your system stucked in the middle of the upgrade progress and this is the reason for a non functional system

I have 2 installations on an external usb disk, so this can not be the problem

And yes, backing up /home and recover it after fresh install would work

Nachteule

6th Nov, 2019, 03:05 AM
And, you can do a manual upgrade to see directly what happens:

1) change all stretch to buster in file /etc/apt/sources.list and /etc/apt/sources.list.d/xbian.list
2) run sudo apt-get update
3) DEBIAN_FRONTEND=noninteractive sudo apt-get dist-upgrade -y --allow-downgrades -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold 2>&1 | tee /tmp/aptstatus
4) sudo apt-get install --reinstall xbian-update

in 3), you have to look which packages will be REMOVED and it is important that upstart and xbian-package-xbmc is not removed and elogind will be installed

Please note: you should not run this in a ssh session, because usually connection will be lost during apt-get run and this wil interrupt the upgrade process

jakenl

6th Nov, 2019, 09:14 AM
(6th Nov, 2019 03:05 AM)Nachteule Wrote: [ -> ]And, you can do a manual upgrade to see directly what happens:

1) change all stretch to buster in file /etc/apt/sources.list and /etc/apt/sources.list.d/xbian.list
2) run sudo apt-get update
3) DEBIAN_FRONTEND=noninteractive sudo apt-get dist-upgrade -y --allow-downgrades -o Dpkg::Options::=--force-confdef -o Dpkg::Options::=--force-confold 2>&1 | tee /tmp/aptstatus
4) sudo apt-get install --reinstall xbian-update

in 3), you have to look which packages will be REMOVED and it is important that upstart and xbian-package-xbmc is not removed and elogind will be installed
Thanks, I will try that and see how it goes!

Skywatch

6th Nov, 2019, 10:05 PM
I just thought I'd try this as well with a USB SSD to see if it might help.

Whilst upstart is not in the removed packages list (good), elogin is not in the new packages list (not-so-good?).

But it's upgrading anyway as there seems no way to stop it now.

I'll let you know if it recovers to a working state or not.

-----

With staging enabled it seemed to upgrade but upon completion and after several reboots no http access but ssh working. So I reverted to the previous snapshot.

Nachteule

6th Nov, 2019, 11:37 PM
(6th Nov, 2019 10:05 PM)Skywatch Wrote: [ -> ]I just thought I'd try this as well with a USB SSD to see if it might help.

Whilst upstart is not in the removed packages list (good), elogin is not in the new packages list (not-so-good?).

But elogind should be there, because it is in depencency of another package (initramfs-tools) Huh

Terminal

root@kmxbilr2 /var/lib/dpkg # dpkg-query -s initramfs-tools | grep ^Depends
Depends: initramfs-tools-core (= 0.133+xbian1), linux-base, elogind

Quote:But it's upgrading anyway as there seems no way to stop it now.

I'll let you know if it recovers to a working state or not.

Thanks

Skywatch

7th Nov, 2019, 12:06 AM
I guess that the -y in line 3) will start the upgrade right away. It was upgrading in the background while I was looking to see what packages were/were not included. Maybe I missed it, but I am very confident that it was not showing. Confused

I'll try again without -y as that will hopefully hold it at the yes/no prompt and I can look again.

And here's why - initramfs-tools is held back for some reason!

Terminal

xbian@cinema2 ~ $ sudo apt-get dist-upgrade --allow-downgrades -o Dpkg::Options: :=--force-confdef -o Dpkg::Options::=--force-confold 2>&1 | tee /tmp/aptstatus
Reading package lists...
Building dependency tree...
Reading state information...
Calculating upgrade...
The following packages will be REMOVED:
consolekit libmariadbclient18 libtirpc1 systemd-shim xbian-package-xbmc
The following NEW packages will be installed:
binutils-arm-linux-gnueabihf binutils-common cpp-8 fdisk g++-8 gcc-7-base
gcc-8 gcc-8-base gdisk gnupg-l10n gnupg-utils gpg gpg-agent gpg-wks-client
gpg-wks-server gpgconf gpgsm guile-2.2-libs libargon2-1 libasan5 libass9
libb-hooks-op-check-perl libbind9-161 libbinutils libblockdev-fs2
libblockdev-loop2 libblockdev-part-err2 libblockdev-part2 libblockdev-swap2
libblockdev-utils2 libblockdev2 libboolean-perl libcdio-cdda2
libcdio-paranoia2 libcdio18 libclone-choose-perl libcodec2-0.8.1 libcom-err2
libcryptsetup12 libdevel-callchecker-perl libdns-export1104 libdns1104
libdrm-amdgpu1 libdrm-common libdrm-etnaviv1 libdrm-nouveau2 libdrm-radeon1
libdynaloader-functions-perl libegl-mesa0 libegl1 libevent-2.1-6 libext2fs2
libf2fs-format4 libf2fs5 libfl2 libfstrm0 libgcc-8-dev libgdbm-compat4
libgdbm6 libgl1 libgl1-mesa-dri libglvnd0 libglx-mesa0 libglx0 libi2c0
libicu63 libimagequant0 libisc-export1100 libisc1100 libisccc161
libisccfg163 libisl19 libjansson4 libllvm7 liblmdb0 liblwres161 libmariadb3
libmpfr6 libncurses6 libncursesw6 libnftnl11 libnl-route-3-200 libnorm1
libntfs-3g883 libparted-fs-resize0 libpcre2-8-0 libperl5.28 libprocps7
libprotobuf-c1 libpython2-dev libpython2-stdlib libpython3.7
libpython3.7-dev libpython3.7-minimal libpython3.7-stdlib libsensors-config
libsensors5 libsndio7.0 libsodium23 libstdc++-8-dev libtinfo6
libtirpc-common libtirpc3 libubsan1 libuchardet0 libunistring2 libva-drm2
libva-x11-2 libva2 libvidstab1.1 libvpx5 libwayland-egl1 libwebpmux3
libx264-155 libx265-165 libyaml-0-2 mariadb-common perl-modules-5.28
python-certifi python-idna python2 python2-dev python2-minimal
python3-certifi python3-chardet python3-crypto python3-dbus
python3-distro-info python3-distutils python3-idna python3-lib2to3
python3-pkg-resources python3-requests python3-six python3-urllib3
python3-yaml python3.7 python3.7-dev python3.7-minimal usb.ids
The following packages have been kept back:
initramfs-tools initramfs-tools-core
The following packages will be upgraded:
acl adduser alsa-tools alsa-utils anacron apt apt-utils at atomicparsley
autoconf autofs automake autotools-dev avahi-daemon base-files base-passwd
bash bc bind9-host binutils blt bsdmainutils bsdutils btrfs-progs
build-essential bzip2 ca-certificates cec-utils cifs-utils cme console-setup
console-setup-linux coreutils cpio cpp cron cvs dash dbus debconf
debconf-i18n debian-archive-keyring debian-keyring debianutils dh-python
dialog diffutils dirmngr distro-info-data dmsetup dosfstools dpkg dpkg-dev
e2fslibs e2fsprogs exfat-fuse exfat-utils f2fs-tools fail2ban ffmpeg file
findutils firmware-atheros firmware-misc-nonfree firmware-ralink
firmware-realtek fontconfig fontconfig-config fuse g++ gcc gettext
gettext-base git git-man gnupg gnupg-agent gpgv grep groff-base
guile-2.0-libs gzip hdparm hfsutils hostname i2c-tools ifplugd ifupdown
inetutils-tools init-system-helpers initscripts insserv iproute2 iptables
ir-keytable isc-dhcp-client isc-dhcp-common iw jfsutils kbd
keyboard-configuration keyutils klibc-utils kmod kpartx lcdproc less
libaacs0 libacl1 libalgorithm-diff-perl libao-common libao4 libaom0
libapparmor1 libapt-inst2.0 libapt-pkg5.0 libasn1-8-heimdal libasound2
libasound2-data libassuan0 libatasmart4 libatomic1 libattr1 libaudit-common
libaudit1 libavahi-client3 libavahi-common-data libavahi-common3
libavahi-compat-libdnssd1 libavahi-core7 libavc1394-0 libavcodec58
libavdevice58 libavfilter7 libavformat58 libavresample4 libavutil56
libblkid1 libbluetooth3 libbluray2 libbsd0 libbz2-1.0 libc-bin libc-dev-bin
libc-l10n libc6 libc6-dev libcaca0 libcairo2 libcap-ng0 libcap2 libcap2-bin
libcapture-tiny-perl libcarp-assert-more-perl libcc1-0 libcec libcec-dev
libcec4 libchromaprint1 libclass-data-inheritable-perl libclass-isa-perl
libclass-load-perl libclone-perl libcomerr2 libconfig-model-lcdproc-perl
libconfig-model-perl libcroco3 libcups2 libcurl3-gnutls libdaemon0
libdatrie1 libdb5.3 libdbus-1-3 libdbus-glib-1-2 libdebconfclient0
libdevel-stacktrace-perl libdevmapper-event1.02.1 libdevmapper1.02.1
libdigest-hmac-perl libdpkg-perl libdrm2 libebur128-1 libedit2 libegl1-mesa
libelf1 liberror-perl libevdev2 libexception-class-perl libexpat1
libexpat1-dev libexporter-tiny-perl libfdisk1 libffi6 libfftw3-double3
libfftw3-single3 libfile-copy-recursive-perl libfile-homedir-perl
libfile-which-perl libflac8 libflite1 libfontconfig1 libfreetype6
libfribidi0 libfuse2 libgbm1 libgc1c2 libgcc1 libgcrypt20 libgdk-pixbuf2.0-0
libgdk-pixbuf2.0-common libgeoip1 libgetopt-long-descriptive-perl libgif7
libgl1-mesa-glx libglapi-mesa libglib2.0-0 libglu1-mesa libgme0 libgmp10
libgnutls-openssl27 libgnutls30 libgomp1 libgpg-error0 libgpgme11
libgraphite2-3 libgsm1 libgssapi-krb5-2 libgssapi3-heimdal libgudev-1.0-0
libharfbuzz0b libhash-merge-perl libhcrypto4-heimdal libhdb9-heimdal
libheimbase1-heimdal libheimntlm0-heimdal libhogweed4 libhtml-parser-perl
libhtml-tree-perl libhttp-cookies-perl libhttp-message-perl
libhttp-negotiate-perl libhx509-5-heimdal libi2c-dev libidn11 libidn2-0
libiec61883-0 libimobiledevice6 libinput-bin libinput10
libio-socket-ssl-perl libio-stringy-perl libip4tc0 libip6tc0 libiptc0
libiw30 libjack-jackd2-0 libjpeg62-turbo libjs-jquery libjs-sphinxdoc
libjs-underscore libjson-c3 libjson-perl libk5crypto3 libkdc2-heimdal
libkeyutils1 libklibc libkmod2 libkrb5-26-heimdal libkrb5-3 libkrb5support0
liblcms2-2 libldap-2.4-2 libldap-common libldb1 liblilv-0-0 liblirc-client0
liblist-moreutils-perl liblocale-gettext-perl liblockfile-bin liblockfile1
liblog-log4perl-perl libltdl7 liblwp-protocol-https-perl liblz4-1 liblzma5
liblzo2-2 libmad0 libmagic-mgc libmagic1 libmailutils5 libmicrohttpd12
libmodplug1 libmodule-runtime-perl libmount1 libmouse-perl
libmousex-strictconstructor-perl libmp3-tag-perl libmp3lame0 libmpc3
libmpdec2 libmpeg2-4 libmpg123-0 libmysofa0 libncurses5 libncursesw5
libnet-http-perl libnet-smtp-tls-butmaintained-perl libnet-ssleay-perl
libnetfilter-conntrack3 libnettle6 libnfnetlink0 libnghttp2-14 libnih-dbus1
libnih1 libnl-3-200 libnl-genl-3-200 libnpth0 libnspr4 libnss-mdns libnss3
libntlm0 libogg0 libopenal-data libopenal1 libopenjp2-7 libopenmpt0
libopts25 libopus0 liborc-0.4-0 libp11-kit-dev libp11-kit0
libpackage-stash-perl libpam-modules libpam-modules-bin libpam-runtime
libpam-systemd libpam0g libpango-1.0-0 libpangocairo-1.0-0 libpangoft2-1.0-0
libparams-classify-perl libparams-util-perl libparams-validate-perl
libparse-recdescent-perl libparted2 libpath-tiny-perl libpcre3 libpcrecpp0v5
libpcsclite1 libperl4-corelibs-perl libpgm-5.2-0 libpipeline1 libpixman-1-0
libplist3 libplymouth4 libpng16-16 libpod-pom-perl libpolkit-agent-1-0
libpolkit-backend-1-0 libpolkit-gobject-1-0 libpopt0 libpostproc55 libpsl5
libpulse-mainloop-glib0 libpulse0 libpython-dev libpython-stdlib
libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib
libpython3-dev libpython3-stdlib libreadline7 libregexp-common-perl
libroken18-heimdal librsvg2-2 librtmp1 libsamplerate0 libsasl2-2
libsasl2-modules-db libsdl-image1.2 libsdl1.2debian libsdl2-2.0-0
libseccomp2 libselinux1 libsemanage-common libsemanage1 libsepol1
libserd-0-0 libsgutils2-2 libshine3 libsigsegv2 libslang2 libsm6
libsmartcols1 libsmbclient libsnappy1v5 libsndfile1 libsoxr0 libsqlite0
libsqlite3-0 libss2 libssh-4 libssh-gcrypt-4 libssh2-1 libssl1.1 libstdc++6
libstring-rewriteprefix-perl libsub-exporter-perl libsub-identify-perl
libswresample3 libswscale5 libsystemd0 libtag1v5 libtag1v5-vanilla
libtalloc2 libtasn1-6 libtcl8.6 libtdb1 libtevent0 libtext-charwidth-perl
libtext-diff-perl libtext-iconv-perl libthai-data libthai0 libtheora0
libtiff5 libtinfo5 libtk8.6 libtry-tiny-perl libtwolame0 libubsan0 libudev1
libudisks2-0 libunicode-string-perl libupower-glib3 liburi-perl libusb-0.1-4
libusb-1.0-0 libusbmuxd4 libuuid1 libvdpau1 libvncserver1 libvorbis0a
libvorbisenc2 libvorbisfile3 libwacom-common libwacom2 libwavpack1
libwayland-client0 libwayland-cursor0 libwayland-egl1-mesa
libwayland-server0 libwbclient0 libwebp6 libwebpdemux2 libwind0-heimdal
libwrap0 libwww-perl libwww-robotrules-perl libx11-6 libx11-data libx11-xcb1
libx264-148 libxau6 libxcb-dri2-0 libxcb-dri3-0 libxcb-glx0 libxcb-present0
libxcb-render0 libxcb-shape0 libxcb-shm0 libxcb-sync1 libxcb-xfixes0 libxcb1
libxcursor1 libxdamage1 libxft2 libxinerama1 libxkbcommon0
libxml-libxml-perl libxml-namespacesupport-perl libxml-sax-base-perl
libxml-sax-perl libxml-simple-perl libxml2 libxshmfence1 libxslt1.1 libxss1
libxtables12 libxvidcore4 libyajl2 libyaml-perl libzmq5 libzstd1
libzvbi-common libzvbi0 linux-base locales lockfile-progs login logrotate
lsb-base lsb-release lsof m4 mailutils mailutils-common make makedev man-db
mime-support mount mpack multiarch-support mysql-common nano ncurses-base
ncurses-bin net-tools netbase nfs-common ntfs-3g ntp openbsd-inetd
openssh-client openssh-server openssh-sftp-server openssl parted passwd
patch perl perl-base pinentry-curses plymouth policykit-1 procps psmisc pv
python python-apt python-apt-common python-chardet python-configparser
python-crypto python-dev python-dnspython python-future python-ldb
python-libcec python-minimal python-pil python-pkg-resources python-requests
python-samba python-six python-smbus python-talloc python-tdb python-tk
python-urllib3 python2.7 python2.7-dev python2.7-minimal python3 python3-apt
python3-dev python3-minimal readline-common rkhunter rpcbind samba
samba-common samba-common-bin samba-dsdb-modules samba-libs schedtool sed
sensible-utils shared-mime-info sshfs startpar sudo svtplay-dl systemd
sysv-rc sysvinit-utils tar tcpd tdb-tools tk8.6-blt2.5 tzdata u-boot-tools
ucf udev udisks2 ufw unattended-upgrades update-inetd upower usbutils
util-linux wget wireless-tools wpasupplicant xbian-package-vnc-server
xkb-data xz-utils zlib1g
611 upgraded, 140 newly installed, 5 to remove and 2 not upgraded.
Need to get 377 MB of archives.
After this operation, 425 MB of additional disk space will be used.
Do you want to continue? [Y/n]

Nachteule

7th Nov, 2019, 01:45 AM
Aarrrrrrgggggh!

Yes, there is something wrong. xbian-package-xbmc will be removed, and this ist absolutely not correct

You could try to install initramfs-tools manually to see what happens:

Terminal

sudo apt-get install -s initramfs-tools

Skywatch

7th Nov, 2019, 03:04 AM
(7th Nov, 2019 01:45 AM)Nachteule Wrote: [ -> ]You could try to install initramfs-tools manually to see what happens:

No need as I am back on stretch now.

I didn't need to 'upgrade' for any reason, I just wanted to see if @jakenl was having a unique difficulty or if it might affect others too..... and now we know the answer Wink

(7th Nov, 2019 01:45 AM)Nachteule Wrote: [ -> ]You could try to install initramfs-tools manually to see what happens:

xbian-package-xbmc will still be removed Tongue

Nachteule

7th Nov, 2019, 05:14 AM
(7th Nov, 2019 03:04 AM)Skywatch Wrote: [ -> ]
(7th Nov, 2019 01:45 AM)Nachteule Wrote: [ -> ]You could try to install initramfs-tools manually to see what happens:

No need as I am back on stretch now.

I didn't need to 'upgrade' for any reason, I just wanted to see if @jakenl was having a unique difficulty or if it might affect others too..... and now we know the answer Wink

(7th Nov, 2019 01:45 AM)Nachteule Wrote: [ -> ]You could try to install initramfs-tools manually to see what happens:

xbian-package-xbmc will still be removed Tongue

No idea what broken installation you guys have Dodgy
There must be packages installed which breaks the clean upgrade process, I suppose those package(s) require libpam-systemd and/or plymouth and/or systemd

For a final test, I installed latest Stretch based image on a external USB disk, run update to get latest Stretch and XBian packages, rebooted and then ran distribution upgrade - all done inside of Kodi/XBian-GUI with disabled staging and devel repo.

Everythingl went fine, after 25min I got clean Buster installation. Tataaaah Big Grin

Here the beginning of the upgrade log: https://pastebin.com/ve7Wn684

Skywatch

7th Nov, 2019, 06:32 AM
(7th Nov, 2019 05:14 AM)Nachteule Wrote: [ -> ]...... with disabled staging and devel repo.

Hmmmm.....I have staging enabled. Would that cause the problemI wonder? Huh

......Answer, No! Sad

Nachteule

7th Nov, 2019, 07:34 AM
(7th Nov, 2019 06:32 AM)Skywatch Wrote: [ -> ]
(7th Nov, 2019 05:14 AM)Nachteule Wrote: [ -> ]...... with disabled staging and devel repo.

Hmmmm.....I have staging enabled. Would that cause the problemI wonder? Huh

......Answer, No! Sad

No, actually AFAIR only kernel package is in staging, nothing else

You could sent me a list of your installed packages, so I can install them to see if I have a chance to see what's going on

Terminal

sudo dpkg -l | awk '/^ii/{print $2}'

jakenl

7th Nov, 2019, 09:21 AM
(7th Nov, 2019 07:34 AM)Nachteule Wrote: [ -> ]You could sent me a list of your installed packages, so I can install them to see if I have a chance to see what's going on

Terminal

sudo dpkg -l | awk '/^ii/{print $2}'
I ran the command and I came across this:

systemd
systemd-shim

This is not OK to have I believe ,after reading this and the other active topic about Buster upgrade?
How can I select all pacakages? While scrolling up, I only see packages starting with letter 'z' up to 'l', I guess just xx lines and not unlimited
Pages: 1 2 3 4 5
Forum > Software > Installation > Distribution upgrade to Buster fails
Reference URL's