00:14 | shored1 has joined IRC (shored1!~shored@user/shored) | |
00:14 | shored has left IRC (shored!~shored@user/shored, Ping timeout: 248 seconds) | |
00:17 | shored has joined IRC (shored!~shored@user/shored) | |
00:19 | shored1 has left IRC (shored1!~shored@user/shored, Ping timeout: 272 seconds) | |
01:59 | vagrantc has left IRC (vagrantc!~vagrant@2600:3c01:e000:21:7:77:0:20, Quit: leaving) | |
05:44 | ricotz has joined IRC (ricotz!~ricotz@ubuntu/member/ricotz) | |
05:55 | Vercas5 has joined IRC (Vercas5!~Vercas@gateway/tor-sasl/vercas) | |
05:57 | Vercas has left IRC (Vercas!~Vercas@gateway/tor-sasl/vercas, Ping timeout: 240 seconds) | |
05:57 | Vercas5 is now known as Vercas | |
06:57 | Vercas0 has joined IRC (Vercas0!~Vercas@gateway/tor-sasl/vercas) | |
06:59 | Vercas has left IRC (Vercas!~Vercas@gateway/tor-sasl/vercas, Ping timeout: 240 seconds) | |
06:59 | Vercas0 is now known as Vercas | |
07:30 | eu^static-178248 has joined IRC (eu^static-178248!~eu^static@182.75.223.102) | |
07:30 | <eu^static-178248> Hi Alkis, Jeremy here, hope you are doing well
| |
07:31 | <alkisg> Hello eu^static-178248
| |
07:31 | (you can type /nick jeremy1234 to have a more readable nickname :D)
| |
07:31 | <eu^static-178248> ohh yes
| |
07:32 | eu^static-178248 is now known as jeremy_walker | |
07:32 | <jeremy_walker> I have a question regarding chrootless setup.
| |
07:33 | <alkisg> Shoot
| |
07:33 | <jeremy_walker> When using a chrootless setup with a PXE boot configuration, what should be the line for the root= parameter?
| |
07:33 | I am referring to our conversation awhile ago, https://github.com/ltsp/ltsp/issues/141
| |
07:34 | <alkisg> It's always root=/dev/nfs
| |
07:34 | <jeremy_walker> As a background, we have been using the LTSP chroot setup with the Odroid C2s very successfully for the last couple of years. We recently upgraded the machines to the newer and more powerful Odroid N2s. The N2s support Petitboot, so no need for a local eMMC/SD card to load the initial kernel, it can be downloaded from the network and booted.
| |
07:35 | * alkisg hasn't yet found any time to try to netboot his odroid c2 :) | |
07:37 | <jeremy_walker> my boot line looks like, does this look correct?
| |
07:38 | APPEND console=tty1 console=ttyS0,115200n8 no_console_suspend ip=dhcp rw root=/dev/nfs nfsroot=x.x.x.x:/srv/ltsp init=/usr/share/ltsp/client/init/init ltsp.image=images/aarch64.img rootwait fsck.repair=yes net.ifnames=0 elevator=noop hdmimode=1080p60hz cvbsmode=576cvbs max_freq_a53=1908 max_freq_a73=2208 maxcpus=6 voutmode=hdmi disablehpd=false
| |
07:38 | overscan=100 monitor_onoff=false logo=osd0,loaded sdrmode=auto consoleblank=0 enable_wol=1 showlogo
| |
07:38 | <alkisg> I don't know about the odroid-specific parts, but the ltsp-specific ones seem fine
| |
07:39 | <jeremy_walker> ok yeah the odroid-specific parts can be ignored, they are not even necessary for a regular boot, just additional cusotmizations
| |
07:39 | I prepared the image using the following command:
| |
07:39 | ltsp image /,,/boot,subdir=boot
| |
07:40 | but I am getting the following error on boot:
| |
07:40 | Begin: Running /scripts/nfs-bottom ... done.
| |
07:40 | Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev failed: No such file or directory
| |
07:40 | mount: mounting /dev on /root/dev failed: No such file or directory
| |
07:40 | done.
| |
07:40 | mount: mounting /run on /root/run failed: No such file or directory
| |
07:40 | run-init: can't execute '/usr/share/ltsp/client/init/init': No such file or directory
| |
07:40 | Target filesystem doesn't have requested /usr/share/ltsp/client/init/init.
| |
07:40 | run-init: can't execute '/sbin/init': No such file or directory
| |
07:40 | run-init: can't execute '/etc/init': No such file or directory
| |
07:40 | run-init: can't execute '/bin/init': No such file or directory
| |
07:40 | run-init: can't execute '/bin/sh': No such file or directory
| |
07:40 | run-init: can't execute '': No such file or directory
| |
07:40 | No init found. Try passing init= bootarg.
| |
07:42 | As a test I exported /, and changed the nfsroot to x.x.x.x:/ and everything works great. Obviously, that is not a desired setup, but it confirms that the rest of the system is properly configured. I just can't figure out how to get the client to boot using just the images/aarch64.img without the / filesystem exported via NFS
| |
07:58 | <alkisg> jeremy_walker: Are you using an initramfs?
| |
07:58 | <jeremy_walker> I believe so
| |
07:59 | <alkisg> Try passing break=mount in the kernel command line
| |
07:59 | If you do get a shell, then that part is OK. If not, you have the following issue:
| |
08:00 | For example in Raspberry Pi OS, no initramfs is used. This means that when the kernel tries to process nfsroot=x.x.x.x:/srv/ltsp, it can't find an init there; the init is inside the compressed squashfs file,
| |
08:01 | so as a solution, we use a /srv/ltsp/raspios chroot as the root directory; the kernel loads init from there; then our ltsp init is clever enough to mount the squashfs image and chain the execution there, so the chroot is only used for just a millisecond in the boot process
| |
08:01 | Do the break=mount test first, and we'll see what to do next, when you have the result of that
| |
08:02 | <jeremy_walker> drops into an initramfs shell
| |
08:02 | <alkisg> At that point, what is the output of `ls /root` ?
| |
08:02 | Scratch that,
| |
08:02 | replace break=mount with break=bottom, which is after the mounting part. Reboot, get to the shell.
| |
08:02 | At that point, run: ls /root
| |
08:03 | See if it properly mounted your /srv/ltsp directory, and if you can see images/aarch64.img
| |
08:04 | <jeremy_walker> (initramfs) ls -l /root/images/aarch64.img
| |
08:04 | -rw-r--r-- 1 1335631872 /root/images/aarch64.img
| |
08:06 | <alkisg> Press Ctrl+D to exit, then upload a photo of all the errors
| |
08:07 | > Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev failed: No such file or directory
| |
08:07 | If that's the first one... something is very wrong, why would dev not exist at that point?
| |
08:07 | Btw are you using the ltsp version from the ppa, or some older one from distributions?
| |
08:07 | <jeremy_walker> proposed
| |
08:08 | <alkisg> OK, upload a photo
| |
08:08 | <jeremy_walker> (initramfs) Begin: Running /scripts/init-bottom ... mount: mounting /dev on /root/dev failed: No such file or directory
| |
08:08 | mount: mounting /dev on /root/dev failed: No such file or directory
| |
08:08 | done.
| |
08:08 | mount: mounting /run on /root/run failed: No such file or directory
| |
08:08 | run-init: can't execute '/usr/share/ltsp/client/init/init': No such file or directory
| |
08:08 | Target filesystem doesn't have requested /usr/share/ltsp/client/init/init.
| |
08:08 | run-init: can't execute '/sbin/init': No such file or directory
| |
08:08 | run-init: can't execute '/etc/init': No such file or directory
| |
08:08 | run-init: can't execute '/bin/init': No such file or directory
| |
08:08 | run-init: can't execute '/bin/sh': No such file or directory
| |
08:08 | run-init: can't execute '': No such file or directory
| |
08:08 | No init found. Try passing init= bootarg.
| |
08:08 | BusyBox v1.30.1 (Ubuntu 1:1.30.1-4ubuntu6.4) built-in shell (ash)
| |
08:08 | Enter 'help' for a list of built-in commands.
| |
08:08 | (initramfs)
| |
08:08 | <alkisg> And what's above these?
| |
08:09 | <jeremy_walker> Internet Systems Consortium DHCP Client 4.4.1
| |
08:09 | Copyright 2004-2018 Internet Systems Consortium.
| |
08:09 | All rights reserved.
| |
08:09 | For info, please visit https://www.isc.org/software/dhcp/
| |
08:09 | Listening on LPF/eth0/00:1e:06:43:18:68
| |
08:09 | Sending on LPF/eth0/00:1e:06:43:18:68
| |
08:09 | Sending on Socket/fallback
| |
08:09 | DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 3 (xid=0x39fd464d)
| |
08:09 | DHCPOFFER of 192.168.166.87 from 192.168.166.254
| |
08:09 | DHCPREQUEST for 192.168.166.87 on eth0 to 255.255.255.255 port 67 (xid=0x4d46fd39)
| |
08:09 | DHCPACK of 192.168.166.87 from 192.168.166.254 (xid=0x39fd464d)
| |
08:09 | ip: RTNETLINK answers: File exists
| |
08:09 | bound to 192.168.166.87 -- renewal in 2817 seconds.
| |
08:09 | [ 12.153157@0] FS-Cache: Loaded
| |
08:09 | [ 12.173846@2] RPC: Registered named UNIX socket transport module.
| |
08:09 | [ 12.176326@2] RPC: Registered udp transport module.
| |
08:09 | [ 12.180989@2] RPC: Registered tcp transport module.
| |
08:09 | [ 12.185820@2] RPC: Registered tcp NFSv4.1 backchannel transport module.
| |
08:10 | oops, I forgot to mask the IPs... oh well!
| |
08:10 | <alkisg> Eh, they're internal IPs, not a security issue
| |
08:10 | <jeremy_walker> true
| |
08:10 | and before the previous dump
| |
08:10 | Loading, please wait...
| |
08:10 | Starting version 245.4-4ubuntu3.15
| |
08:10 | Begin: Loading essential drivers ... done.
| |
08:10 | Begin: Running /scripts/init-premount ... done.
| |
08:10 | Begin: Mounting root file system ... Begin: Running /scripts/nfs-top ... done.
| |
08:10 | Begin: Running /scripts/nfs-premount ... done.
| |
08:12 | rebooted without the break=bottom directive, repasting output for readability:
| |
08:12 | Loading, please wait...
| |
08:12 | Starting version 245.4-4ubuntu3.15
| |
08:12 | Begin: Loading essential drivers ... done.
| |
08:12 | Begin: Running /scripts/init-premount ... done.
| |
08:12 | Begin: Mounting root file system ... Begin: Running /scripts/nfs-top ... done.
| |
08:12 | Begin: Running /scripts/nfs-premount ... done.
| |
08:12 | Internet Systems Consortium DHCP Client 4.4.1
| |
08:12 | Copyright 2004-2018 Internet Systems Consortium.
| |
08:12 | All rights reserved.
| |
08:12 | For info, please visit https://www.isc.org/software/dhcp/
| |
08:12 | Listening on LPF/eth0/00:1e:06:43:18:68
| |
08:12 | Sending on LPF/eth0/00:1e:06:43:18:68
| |
08:12 | Sending on Socket/fallback
| |
08:12 | DHCPDISCOVER on eth0 to 255.255.255.255 port 67 interval 3 (xid=0x5e47ee5f)
| |
08:12 | DHCPOFFER of 192.168.166.87 from 192.168.166.254
| |
08:12 | DHCPREQUEST for 192.168.166.87 on eth0 to 255.255.255.255 port 67 (xid=0x5fee475e)
| |
08:12 | DHCPACK of 192.168.166.87 from 192.168.166.254 (xid=0x5e47ee5f)
| |
08:12 | ip: RTNETLINK answers: File exists
| |
08:13 | Enter 'help' for a list of built-in commands.
| |
08:13 | [ 12.383274@1] meson_uart ff803000.serial: ttyS0 use xtal(24M) 24000000 change 115200 to 115200
| |
08:13 | (initramfs)
| |
08:14 | additional information, what I've done so far:
| |
08:14 | what I've done so far,
| |
08:14 | $ cp /boot/Image.gz /boot/vmlinuz
| |
08:14 | $ lz4 -d /boot/initrd.img-4.9.277-122 /boot/initrd.img
| |
08:14 | $ ltsp image /,,/boot,subdir=boot
| |
08:14 | <alkisg> Try to put all the boot info in a pastebin, it's not readable directly on irc
| |
08:14 | <jeremy_walker> $ ltsp initrd
| |
08:14 | $ ltsp nfs
| |
08:14 | pxelinux.cfg/default looks like this
| |
08:14 | DEFAULT Ubuntu Focal
| |
08:14 | LABEL Ubuntu Focal
| |
08:14 | KERNEL /odroid/Image.gz
| |
08:14 | INITRD /odroid/initrd.img.gz
| |
08:14 | FDT /odroid/meson64_odroidn2_plus.dtb
| |
08:14 | APPEND ip=dhcp rw boot=nfs root=/dev/nfs nfsroot=x.x.x.x:/srv/ltsp break=bottom init=/usr/share/ltsp/client/init/init ltsp.image=images/aarch64.img rootwait
| |
08:15 | ok, couple minutes please
| |
08:22 | <alkisg> To be honest though, if what you're reporting so far is accurate, there's something wrong with the /dev directory not being available on boot; that would take e.g. an hour of troubleshooting, which I don't have currently... :/
| |
08:24 | <jeremy_walker> https://pastebin.com/eGVGCQTn
| |
08:25 | I understand, would you by any chance have some time later?
| |
08:27 | <alkisg> For free support, I might have some time in the summer :D (too many thing on hold currently!) For paid support, I might be able to squeeze up to 2 hours sometime in the following days...
| |
08:28 | <jeremy_walker> I don't mind paying, you have been enormously helpful already so I don't want to exploit your kindness
| |
08:29 | <alkisg> Ah got it, ltsp is missing from your initramfs
| |
08:29 | You can either try to add INITRD /odroid/ltsp.img right after KERNEL, or you can try `update-initramfs -u` to see if that puts ltsp inside the initramfs
| |
08:30 | Not sure if odroid's pxelinux emulation can read two initrds
| |
08:31 | Ah or you could merge them, try that one first:
| |
08:31 | cat file1 file2 > file3 merges two files
| |
08:31 | We want to merge /srv/tftp/ltsp/ltsp.img first, and initrd.img.gz second, and put the result in /serv/tftp/odroid/initrd.img.gz
| |
08:32 | So, just run these commands without doing anything else:
| |
08:32 | sudo mv /srv/tftp/odroid/initrd.img.gz /serv/tftp/odroid/initrd.img.gz.original
| |
08:32 | sudo -i; cat /srv/tftp/ltsp/ltsp.img /serv/tftp/odroid/initrd.img.gz.original > /srv/tftp/odroid/initrd.img.gz
| |
08:32 | Then reboot the client
| |
08:35 | <jeremy_walker> bingo!
| |
08:35 | that fixed it
| |
08:36 | wow, thank you so much
| |
08:36 | <alkisg> Yey!
| |
08:36 | You may also try to google "pxelinux two initrds" and use the appropriate syntax so that you don't have to use "cat >" at all
| |
08:36 | <jeremy_walker> ok
| |
08:36 | <alkisg> ltsp.img goes first, initrd.img.gz goes second, in that order
| |
08:38 | <jeremy_walker> I did try passing the two initrds as 2 separate lines, the client downloads both files, but then threw some error, but I didn't read the error properly
| |
08:38 | I will look into the multiple initrds in pxelinux
| |
08:38 | Thank you again
| |
08:42 | <alkisg> It might need a comma syntax, initrd one,two
| |
11:09 | jeremy_walker has left IRC (jeremy_walker!~eu^static@182.75.223.102, Quit: Client closed) | |
11:45 | Faith has joined IRC (Faith!~Faith@user/faith) | |
12:50 | lucascastro has joined IRC (lucascastro!~lucascast@192-140-51-210.static.oncabo.net.br) | |
14:37 | manolo66 has joined IRC (manolo66!~manolo66@lmontsouris-659-1-30-59.w81-250.abo.wanadoo.fr) | |
14:57 | vagrantc has joined IRC (vagrantc!~vagrant@2600:3c01:e000:21:7:77:0:20) | |
15:20 | ltspbot has joined IRC (ltspbot!~supybot@devs.ts.sch.gr) | |
15:38 | manolo66 has left IRC (manolo66!~manolo66@lmontsouris-659-1-30-59.w81-250.abo.wanadoo.fr, Quit: Client closed) | |
16:33 | Fuzai has joined IRC (Fuzai!~quassel@50.54.159.160) | |
16:35 | <Fuzai> Hello, is there a specific reason that the ltsp servers /etc/hosts file generation script for the clients has a hard entry for the ip address of the server and a hostname of "server" instead of the actual ltsp servers hostname?
| |
16:36 | I tripped over this today and it caught me off guard that when I was updating the servers /etc/hosts that the client wasn't being updated to reflect after I gereated a chrootless image
| |
16:38 | <vagrantc> it simplifies some of the defaults for the code
| |
16:38 | <Fuzai> Ok, so there is something else in the scripts relying on that staying as server. Thank you
| |
16:39 | <vagrantc> i mean, it might be possible to change ... but ... it's been that way since before the complete rewrite of ltsp
| |
16:39 | (maybe even before two complete rewrites)
| |
16:39 | <Fuzai> Also thank you for LTSP, I've been using it on and off for well over a decade now in some form or another
| |
16:40 | This current iteration was pretty painless to install over Proxmox
| |
16:40 | <vagrantc> yeah, alkisg did a great job with the current code
| |
16:40 | took out a lot of the mistakes i made with ltsp5 :)
| |
16:40 | <Fuzai> It wasn't that bad
| |
16:40 | <3
| |
16:40 | <vagrantc> no, but there were some ugly bits :)
| |
16:43 | <Fuzai> I mean the whole mixed client combo where you could run some apps from the server was and has been inspiratoinal to the point that the day I figure out how to unlock many thunderbolt cards for passthru to a server, that I'll probably finally write the distro i've been planning since ltsp 5 days
| |
16:45 | <vagrantc> that's less of a thing no, through no fault of LTSP ... support for network transparent X is more-or-less bitrotting
| |
16:45 | less of a thing *now*
| |
16:49 | <Fuzai> Oh yea, but thunderbolt is a thing, and pci passthru to a vm is a thing. The idea that you could take a basical egpu type box with a usb controller and pass that into a vm
| |
16:49 | then use a phone like a remote control and switch your approved vms onto your logged in terminal
| |
16:50 | The idea is the vms could roam with you depending on the acls by using a phone like a remote control and login/logout tool
| |
16:51 | <vagrantc> yeah, roaming profilse are interesting
| |
16:51 | <Fuzai> The concept gets really interesting when you start talking about bitfurification and pcie switches :)
| |
16:51 | <vagrantc> i remember seeing that when i experimented with xrdp
| |
16:51 | <Fuzai> Yea, I grew up as a child of AS/400's and saw what Sun did in the 90's for roaming profiles
| |
16:51 | <vagrantc> log out from on client, move over to another, log in right back where you left it
| |
16:52 | <Fuzai> I think they called them Sunrays back then
| |
16:52 | <vagrantc> yeah
| |
16:52 | <Fuzai> Well even better, you could just pause it and restore with the pcie map changed
| |
16:52 | It also makes it super easy to add memory or resorces on demand
| |
16:52 | resources
| |
16:52 | <vagrantc> sounds like a fun project :)
| |
16:53 | <Fuzai> Someday :) I have a friend that just got done learning ASIC stuff that i'm about ask about making me a board. I tried with the maple ridge controllers and I haven't been able to get it to go. Sadly I just have too many other cool things going on before that one gets time.
| |
16:54 | But I feel that if I can get 16 thunderbolt controllers working independly for passthru on one pcie16x that i might have something here
| |
16:55 | Anywho, I gotta get back to work, you have a great day!
| |
16:56 | <vagrantc> likewise!
| |
16:58 | lucascastro has left IRC (lucascastro!~lucascast@192-140-51-210.static.oncabo.net.br, Ping timeout: 248 seconds) | |
17:25 | lucascastro has joined IRC (lucascastro!~lucascast@177-185-131-162.corp.isotelco.net.br) | |
17:26 | Fuzai has left IRC (Fuzai!~quassel@50.54.159.160, Ping timeout: 246 seconds) | |
17:28 | Fuzai has joined IRC (Fuzai!~quassel@50.54.159.160) | |
19:39 | ricotz has left IRC (ricotz!~ricotz@ubuntu/member/ricotz, Quit: Leaving) | |
19:58 | Fuzai has left IRC (Fuzai!~quassel@50.54.159.160, Ping timeout: 240 seconds) | |
20:18 | lucascastro has left IRC (lucascastro!~lucascast@177-185-131-162.corp.isotelco.net.br, Ping timeout: 256 seconds) | |
20:25 | Fuzai has joined IRC (Fuzai!~quassel@50.54.159.160) | |
20:25 | Fuzai has left IRC (Fuzai!~quassel@50.54.159.160, Client Quit) | |
20:48 | vagrantc has left IRC (vagrantc!~vagrant@2600:3c01:e000:21:7:77:0:20, Quit: leaving) | |
20:49 | Faith has left IRC (Faith!~Faith@user/faith, Quit: Leaving) | |
21:39 | lucascastro has joined IRC (lucascastro!~lucascast@192-140-51-210.static.oncabo.net.br) | |
21:42 | bcg has left IRC (bcg!~b@dg4ybwyyyyyyyyyyyyyyt-3.rev.dnainternet.fi, Ping timeout: 250 seconds) | |
21:43 | bcg has joined IRC (bcg!~b@213-216-205-19.co.dnainternet.fi) | |