== Setup a new kvm domain fast == === guest setup === or: how to install Debian. Define a shell function {{{ # set up environment setup_env() { echo -n "New hostname: " && export LC_ALL=C && read guest && target=/mnt/target && mirror=`cat /etc/apt/sources.list /etc/apt/sources.list.d/debian.list 2>/dev/null | awk '/^deb.*debian/ {print $2; exit}'` && vg=`vgdisplay -c | awk -F: '{print $1;exit}' | sed 's/ *//g'` && echo "Chosen vg is $vg" && echo -n "Use lvm for non-swap partitions? [Y/n] " && read use_lvm && if [ "$use_lvm" = "n" ]; then : SAN, as in the msa2012i at ubcece && : requires that it is already setup && dev_root="/dev/mapper/$guest-root" && dev_boot="/dev/mapper/$guest-boot" && echo "Root device will be $dev_root" && echo "Boot device will be $dev_boot" && echo "Make sure they exist already." && fs=xfs else use_lvm="y" && dev_root="/dev/mapper/$vg-$guest--root" && dev_boot="/dev/mapper/$vg-$guest--boot" && echo "Root device will be $dev_root" && echo "Boot device will be $dev_boot" && fs=ext3 fi && dev_swap="/dev/mapper/$vg-$guest--swap" && echo "Swap device will be $dev_swap" && echo "fs is $fs" echo "Chosen mirror is $mirror" } }}} And run it {{{ setup_env }}} Then install base: The way we lay out the filesystems by default is that we have one 4g / filesystem, a swap, and a tiny boot filesystem. On the host we make a new LVM logical volume for each of the three. Only the LV that will take the guest's boot will actually be partitioned - into a single boot partition. That's so we can install grub into the MBR and have the system start just like a real system. Root and swap are put directly onto the logical volume, without partitioning it at all. This makes getting to the data from the host easier - no need to run kpartx - and it makes growing trivial. {{{ ####### # install base apt-get install debootstrap kpartx && if [ "$use_lvm" = "y" ]; then lvcreate -L 128m -n "$guest"-boot /dev/"$vg" && lvcreate -L 4g -n "$guest"-root /dev/"$vg" && fi && lvcreate -L 4g -n "$guest"-swap /dev/"$vg" : && ( echo ',,L,*' | sfdisk "$dev_boot" ) && kpartx -v -a "$dev_boot" && mkfs."$fs" "$dev_boot"1 && mkfs."$fs" "$dev_root" && mkswap "$dev_swap" && : && mkdir -p "$target" && mount "$dev_root" "$target" && mkdir -p "$target/boot" && mount "$dev_boot"1 "$target/boot" && cd "$target" && debootstrap --variant=minbase lenny . "$mirror" }}} And finalize the setup: {{{ ####### # finish setup echo "$guest" > etc/hostname && cat > etc/hosts << EOF && 127.0.0.1 localhost # The following lines are desirable for IPv6 capable hosts ::1 localhost ip6-localhost ip6-loopback fe00::0 ip6-localnet ff00::0 ip6-mcastprefix ff02::1 ip6-allnodes ff02::2 ip6-allrouters ff02::3 ip6-allhosts EOF rm -fv etc/apt/sources.list && ( ! [ -e /etc/apt/sources.list ] || cp /etc/apt/sources.list etc/apt/sources.list) (cp -v /etc/apt/sources.list.d/* etc/apt/sources.list.d/ || true ) && cp -v /etc/apt/preferences etc/apt/ && apt-key exportall | chroot . apt-key add - && chroot . apt-get update && echo "Apt::Install-Recommends 0;" > etc/apt/apt.conf.d/local-recommends && chroot . apt-get install net-tools iproute ifupdown dialog vim netbase xfsprogs && #chroot . apt-get remove --purge cpp dpkg-dev g++ gcc gcc-4.2-base libatm1 libdevmapper1.02.1 libgpm2 libc6-dev linux-libc-dev libstdc++6-4.3-dev binutils cpp-4.3 gcc-4.3 gettext-base libgmp3c2 libgomp1 libmpfr1ldbl libtimedate-perl # don't - it may start daemons #chroot . apt-get dist-upgrade chroot . apt-get install grub && cp -av usr/lib/grub/x86_64-pc boot/grub && grub << EOF && device (hd0) $dev_boot root (hd0,0) setup (hd0) quit EOF # install a kernel image echo -e "do_symlinks = yes\nlink_in_boot = yes\ndo_initrd = yes" > etc/kernel-img.conf && chroot . apt-get install linux-image-2.6-amd64 }}} And a fstab and a boot loader config {{{ # doesn't work: chroot . update-grub rootuuid=`vol_id "$dev_root" "$target" | awk -F= '$1=="ID_FS_UUID" {print $2}'` && swapuuid=`vol_id "$dev_swap" "$target" | awk -F= '$1=="ID_FS_UUID" {print $2}'` && bootuuid=`vol_id "$dev_boot"1 | awk -F= '$1=="ID_FS_UUID" {print $2}'` && cat > boot/grub/menu.lst << EOF && default 0 timeout 5 color cyan/blue white/blue ### BEGIN AUTOMAGIC KERNELS LIST # kopt=root=UUID=$rootuuid ro ## ## End Default Options ## title Debian root (hd0,0) kernel /vmlinuz root=UUID=$rootuuid ro initrd /initrd.img ### END DEBIAN AUTOMAGIC KERNELS LIST EOF if [ "$fs" = "ext3" ]; then rootopts="errors=remount-ro" else rootopts="defaults" fi cat > etc/fstab << EOF && UUID=$rootuuid / $fs $rootopts 0 1 UUID=$bootuuid /boot $fs defaults 0 2 UUID=$swapuuid none swap sw 0 0 EOF cat > etc/network/interfaces << EOF auto lo iface lo inet loopback auto eth0 iface eth0 inet manual pre-up ip link set up dev \$IFACE post-down ip link set down dev \$IFACE EOF }}} Maybe fix/setup networking properly: {{{ vi etc/network/interfaces }}} And unmount: {{{ cd / && umount "$target"/boot && umount "$target" && kpartx -v -d "$dev_boot" && rmdir "$target" }}} === virsh setup === Setup a new kvm domain by creating a new file in /etc/da-virt/`hostname/$guest.xml. * Properly configure hostname * Pick a new uuid ({{{uuidgen}}}) * Setup block devices properly * pick a new and unique mac address (on d.o every kvm host has their own mac address space and the last block is changed for the guests, as in {{{..:..:..:..::}}}. ) * virsh commands: ** {{{virsh help}}} ** {{{virsh define foo.xml}}} ** {{{virsh start foo}}} ** {{{virsh destroy foo}}} ** {{{virsh vncdisplay foo}}} (and ssh -L 5900:localhost:<5900+x> $host and vnc localhost) === post processing === Do not forget to set a sane root password before installing ssh in the new kvm domain. === when stuff goes wrong === To get to the guest data from the host: {{{ setup_env kpartx -v -a "$dev_boot" && mkdir -p "$target" && mount "$dev_root" "$target" && mkdir -p "$target/boot" && mount "$dev_boot"1 "$target/boot" }}} and once you're done: {{{ cd / && umount "$target"/boot && umount "$target" && kpartx -v -d "$dev_boot" && rmdir "$target" }}} Make sure that the filesystem isn't being mounted twice - i.e. never start the guest while the filesystems are mounted, and never mount them while the guest is running.