csml-wiki.northwestern.edu - User contributions [en]

Hardware

2019-09-26T16:23:27Z

Ian: /* Printers */

=== Desktop machines ===

All desktop machines run [http://www.opensuse.org OpenSuSE].
* [[Installation instructions for OpenSuSE 13.1]].
* [[Installation instructions for OpenSuSE Leap 42.1]].
* [[Installation instructions for OpenSuSE Leap 15.0]].
* [[Installation instructions for OpenSuSE Leap 15.1]].

[[Etiquette: Running Nice on other desktop machines]]

=== Clusters ===

==== Minotaur ====
* 38 nodes, each containing two 10-core processors (760 cores total). 16 GB memory per node. Processor type: Intel Xeon E5-2630, 2.2 GHz.
* Jobs are scheduled via [http://www.adaptivecomputing.com/products/open-source/torque/ Torque]/Maui. [[Notes on Torque]].

==== Hydra ====
* 60 nodes, each containing two 6-core processors (720 cores total). 12 GB memory per node. 8 nodes (queue "fast", nodes h001-h008) have Intel Xeon X5690 3.47 GHz processors. 52 nodes (queue "default", nodes h009-h060) have Intel Xeon E5645 2.40 GHz processors.
* Jobs are scheduled via [http://www.adaptivecomputing.com/products/open-source/torque/ Torque]/Maui. [[Notes on Torque]].
* [[General Usage of Hydra]]

==== Quest ====
* Jobs are scheduled via [http://www.adaptivecomputing.com/products/open-source/torque/ Torque]/Moab. [[Notes on Torque]].
* [[General Usage of Quest]]

=== Disk space, backups, and RAID storage ===

==== Disk space allocations and nightly backups ====

Each user has a home directory located on ''ariadne''. This home directory is exported to all desktop machines, so that you see the same home filesystem on each machine. The drive is protected against hardware failure via a [[http://en.wikipedia.org/wiki/RAID_1#RAID_1 RAID-1]] setup. Furthermore, each night all new or modified files on /home are written to tape (located in ariadne). This makes it important not to store temporary data in your home folder, as it would quickly fill up the tape. Since users tend to forget this, a quota system has been enabled on ariadne, restricting each user to 15 GB. To check how much space you are using log on to ariadne and issue the command
<pre>
quota -s
</pre>

In addition, each user has significant additional storage on the scratch partitions. These drives are located in the different desktop machines and protected via RAID-1, but backups are your own responsibility. Note that these partitions are generally only mounted on the desktop machine that contains the corresponding drives. If you need a partition to be exported to a different machine, please ask.

==== Synology diskstation ====

Pergamon is a 18 TB RAID 6 diskstation. [[Synology diskstation|Detailed usage instructions.]]

==== Changing the nightly backup tape ====

# Press eject button on tape drive in ariadne.
# Take the tape cartridge out of the drive and put it in its box (should be on top of ariadne). Label the box. Give to Erik.
# Insert cleaning tape (on top of ariadne). It will work for less than a minute and then eject automatically.
# Put cleaning tape back in box on top of ariadne.
# Insert new DDS tape (find in cabinet). Leave empty box on top of ariadne.
# Erik: Update settings in /usr/local/lib/backup, namely ''position'' and ''tapenumber''; update logfile.

==== Recovering data from the nightly backup tape ====

Log files of all nightly backup tapes are located on ariadne, in /usr/local/lib/backup. For privacy reasons, these logfiles are only accessible to root. Once the proper file to be recovered has been identified, insert the corresponding tape into the drive on ariadne and follow these steps (all to be executed as root):

# <tt>cd /</tt> (if you change to a different directory, the recovered file will be placed relative to this directory)
# <tt>/usr/local/bin/tape-rewind</tt> (or <tt>mtst -f /dev/nst0 rewind</tt>)
# <tt>mtst -f /dev/nst0 fsf <position></tt> (see the contents file in /usr/local/lib/backup for the position number)
# <tt>tar xzvf /dev/nst0 <full_file_name_without_leading_slash></tt> This step won't work unless you omit the leading slash; also note that you can specify multiple files, separated by spaces. The 'z' option is necessary because all nightly backups are compressed. For wildcards, use --wildcards and escape '*' and '?'. For example: <tt>tar -x --wildcards -zvf /dev/nst0 \*datafiles\*</tt>
# <tt>/usr/local/bin/tape-rewoffl</tt> (or <tt>mtst -f /dev/nst0 rewoffl</tt>)

==== Archiving data using the LTO tape drive ====

==== Checking RAID status ====

<ul>

<li>Hydra
<ul>
<li>OS is on software RAID (which spans /dev/sda and /dev/sdb). An overview is obtained via
<pre>cat /proc/mdstat</pre>
Detailed information via
<pre>
mdadm --detail /dev/mdX
</pre>
where X = 1, 5, 6, 7. Also see [[Setting up e-mail notifications for Linux Software RAID]].</li>
<li>/home: 11 TB RAID 6. Check via
<pre>
opera http://127.0.0.1:81
</pre>
If this doesn't work, restart Areca HTTP server via /etc/rc.d/arecaweb script. It is also possible to interrogate the controller from the command line via 'cli64'. Useful commands within cli64 include 'vsf info' (volume set information) and 'disk info'.
</li>
<li>/archive: 80 TB RAID ([http://en.wikipedia.org/wiki/Nested_RAID_levels#RAID_60_.28RAID_6.2B0.29 RAID 60]). Check via
<pre>
opera http://127.0.0.1:82
</pre>
Just as for /home, it is possible to use the 'cli64' command-line interface. However, to switch this to the proper controller, first use 'set curctrl=2'.
</li>
</ul>
</li>

<li>Minotaur RAID-6 controller with 12 drives (incl. one hot spare). Web interface. Log in to the head node and use
<pre>
opera http://172.16.0.101
</pre>
RAID status is visible on the top line of the Raid Set Hierarchy table, under Volume State. For drive stability click any channel and find the SMART Attributes at the bottom of the page. Each has two values, Attribute and Threshold (Threshold is in parentheses). An Attribute value lower than Threshold indicates an unstable drive.
</li>

<li>Ariadne RAID-5 controller with 4 drives. Status can be checked by interrogating the controller:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -AdpAllInfo -aALL | less
</pre>
In the 'Device Present' section, it is reported if any drives are critical or have failed, and what the state of the RAID is. More detailed information can also be found via
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDPDInfo -aAll | less
</pre>
Directly at the beginning (under 'Adapter #0') it should report 'State: Optimal'</li>

To start a volume consistency check:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDCC -Start -LALL -aAll
</pre>
and to monitor the progress of this check:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDCC -ShowProg -LALL -aAll
</pre>
or, for continuous display:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDCC -ProgDsply -LALL -aAll
</pre>

<li>Desktop machines, except pelops Hardware RAID-1. The RAID status is reported upon reboot of a machine. Press Ctrl-C (when prompted) to enter the configuration utility. From within Linux, use (as root):
<pre>
mpt-status -i 0
mpt-status -i 2
</pre>
The second command only applies to machines with a second set of hard drives (achilles, agamemnon, nestor, poseidon) 
To allow regular users to verify the RAID status, the <tt>mpt-status</tt> has been added to <tt>sudo</tt>:
<pre>
sudo mpt-status -i 0
sudo mpt-status -i 2
</pre>
</li>

<li>Pelops: Software RAID (for OS and scratch partitions). See [[#hydra|Hydra]].</li>

==== Identifying a failed drive ====

Even if you know that a specific device (e.g., /dev/sdc) has failed, it is not always obvious which physical drive inside the machine this is. For this purpose, it is helpful to identify all other (still functional) drives from the command line. One way to do this is to read all drive serial numbers. For example, find the serial number of /dev/sda:
<pre>
udevadm info --query=all --name=/dev/sda | fgrep SERIAL
</pre>
Having the serial numbers allows you to connect device names to physical drives.

</ul>

=== Printers ===
There are two black-and-white laser printers (PS1 and PS2) in the lab, both supporting double-sided printing. For network printing, use luijten-ps1.ms.northwestern.edu and luijten-ps2.ms.northwestern.edu, respectively. For OS X, choose "HP JetDirect" as the protocol.
luijten-ps1.ms.northwestern.edu can be printed to from your personal laptop. To add this printer to your laptop go to add-printer > network printer. The address/hostname is luijten-ps1.ms.northwestern.edu. On Mac, choose Airprint > LPD protocol. On Windows, use TCP/IPP protocol. Printer Driver is a Brother-HL-L2300 series. The printer name is luijten-ps1.

=== Scanner ===

=== UPS ===

All our UPS units are manufactured by APC, and supported via apcupsd. Installation & configuration instructions:

<ul>

<li>Make sure sure the <tt>apcupsd</tt> package is installed, see [[Installation instructions for OpenSuSE 13.1]].</li>

<li>Connect UPS unit to USB port of the corresponding machine.</li>

<li>In <tt>/etc/apcupsd/apcupsd.conf</tt> edit these lines:
<pre>
UPSCABLE usb
UPSTYPE usb
</pre>
Also, '''comment out''' the <tt>DEVICE</tt> line.
</li>

<li>From command line, do
<pre>
chkconfig apcupsd on
</pre>
</li>

<li>Start the daemon manually:
<pre>
apcupsd
</pre>

<li>Test it:
<pre>
apcaccess
</pre>
This should produce extensive output regarding the UPS unit. 
(Note: this command also works for regular users; in that case use <tt>/usr/sbin/apcaccess</tt>.)

</li>

</ul>

Installation instructions for OpenSuSE Leap 15.1

2019-07-18T13:33:20Z

Ian:

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
*Expert Partioning:
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing file system (raids) so check carefully.
** OpenSuse 15.1 Uses GPT partitions for larger drives, if drives are over 2TB GPT partitioning must be used. However, GPT partitioning also requires a /boot partition at the beginning of the OS's drive where GRUB2 will be installed. This partition should be 16MiB, vFAT32 format, and mounted as /boot/efi .
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
** Noveau drivers
* Network configuration:
** Choose Wicked service manager
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NFS client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Installation instructions for OpenSuSE Leap 15.1

2019-07-17T21:25:58Z

Ian:

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
*Expert Partioning:
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing file system (raids) so check carefully.
** OpenSuse 15.1 Uses GPT partitions for larger drives, if drives are over 2TB GPT partitioning must be used. However, GPT partitioning also requires a /boot partition at the beginning of the OS's drive where GRUB2 will be installed. This partition should be 16MiB, vFAT32 format, and mounted as /boot/efi .
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
** Noveau drivers
* Network configuration:
** Choose Wicked service manager
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NSF client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Installation instructions for OpenSuSE Leap 15.1

2019-07-17T21:17:24Z

Ian:

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
*Expert Partioning:
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing file system (raids) so check carefully.
** OpenSuse 15.1 Uses GPT partitions for larger drives, if drives are over 2TB GPT partitioning must be used. However, GPT partitioning also requires a /boot partition at the beginning of the OS's drive where GRUB2 will be installed. This partition should be 16MiB, vFAT32 format, and mounted as /boot/efi .
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
** Noveau drivers
* Network configuration:
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NSF client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Installation instructions for OpenSuSE Leap 15.1

2019-07-17T16:58:18Z

Ian:

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
*Expert Partioning:
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing file system (raids) so check carefully.
** OpenSuse 15.1 Uses GPT partitions for larger drives, if drives are over 2TB GPT partitioning must be used. However, GPT partitioning also requires a /boot partition at the beginning of the OS's drive where GRUB2 will be installed. This partition should be 16MiB, vFAT32 format, and mounted as /boot/efi .
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
* Network configuration:
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NSF client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Installation instructions for OpenSuSE Leap 15.1

2019-07-17T16:38:41Z

Ian:

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
*Expert Partioning:
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing file system (raids) so check carefully.
** OpenSuse 15.1 Uses GPT partitions for larger drives, if drives are over 2TB GPT partitioning must be used. However, GPT partitioning also requires a /boot partition at the beginning of the OS's drive where GRUB2 will be installed. This partition should be 16MiB and vFAT32 format.
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
* Network configuration:
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NSF client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Installation instructions for OpenSuSE Leap 15.1

2019-07-16T22:01:19Z

Ian:

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing file system (raids) so check carefully.
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
* Network configuration:
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NSF client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Installation instructions for OpenSuSE Leap 15.1

2019-07-16T21:59:56Z

Ian: Created page with "* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry. * Do not 'upgrade' from an earlier version. Choose '..."

* If the installation program hangs almost right away on a PCI-related message, add the boot option "nomodeset" and retry.
* Do not 'upgrade' from an earlier version. Choose 'new install', but use extreme care not to interfere with existing scratch partitions.
** Select Base System: Desktop with KDE Plasma
** Using old file system use partitioning to recreate file system EXACTLY. OpenSuse may or may not correctly recognize the existing files system and raids so check carefully.
* Select the following additional software categories:
** Console tools
** File server
* Unselect:
** Games
* Network configuration:
** Firewall enabled, SSH open
** Static IP address, subnet mask: 255.255.255.0
** DNS: 129.105.1.1, 129.105.49.1, 8.8.8.8
** Domain search: 'ms.northwestern.edu' and 'northwestern.edu'
** Gateway (under 'routing' tab): 129.105.92.1
* After install, in Software Management add:
** In "RPM groups" tab: gcc-fortran, gcc7-c++
** Via "Search" tab: motif, motif-devel, glibc-devel-static, lsb, ncftp, net-tools-deprecated, nethogs, pico, MozillaThunderbird, libreadline6, apcupsd, apcupsd-cgi, apcupsd-gui, vlc, emacs-auctex, emacs-x11, finger, xmgrace, libappindicator3-1, libgdk_pixbuf-2_0-0-32bit, libgtk-2_0-0-32bit, libxml2-2-32bit, lynx, mmv, readline-devel, xosview, xsane, ypbind
* In YaST, Network Services:
** NIS client: Domain "el"; Server 129.105.92.12; Open Port in Firewall
** NSF client: Mount /home (options: defaults,rw) and /usr/local from ariadne (options: defaults)
** NTP configuration: Start NTP daemon now and on boot; add server 129.105.92.12
* Connect TO the new machine from ariadne, as root. This will add the host key to ~/.ssh/known_hosts. From there, copy it to /etc/ssh/ssh_known_hosts (still on ariadne). Also, between the hostname and the IP address, add the FQDN of the new machine, so that that is also associate with the same host key.
* Then, as root '''on the new machine''', do:
** ln -s /usr/local/etc/profile.local /etc
** ln -s /usr/local/etc/ssh/ssh_known_hosts /etc/ssh
** add the file /usr/local/etc/hosts_list to /etc/hosts
** scp nestor:/etc/motd /etc (and then edit this file to represent the new machine; "nvidia-smi" is a useful program to find the videocard installed)
** texconfig (and set default paper size to 'letter')
** in /etc/ssh/ssh_config set "ForwardX11 yes"
** in /etc/ssh/sshd_config confirm that "X11Forwarding" is set to "yes"
** in /etc/ssh/sshd_config change "#AuthorizedKeysFile" to ".ssh/authorized_keys2"
** scp telemachos:/root/.bashrc ~
** scp telemachos:/etc/hosts.allow /etc
** scp telemachos:/etc/hosts.deny /etc
* Install debugging software packages via YaST:
** In Software Repositories, enable openSUSE-Leap-15.0-Debug and openSUSE-Leap-15.0-Update-Debug.
** Go to Software Management, select glibc-debuginfo [NOTE: Does not seem to be available through these repositories]
* [[Setting up e-mail notifications for Linux Software RAID]].
* YaST -> Software: Online Update.
* Install Chrome:
** <nowiki>wget https://dl.google.com/linux/direct/google-chrome-stable_current_x86_64.rpm</nowiki>
** rpm -ivh google-chrome-stable_current_x86_64.rpm
** ln -s /usr/bin/google-chrome /usr/bin/chrome
* Install ffmpeg:
** Add packman repository (from command line): zypper addrepo -f <nowiki>http://packman.inode.at/suse/openSUSE_Leap_15.0/</nowiki> packman
** Go into Yast - Software Management. Remove "ffmpeg" and install "ffmpeg-3" from Packman repository (this is necessary to encode h.264 videos)
-----

* Add NVIDIA driver (follow the recommend method via "community repository" and the "zypper inr", followed by a reboot):
** http://en.opensuse.org/SDB:NVIDIA_drivers

* YaST -> Hardware -> Printer -> Printer via Network -> Connection Wizard -> TCP/JetDirect; after installation, configure default options via http://localhost:631

Hardware

2019-07-16T17:53:08Z

Ian: /* Desktop machines */

=== Desktop machines ===

All desktop machines run [http://www.opensuse.org OpenSuSE].
* [[Installation instructions for OpenSuSE 13.1]].
* [[Installation instructions for OpenSuSE Leap 42.1]].
* [[Installation instructions for OpenSuSE Leap 15.0]].
* [[Installation instructions for OpenSuSE Leap 15.1]].

[[Etiquette: Running Nice on other desktop machines]]

=== Clusters ===

==== Minotaur ====
* 38 nodes, each containing two 10-core processors (760 cores total). 16 GB memory per node. Processor type: Intel Xeon E5-2630, 2.2 GHz.
* Jobs are scheduled via [http://www.adaptivecomputing.com/products/open-source/torque/ Torque]/Maui. [[Notes on Torque]].

==== Hydra ====
* 60 nodes, each containing two 6-core processors (720 cores total). 12 GB memory per node. 8 nodes (queue "fast", nodes h001-h008) have Intel Xeon X5690 3.47 GHz processors. 52 nodes (queue "default", nodes h009-h060) have Intel Xeon E5645 2.40 GHz processors.
* Jobs are scheduled via [http://www.adaptivecomputing.com/products/open-source/torque/ Torque]/Maui. [[Notes on Torque]].
* [[General Usage of Hydra]]

==== Quest ====
* Jobs are scheduled via [http://www.adaptivecomputing.com/products/open-source/torque/ Torque]/Moab. [[Notes on Torque]].
* [[General Usage of Quest]]

=== Disk space, backups, and RAID storage ===

==== Disk space allocations and nightly backups ====

Each user has a home directory located on ''ariadne''. This home directory is exported to all desktop machines, so that you see the same home filesystem on each machine. The drive is protected against hardware failure via a [[http://en.wikipedia.org/wiki/RAID_1#RAID_1 RAID-1]] setup. Furthermore, each night all new or modified files on /home are written to tape (located in ariadne). This makes it important not to store temporary data in your home folder, as it would quickly fill up the tape. Since users tend to forget this, a quota system has been enabled on ariadne, restricting each user to 15 GB. To check how much space you are using log on to ariadne and issue the command
<pre>
quota -s
</pre>

In addition, each user has significant additional storage on the scratch partitions. These drives are located in the different desktop machines and protected via RAID-1, but backups are your own responsibility. Note that these partitions are generally only mounted on the desktop machine that contains the corresponding drives. If you need a partition to be exported to a different machine, please ask.

==== Synology diskstation ====

Pergamon is a 18 TB RAID 6 diskstation. [[Synology diskstation|Detailed usage instructions.]]

==== Changing the nightly backup tape ====

# Press eject button on tape drive in ariadne.
# Take the tape cartridge out of the drive and put it in its box (should be on top of ariadne). Label the box. Give to Erik.
# Insert cleaning tape (on top of ariadne). It will work for less than a minute and then eject automatically.
# Put cleaning tape back in box on top of ariadne.
# Insert new DDS tape (find in cabinet). Leave empty box on top of ariadne.
# Erik: Update settings in /usr/local/lib/backup, namely ''position'' and ''tapenumber''; update logfile.

==== Recovering data from the nightly backup tape ====

Log files of all nightly backup tapes are located on ariadne, in /usr/local/lib/backup. For privacy reasons, these logfiles are only accessible to root. Once the proper file to be recovered has been identified, insert the corresponding tape into the drive on ariadne and follow these steps (all to be executed as root):

# <tt>cd /</tt> (if you change to a different directory, the recovered file will be placed relative to this directory)
# <tt>/usr/local/bin/tape-rewind</tt> (or <tt>mtst -f /dev/nst0 rewind</tt>)
# <tt>mtst -f /dev/nst0 fsf <position></tt> (see the contents file in /usr/local/lib/backup for the position number)
# <tt>tar xzvf /dev/nst0 <full_file_name_without_leading_slash></tt> This step won't work unless you omit the leading slash; also note that you can specify multiple files, separated by spaces. The 'z' option is necessary because all nightly backups are compressed. For wildcards, use --wildcards and escape '*' and '?'. For example: <tt>tar -x --wildcards -zvf /dev/nst0 \*datafiles\*</tt>
# <tt>/usr/local/bin/tape-rewoffl</tt> (or <tt>mtst -f /dev/nst0 rewoffl</tt>)

==== Archiving data using the LTO tape drive ====

==== Checking RAID status ====

<ul>

<li>Hydra
<ul>
<li>OS is on software RAID (which spans /dev/sda and /dev/sdb). An overview is obtained via
<pre>cat /proc/mdstat</pre>
Detailed information via
<pre>
mdadm --detail /dev/mdX
</pre>
where X = 1, 5, 6, 7. Also see [[Setting up e-mail notifications for Linux Software RAID]].</li>
<li>/home: 11 TB RAID 6. Check via
<pre>
opera http://127.0.0.1:81
</pre>
If this doesn't work, restart Areca HTTP server via /etc/rc.d/arecaweb script. It is also possible to interrogate the controller from the command line via 'cli64'. Useful commands within cli64 include 'vsf info' (volume set information) and 'disk info'.
</li>
<li>/archive: 80 TB RAID ([http://en.wikipedia.org/wiki/Nested_RAID_levels#RAID_60_.28RAID_6.2B0.29 RAID 60]). Check via
<pre>
opera http://127.0.0.1:82
</pre>
Just as for /home, it is possible to use the 'cli64' command-line interface. However, to switch this to the proper controller, first use 'set curctrl=2'.
</li>
</ul>
</li>

<li>Minotaur RAID-6 controller with 12 drives (incl. one hot spare). Web interface. Log in to the head node and use
<pre>
opera http://172.16.0.101
</pre>
RAID status is visible on the top line of the Raid Set Hierarchy table, under Volume State. For drive stability click any channel and find the SMART Attributes at the bottom of the page. Each has two values, Attribute and Threshold (Threshold is in parentheses). An Attribute value lower than Threshold indicates an unstable drive.
</li>

<li>Ariadne RAID-5 controller with 4 drives. Status can be checked by interrogating the controller:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -AdpAllInfo -aALL | less
</pre>
In the 'Device Present' section, it is reported if any drives are critical or have failed, and what the state of the RAID is. More detailed information can also be found via
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDPDInfo -aAll | less
</pre>
Directly at the beginning (under 'Adapter #0') it should report 'State: Optimal'</li>

To start a volume consistency check:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDCC -Start -LALL -aAll
</pre>
and to monitor the progress of this check:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDCC -ShowProg -LALL -aAll
</pre>
or, for continuous display:
<pre>
/opt/MegaRAID/MegaCli/MegaCli64 -LDCC -ProgDsply -LALL -aAll
</pre>

<li>Desktop machines, except pelops Hardware RAID-1. The RAID status is reported upon reboot of a machine. Press Ctrl-C (when prompted) to enter the configuration utility. From within Linux, use (as root):
<pre>
mpt-status -i 0
mpt-status -i 2
</pre>
The second command only applies to machines with a second set of hard drives (achilles, agamemnon, nestor, poseidon) 
To allow regular users to verify the RAID status, the <tt>mpt-status</tt> has been added to <tt>sudo</tt>:
<pre>
sudo mpt-status -i 0
sudo mpt-status -i 2
</pre>
</li>

<li>Pelops: Software RAID (for OS and scratch partitions). See [[#hydra|Hydra]].</li>

==== Identifying a failed drive ====

Even if you know that a specific device (e.g., /dev/sdc) has failed, it is not always obvious which physical drive inside the machine this is. For this purpose, it is helpful to identify all other (still functional) drives from the command line. One way to do this is to read all drive serial numbers. For example, find the serial number of /dev/sda:
<pre>
udevadm info --query=all --name=/dev/sda | fgrep SERIAL
</pre>
Having the serial numbers allows you to connect device names to physical drives.

</ul>

=== Printers ===
There are two black-and-white laser printers (PS1 and PS2) in the lab, both supporting double-sided printing. For network printing, use luijten-ps1.ms.northwestern.edu and luijten-ps2.ms.northwestern.edu, respectively. For OS X, choose "HP JetDirect" as the protocol.

=== Scanner ===

=== UPS ===

All our UPS units are manufactured by APC, and supported via apcupsd. Installation & configuration instructions:

<ul>

<li>Make sure sure the <tt>apcupsd</tt> package is installed, see [[Installation instructions for OpenSuSE 13.1]].</li>

<li>Connect UPS unit to USB port of the corresponding machine.</li>

<li>In <tt>/etc/apcupsd/apcupsd.conf</tt> edit these lines:
<pre>
UPSCABLE usb
UPSTYPE usb
</pre>
Also, '''comment out''' the <tt>DEVICE</tt> line.
</li>

<li>From command line, do
<pre>
chkconfig apcupsd on
</pre>
</li>

<li>Start the daemon manually:
<pre>
apcupsd
</pre>

<li>Test it:
<pre>
apcaccess
</pre>
This should produce extensive output regarding the UPS unit. 
(Note: this command also works for regular users; in that case use <tt>/usr/sbin/apcaccess</tt>.)

</li>

</ul>

Clonezilla

2019-05-10T22:08:53Z

Ian:

Clonezilla is the disk copying tool used to replicate the drives across slave nodes. See [https://clonezilla.org/clonezilla-live-doc.php Clonezilla Step-by-Step guides] for a how-to guide on disk-to-disk cloning. Inside Minotaur's server rack is an external HDD and a USB. Clonezilla is on the USB, and a copy from a slave node is on the HDD. Reboot a working (and up to date) node with the Clonezilla USB and copy its drive (sda#) to the external HDD (sdb#). The External HDD is much larger than the slave node therefore select Expert-cloning method and under advanced options select "use the partition from the image." Then boot the failed node using Clonezilla and perform the reverse operation, copying the external HDD (sdb#) to the internal drive (sda#). Copying may take a while, up to 2Hrs. Because the target drive is now smaller than the source drive, select the expert method and highlight the option "[*] -icds Skip checking destination partition size before creating partition table." Make sure "use the partition table from the image" is also selected.

Now two nodes are exact copies of each other. This is of course not acceptable. Using root privilege the repaired node then needs to be relabeled.

Clonezilla

2019-05-10T21:54:56Z

Ian: Created page with "Clonezilla is the disk copying tool used to replicate the drives across slave nodes. See [https://clonezilla.org/clonezilla-live-doc.php Clonezilla Step-by-Step guides] for a ..."

Tools

2019-05-10T21:25:08Z

Ian: /* Miscellaneous */

=== Data analysis tools ===

Computer simulations involve the use of a set of analysis tools. Here, we share notes and ideas on programs commonly used in the CSML.

* [[Autocorrelation]]
* [[Generic Analyzer]]
* [[Gnuplot]]
* [[Compressed data files]]

=== Programming ===
* [[Compiler notes]]
* [[Debugging]]
* [[Programming notes]]

=== Document processing ===

Ideally, we prepare manuscripts in [http://en.wikipedia.org/wiki/LaTeX LaTeX]. Occasionally, especially when collaborating with other research groups, it may be necessary to work in Microsoft Word.

* [[Notes on using LaTeX for manuscripts]]
* [[Notes on using Microsoft Word for manuscripts]]

=== Job submission and scheduling ===
* [[Notes on Torque]]
* [[Notes on Maui]]

=== UNIX ===
* [http://www.linuxproblem.org/art_9.html Password-less login via ssh]
* Short version of password-less login: (1) go to your home folder (e.g. ariadne:~/ ). (2) type "ssh-keygen" and press the enter key a few times to leave all answers blank (unless you are prompted to override the existing key in which case you should type "yes"). (3) type "ssh-copy-id XX" , where "XX" is the server name or IP address you wish to ssh into and enter the password. You can repeat this step and add multiple addresses. (4) On servers running Open-SUSE (ariadne, minotaur, hydra) you should also copy the generated key to: "cp ~/.ssh.authorized_keys ~/.ssh/authorized_keys2 ". Re-login and voilà, no more password needed. The same procedure also works on a macOS. However, ssh-copy-id needs to be installed (e.g. via brew install ssh-copy-id) and step (4) should be skipped.
* [[Command-line interface on Linux/UNIX]]

=== Data visualization tools ===
In order to communicate our research effectively, it is often useful to visualize the data from simulations. Here are a set of tools for creating/editing images and videos.

===== Visualizing Dump Files =====

* [[VMD]]
* [[pymol]]

===== Handling image/video files =====

* [[FFmpeg]]

=== Miscellaneous ===
* [[Dropbox]]
* [[Clonezilla]]