Job and File Storage Space - Revision history

Barnes at 18:50, 9 November 2016

2016-11-09T18:50:13Z

2016-11-09T18:49:35Z

2016-11-09T18:46:20Z

/home/username/jobs

2015-04-01T18:14:58Z

/home/username

2015-04-01T18:13:45Z

Disk Space Organization Overview

2013-09-12T19:43:33Z

2013-09-12T19:43:13Z

Disk Space Organization Overview

2013-09-12T19:42:32Z

Disk Space Organization Overview

2013-09-11T21:18:41Z

Disk Space Organization Overview

2013-09-03T20:42:01Z

/home/username/jobs

@@ Line 12: / Line 12: @@
 | style="background: #f9f9f9; width: 750px" | temporary space shared by <b>all</b> users; ~100 GB total; <b>NO BACKUP, DO NOT PERMANENTLY STORE RESULTS HERE</b>
 |}
+=== Results ===
 == /home/username ==
 Upon logging in, the user lands in his or her home directory: /home/<i><b>username</b></i>. This modest amount of space is intended as private space for development, testing of code etc. Results may safely be kept here for some time as this space is backed up. It is not intended for large data files or the many files generated by Condor jobs.
@@ Line 38: / Line 39: @@
 |style="width: 200px"| remote file location on stats server
 |}

← Older revision		Revision as of 18:49, 9 November 2016
Line 38:		Line 38:
	\|style="width: 200px"\| remote file location on stats server		\|style="width: 200px"\| remote file location on stats server
	\|}		\|}
		+
		+	== Results ==
		+	If you have files that you will not be using and do not want to delete, please move them to your own personal storage off of the cluster. The jobs directory is NOT backed up so any results that are important should be moved off of the cluster. The cluster is where you stage your work but it is not a recommended permanent home for your results.

@@ Line 21: / Line 21: @@
 A special directory /home/<b><i>username</i></b>/jobs is a more efficient space for launching jobs. It is actually a link to local space on stats.phys.uconn.edu (and is not accessible from processing nodes.) It is not bound by quotas.
-<b>This is the recommended location for storing files.</b>
+<b>This is the recommended location for storing files that are in use.</b>
 == /scratch ==

@@ Line 15: / Line 15: @@
 == /home/username ==
 Upon logging in, the user lands in his or her home directory: /home/<i><b>username</b></i>. This modest amount of space is intended as private space for development, testing of code etc. Results may safely be kept here for some time as this space is backed up. It is not intended for large data files or the many files generated by Condor jobs.
 == /home/username/jobs ==

@@ Line 4: / Line 4: @@
 {| class="wikitable" style="text-align: left; background: #A9A9A9"
 | style="background: #f9f9f9; width: 150px" | /home/<i><b>username</b></i>
-| style="background: #f9f9f9; width: 750px" | user home directory with regular backups; 90 MB default quota.
+| style="background: #f9f9f9; width: 750px" | user home directory with regular backups; 90 MB default SHARED quota.
 |-
 | style="background: #f9f9f9; width: 150px" | /home/<i><b>username</b></i>/jobs

← Older revision		Revision as of 19:43, 12 September 2013
Line 36:		Line 36:
	\|style="width: 200px"\| remote file location on stats server		\|style="width: 200px"\| remote file location on stats server
	\|}		\|}
−
−	~~== /local ==~~
−	Being a collaborative space, however, means that it should be kept organized for the sake of all other clusters users (including members of the adjoining Physics and Geophysics clusters). This space may be cleaned up by administrators if any files appear to be abandoned.
−
−	The shared spaces discussed so far reside on a file server and accessible to the stats nodes over the network via nfs. While this is conveneint for the purposes of a shared space for testing and job distribution, network latency, bandwidth limitation and congestion may create a bottleneck for data-intensive calculations. To resolve this problem, local space is available on each node in the form of an on-board hard disk. It is mounted on each node under /local. Note that use of this space requires a job to copy the necessary files and clean up at the end.

@@ Line 7: / Line 7: @@
 |-
 | style="background: #f9f9f9; width: 150px" | /home/<i><b>username</b></i>/jobs
-| style="background: #f9f9f9; width: 750px" | link to local space on stats.phys.uconn.edu ideal for launching Condor jobs. No backups, no per-user quota; ~150 GB space total
+| style="background: #f9f9f9; width: 750px" | only available on stats.phys.uconn.edu ideal for launching Condor jobs. No backups, no per-user quota; ~150 GB space total
 |-
 | style="background: #f9f9f9; width: 150px" | /scratch