Monthly Count - Revision history

Jlderidder: /* To collect the count on the Share drive, and combine the two for the monthly report: */

Jlderidder — Fri, 02 Nov 2012 21:05:59 GMT

To collect the count on the Share drive, and combine the two for the monthly report:

←Older revision		Revision as of 21:05, 2 November 2012
Line 69:		Line 69:
	# Download the report created by acumenCount, and open it in Excel, with tabs as delimiters. This report lists collection identifiers, titles, item count, file count, and whether the collection has an EAD. At the end is the total counts for both items and files.		# Download the report created by acumenCount, and open it in Excel, with tabs as delimiters. This report lists collection identifiers, titles, item count, file count, and whether the collection has an EAD. At the end is the total counts for both items and files.

-	==To collect the count on the Share drive, and combine the two for the monthly report: ==	+	To collect the count on the Share drive, and combine the two for the monthly report:

	For the size of content on Share, use the monthly GB counter described here [[Monthly_gb_counter]].		For the size of content on Share, use the monthly GB counter described here [[Monthly_gb_counter]].

Jlderidder: /* To collect the count on the storage drive: */

Jlderidder — Fri, 02 Nov 2012 21:05:42 GMT

To collect the count on the storage drive:

←Older revision		Revision as of 21:05, 2 November 2012
Line 62:		Line 62:
	<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])		<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])

-	==To collect the count on the storage drive:==	+	To collect the count on the storage drive:

	# Log onto libcontent1 via SSH and change into the <code>scripts</code> directory. (see [[Command-line_Work_on_Linux_Server]])		# Log onto libcontent1 via SSH and change into the <code>scripts</code> directory. (see [[Command-line_Work_on_Linux_Server]])
	# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.		# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.
	# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.		# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.
-	# Download the report created by acumenCount, and open it in Excel, with tabs as delimiters. This report lists collection identifiers, titles, item count, file count, and whether the collection has an EAD. At the end is the total counts for both items and files.	+	# Download the report created by acumenCount, and open it in Excel, with tabs as delimiters. This report lists collection identifiers, titles, item count, file count, and whether the collection has an EAD. At the end is the total counts for both items and files.
-		+

	==To collect the count on the Share drive, and combine the two for the monthly report: ==		==To collect the count on the Share drive, and combine the two for the monthly report: ==

Jlderidder: /* Part III: Synopsis over time... */

Jlderidder — Fri, 02 Nov 2012 21:05:14 GMT

Part III: Synopsis over time...

←Older revision		Revision as of 21:05, 2 November 2012
Line 51:		Line 51:


-	Again, more on this process can be found in [[Server-side Count Scripts]].	+
		+
		+	'''Again, more on this process can be found in [[Server-side Count Scripts]].'''
		+
		+

	16:04, 2 November 2012 (CDT) [[User:Jlderidder\|Jlderidder]]		16:04, 2 November 2012 (CDT) [[User:Jlderidder\|Jlderidder]]

Jlderidder: /* Part III: Synopsis over time... */

Jlderidder — Fri, 02 Nov 2012 21:04:51 GMT

Part III: Synopsis over time...

←Older revision		Revision as of 21:04, 2 November 2012
Line 53:		Line 53:
	Again, more on this process can be found in [[Server-side Count Scripts]].		Again, more on this process can be found in [[Server-side Count Scripts]].

-	16:04, 2 November 2012 (CDT)~	+	16:04, 2 November 2012 (CDT) [[User:Jlderidder\|Jlderidder]]


	<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])		<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])
-

	==To collect the count on the storage drive:==		==To collect the count on the storage drive:==

Jlderidder at 21:04, 2 November 2012

Jlderidder — Fri, 02 Nov 2012 21:04:18 GMT

←Older revision		Revision as of 21:04, 2 November 2012
Line 1:		Line 1:
		+	'''What is our monthly count?'''

-	In October 2012, we modified how we collect the count, to capture a snapshot across multiple locations and note duplicates which are in the process of being repaired. We also developed a method of tracking digitization that never sees the light of day. This can include:	+	We're currently counting TIFF and WAVE files in the archive, deposits, and on the share drive, and MP3 and large JPEGs in [http://acumen.lib.ua.edu/ Acumen].
		+
		+	== Share side preparation ==
		+
		+	In October 2012, we modified how we collect the count, to capture a snapshot across multiple locations and note duplicates which are in the process of being repaired. The benefits of this new method is that we're not trying to collect a 3-D representation of our work in a single fell swoop in a single spreadsheet; and also, that we can automate it and save a ton of time and confusion. We're also working off the actual existence of files, not off the reported digitization counts. This avoids a ton of errors caused by inattention, poor counting, and forgetfulness.
		+
		+	In addition, we also developed a method of tracking digitization that never sees the light of day. This can include:
	* digitization for donors, such as providing digital versions of content donated to Special Collections		* digitization for donors, such as providing digital versions of content donated to Special Collections
	* digitization for publication, at the dean's request, often for cost recovery		* digitization for publication, at the dean's request, often for cost recovery
Line 8:		Line 15:
	* correction of errors, such as duplicate captures of a single page		* correction of errors, such as duplicate captures of a single page

-	* Starting in October 2012, ~~we are capturing monthly snapshots (an example can be viewed~~ [~~http://www.lib.ua.edu/wiki/digcoll/images/4/4c/CombinedCount_201210.xlsx here~~]~~, with a second synopsis specifying GB counts, total digitization thus far, and what was accomplished this past month~~.	+	For this process, see [[Documenting Invisible Digitization]].

-	For October, 2012, the synopsis was as follows ~~(not yet automated)~~:	+	== Part I: What's where right now? ==
		+
		+	Starting in October 2012, we are capturing monthly snapshots (an example can be viewed [http://www.lib.ua.edu/wiki/digcoll/images/4/4c/CombinedCount_201210.xlsx here] of image and audio content, with an intellectual item count pulled from the filenames, across web directories ([http://acumen.lib.ua.edu/ Acumen]), the deposits directories (awaiting archiving), the digital archive, and the working share drive, with duplicate items/files there noted in the "Under Repair" columns for clarification.
		+
		+	More on this process can be found in [[Server-side Count Scripts]].
		+
		+	== Part II: How does this differ from last month? And how many GB do we have? ==
		+
		+	Since this does not clarify progress since the previous month, we will also be generating a second synopsis specifying GB counts, total digitization thus far, and what was accomplished this past month.
		+
		+	For example, for October, 2012, the synopsis was as follows:
	* Digitized 125 new items (8719 captures)		* Digitized 125 new items (8719 captures)
	* Total items digitized: 89972		* Total items digitized: 89972
Line 20:		Line 37:
	* Total GB: 14326		* Total GB: 14326

		+	The script that generates this information picks up the information encoded in the tab-delimited text files that track [[Documenting Invisible Digitization]] and incorporate these into the Total items and Total captures sums, to reflect the work we've done that can't be seen. It also captures GB counts across the archive/deposits directory and the following share drive directories in the Digital Projects area:
		+
		+	*Digital_Coll_Complete
		+	*Digital_Coll_in_progress
		+	*Digital_Coll_ON_HOLD
		+	*Digital_Coll_Proposed
		+
		+	If a REVIEW folder exists in Digital_Coll_in_progress, the size of that folder is subtracted, as those files are assumed to be copies of TIFF files already in the archive.
		+
		+	== Part III: Synopsis over time... ==
		+
		+	A third script will collect monthly synopsis files, and generate a snapshot for the fiscal year thus far, with columns for each month and totals at the end and at the bottom.


		+	Again, more on this process can be found in [[Server-side Count Scripts]].

		+	16:04, 2 November 2012 (CDT)~

Jlderidder at 20:41, 2 November 2012

Jlderidder — Fri, 02 Nov 2012 20:41:35 GMT

←Older revision		Revision as of 20:41, 2 November 2012
Line 1:		Line 1:
		+
		+	In October 2012, we modified how we collect the count, to capture a snapshot across multiple locations and note duplicates which are in the process of being repaired. We also developed a method of tracking digitization that never sees the light of day. This can include:
		+	* digitization for donors, such as providing digital versions of content donated to Special Collections
		+	* digitization for publication, at the dean's request, often for cost recovery
		+	* weeded collections (such as those containing duplicates), and collections deleted due to rights issues
		+	* digitization of typed transcripts in order to obtain OCR to enable searchability of hand-written documents (we delete the transcript tiffs)
		+	* recapture of badly digitized content
		+	* correction of errors, such as duplicate captures of a single page
		+
		+	* Starting in October 2012, we are capturing monthly snapshots (an example can be viewed [http://www.lib.ua.edu/wiki/digcoll/images/4/4c/CombinedCount_201210.xlsx here], with a second synopsis specifying GB counts, total digitization thus far, and what was accomplished this past month.
		+
		+	For October, 2012, the synopsis was as follows (not yet automated):
		+	* Digitized 125 new items (8719 captures)
		+	* Total items digitized: 89972
		+	* Total captures: 323204
		+	* Total items in Acumen: 78704
		+	* Total captures in Acumen: 294350
		+	* Total GB in archive: 13852
		+	* Total GB on share: 474
		+	* Total GB: 14326
		+
		+
		+
		+
		+
		+
	<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])		<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])

Jlderidder at 20:39, 2 November 2012

Jlderidder — Fri, 02 Nov 2012 20:39:28 GMT

←Older revision		Revision as of 20:39, 2 November 2012
Line 1:		Line 1:
		+	<font color="gray"> The following information is deprecated as of 10/2012 (15:39, 2 November 2012 (CDT)[[User:Jlderidder\|Jlderidder]])
		+
		+
	==To collect the count on the storage drive:==		==To collect the count on the storage drive:==

Line 12:		Line 15:

	Please refer to this document for information on how we compile our monthly count [[Image:Collecting_numbers_for_use_in_the_monthly_count.docx‎]]		Please refer to this document for information on how we compile our monthly count [[Image:Collecting_numbers_for_use_in_the_monthly_count.docx‎]]
		+
		+	</font>

Scpstu32 at 15:17, 1 December 2010

Scpstu32 — Wed, 01 Dec 2010 15:17:18 GMT

←Older revision		Revision as of 15:17, 1 December 2010
Line 1:		Line 1:
	==To collect the count on the storage drive:==		==To collect the count on the storage drive:==

-	# Log onto libcontent1 via SSH and change into the <code>scripts</code> directory. (see Command-line_Work_on_Linux_Server)	+	# Log onto libcontent1 via SSH and change into the <code>scripts</code> directory. (see [[Command-line_Work_on_Linux_Server]])
	# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.		# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.
	# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.		# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.

Scpstu32 at 15:10, 1 December 2010

Scpstu32 — Wed, 01 Dec 2010 15:10:20 GMT

←Older revision		Revision as of 15:10, 1 December 2010
Line 1:		Line 1:
	==To collect the count on the storage drive:==		==To collect the count on the storage drive:==

-	# Log onto libcontent1 via SSH and change into the <~~samp~~>scripts</~~samp~~> directory. (see Command-line_Work_on_Linux_Server)	+	# Log onto libcontent1 via SSH and change into the <code>scripts</code> directory. (see Command-line_Work_on_Linux_Server)
	# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.		# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.
	# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.		# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.

Scpstu32 at 15:10, 1 December 2010

Scpstu32 — Wed, 01 Dec 2010 15:10:01 GMT

←Older revision		Revision as of 15:10, 1 December 2010
Line 1:		Line 1:
	==To collect the count on the storage drive:==		==To collect the count on the storage drive:==

-	# Log onto libcontent1 via SSH and change into the scripts directory. (see Command-line_Work_on_Linux_Server)	+	# Log onto libcontent1 via SSH and change into the <samp>scripts</samp> directory. (see Command-line_Work_on_Linux_Server)
	# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.		# Run GBcount: type in `GBcount` and hit enter. It will output on the command line the total count in gigabytes for the archival storage directories on the server. It will also output a detailed report in the scripts/output directory.
	# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.		# Run acumenCount: type in `acumenCount` and hit enter. It will output on the command line the total number of collections represented in Acumen, including the number which do not have EADs; the detailed report will be output in the scripts/output directory.