Metadata Movement

From UA Libraries Digital Services Planning and Documentation
(Difference between revisions)
Jump to: navigation, search
m (reflecting server switch from libcontent1 to libcontent)
 
(15 intermediate revisions by 2 users not shown)
Line 4: Line 4:
 
==Digital Services:==
 
==Digital Services:==
 
When content is ready for storage:
 
When content is ready for storage:
# Put the Excel file into S:\Digital Projects\Administrative\collectionInfo\forMDlib\needsRemediation for Mary.
+
# Put the Excel file into S:\Digital Projects\Administrative\Pipeline\collectionInfo\forMDlib\needsRemediation for Mary.
# Export a Unicode tab-delimited text file and put it with the content for Storage
+
# Export a tab-delimited text file and put it with the content for Storage.
# Export a UTF-8 tab-delimited text file (use OpenOffice) to generate MODS according to the instructions here: [[Making MODS]]<!--[[Generating_MODS]]-->
+
# Export a tab-delimited text file to generate MODS according to the instructions here: [[Making MODS]]<!--[[Generating_MODS]]-->
 
# Upload the MODS to Acumen by following the process outlined here: [[Uploading_MODS]]
 
# Upload the MODS to Acumen by following the process outlined here: [[Uploading_MODS]]
 
# Delete the text file used to create the MODS.
 
# Delete the text file used to create the MODS.
Line 16: Line 16:
 
# Generate MODS records, according to the instructions here: [[Making MODS]]<!--[[Generating_MODS]]-->
 
# Generate MODS records, according to the instructions here: [[Making MODS]]<!--[[Generating_MODS]]-->
 
# Upload these  MODS records to Acumen by following the process outlined here: [[Uploading_MODS]]
 
# Upload these  MODS records to Acumen by following the process outlined here: [[Uploading_MODS]]
# Export a Unicode tab-delimited text file of the remediated metadata.
+
# Export a tab-delimited text file of the remediated metadata.
# Deposit the exported Unicode tab-delimited collection-level metadata in S:\Digital Projects\Administrative\collectionInfo\JodyPickup.   
+
# Deposit the exported tab-delimited collection-level metadata in S:\Digital Projects\Administrative\collectionInfo\JodyPickup.   
 
# Notify  Jody it's ready for pickup.
 
# Notify  Jody it's ready for pickup.
  
Line 23: Line 23:
 
# If initial uploaded content includes text files in the Scans directory (i.e. item-level tab-delimited metadata), move those to S:\Digital Projects\Administrative\collectionInfo\forMDlib\itemMD\   
 
# If initial uploaded content includes text files in the Scans directory (i.e. item-level tab-delimited metadata), move those to S:\Digital Projects\Administrative\collectionInfo\forMDlib\itemMD\   
 
# Notify Mary they're ready for pickup
 
# Notify Mary they're ready for pickup
# Pick up finalized spreadsheets from S:\Digital Projects\Administrative\collectionInfo\JodyPickup and transfer to the deposits directory on libcontent1
+
# Pick up finalized spreadsheets from S:\Digital Projects\Administrative\collectionInfo\JodyPickup and transfer to the deposits directory on libcontent
 
# Process for correct deposit into long term storage and linking in LOCKSS Manifests
 
# Process for correct deposit into long term storage and linking in LOCKSS Manifests
  
 
==Metadata Transfer and Remediation for Collections Requiring Multiple Uploads==
 
==Metadata Transfer and Remediation for Collections Requiring Multiple Uploads==
# When enough item scans have passed quality control checks to warrant an upload of materials to Storage (i.e. a "batch"), the metadata corresponding to the items to be uploaded is copied out of the original set of metadata and pasted into a new Excel file (.xlsx) by Digital Services. The naming convention for this file is collectionNumber.n.xlsx, where "n" is the numerical value of the batch. Ex: u0008_0000001.2.xlsx = the metadata for the second batch of items for collection u0008_0000001. <br /><br />Digital Services will note - in the original collection metadata Excel file - which items correspond to this batch. This shall be done via entering the information into a column in the Excel version of the collection metadata. In this fashion, we keep track of which batch we're on. <br /><br />This column and it's cells must be excluded from any subsequent text files that are generated for MODS or Storage purposes.<br /><br />
+
# When enough item scans have passed quality control checks to warrant an upload of materials to Storage (i.e. a "batch"), the metadata corresponding to the items to be uploaded is copied out of the original set of metadata and pasted into a new Excel file (.xlsx) by Digital Services. For instructions on how to prepare batch metadata see here: [[BATCH_Metadata]] The naming convention for this file is collectionNumber.n.xlsx, where "n" is the numerical value of the batch. Ex: u0008_0000001.2.xlsx = the metadata for the second batch of items for collection u0008_0000001. <br /><br />Digital Services will note - in the original collection metadata Excel file - which items correspond to this batch. This shall be done via entering the information into a column in the Excel version of the collection metadata. In this fashion, we keep track of which batch we're on. <br /><br />This column and it's cells must be excluded from any subsequent text files that are generated for MODS or Storage purposes.<br /><br />
# This subset of the collection metadata is then exported from Excel as a tab delimited Unicode .txt file and is placed in the appropriate folder in s:\Digital Projects\Digital_Coll_Complete by Digital Services.
+
# This subset of the collection metadata is then exported from Excel as a tab delimited .txt file and is placed in the appropriate collection metadata folder in s:\Digital Projects\Digital_Coll_Complete by Digital Services.
 
# The .xlsx version of this metadata subset is placed into S:\Digital Projects\Administrative\collectionInfo\forMDlib\needsRemediation by Digital Services.  
 
# The .xlsx version of this metadata subset is placed into S:\Digital Projects\Administrative\collectionInfo\forMDlib\needsRemediation by Digital Services.  
# Metadata Services then applies the same steps as for single batch collections in terms of MODS generation and exporting a Unicode .txt files to delivery to Jody for Storage.
+
# Metadata Services then applies the same steps as for single batch collections in terms of MODS generation and exporting a .txt files to delivery to Jody for Storage.
  
  
Line 37: Line 37:
 
<!--'''Diagram of metadata movement for collections requiring multiple uploads''' this image shows a potential policy:  [[Image:metadata_transfer_and_remediation.pdf]]-->
 
<!--'''Diagram of metadata movement for collections requiring multiple uploads''' this image shows a potential policy:  [[Image:metadata_transfer_and_remediation.pdf]]-->
  
==PowerPoint Slide Presentations==
+
==Workflow Slide Presentations==
[[Image:MetadataMovement.DS-Jody.pdf]]
+
<!-- [http://intranet.lib.ua.edu/wiki/digcoll/images/6/68/MetadataMovement.DS-Jody.pdf Workflow between Digital Services and Jody regarding delivering Content and MODS for Storage and Delivery]
 +
This PowerPoint, such that it is, has been commented out given that the process it outdated.
 +
-->
 +
 
 +
[http://intranet.lib.ua.edu/wiki/digcoll/images/d/db/MetadataMovement.DS-MU.pdf Workflow between Digital Services and Metadata Services regarding Excel files/metadata] - This does not cover the creation of MODS files or how Metadata Services delivers tab-delimited metadata for long term Storage.

Latest revision as of 09:11, 6 August 2013

Diagram of metadata movement for content being digitized in Digital Services effective November 2009: File:Metadata.pdf


Contents

[edit] Digital Services:

When content is ready for storage:

  1. Put the Excel file into S:\Digital Projects\Administrative\Pipeline\collectionInfo\forMDlib\needsRemediation for Mary.
  2. Export a tab-delimited text file and put it with the content for Storage.
  3. Export a tab-delimited text file to generate MODS according to the instructions here: Making MODS
  4. Upload the MODS to Acumen by following the process outlined here: Uploading_MODS
  5. Delete the text file used to create the MODS.
  6. Notify Jody that new MODS await.

[edit] Metadata Services:

  1. Retrieve deposited spreadsheet from S:\Digital Projects\Administrative\collectionInfo\forMDlib\needsRemediation, and remediate metadata appropriately.
  2. Move the remediated spreadsheet to S:\Digital Projects\Administrative\collectionInfo\Storage_Excel
  3. Generate MODS records, according to the instructions here: Making MODS
  4. Upload these MODS records to Acumen by following the process outlined here: Uploading_MODS
  5. Export a tab-delimited text file of the remediated metadata.
  6. Deposit the exported tab-delimited collection-level metadata in S:\Digital Projects\Administrative\collectionInfo\JodyPickup.
  7. Notify Jody it's ready for pickup.

[edit] Jody: Digital Services

  1. If initial uploaded content includes text files in the Scans directory (i.e. item-level tab-delimited metadata), move those to S:\Digital Projects\Administrative\collectionInfo\forMDlib\itemMD\
  2. Notify Mary they're ready for pickup
  3. Pick up finalized spreadsheets from S:\Digital Projects\Administrative\collectionInfo\JodyPickup and transfer to the deposits directory on libcontent
  4. Process for correct deposit into long term storage and linking in LOCKSS Manifests

[edit] Metadata Transfer and Remediation for Collections Requiring Multiple Uploads

  1. When enough item scans have passed quality control checks to warrant an upload of materials to Storage (i.e. a "batch"), the metadata corresponding to the items to be uploaded is copied out of the original set of metadata and pasted into a new Excel file (.xlsx) by Digital Services. For instructions on how to prepare batch metadata see here: BATCH_Metadata The naming convention for this file is collectionNumber.n.xlsx, where "n" is the numerical value of the batch. Ex: u0008_0000001.2.xlsx = the metadata for the second batch of items for collection u0008_0000001.

    Digital Services will note - in the original collection metadata Excel file - which items correspond to this batch. This shall be done via entering the information into a column in the Excel version of the collection metadata. In this fashion, we keep track of which batch we're on.

    This column and it's cells must be excluded from any subsequent text files that are generated for MODS or Storage purposes.

  2. This subset of the collection metadata is then exported from Excel as a tab delimited .txt file and is placed in the appropriate collection metadata folder in s:\Digital Projects\Digital_Coll_Complete by Digital Services.
  3. The .xlsx version of this metadata subset is placed into S:\Digital Projects\Administrative\collectionInfo\forMDlib\needsRemediation by Digital Services.
  4. Metadata Services then applies the same steps as for single batch collections in terms of MODS generation and exporting a .txt files to delivery to Jody for Storage.


  • If there *is* a collnum.2.xlsx or collnum.2.txt, and there is a collnum.xlsx or collnum.txt in the same directory, we will assume that the latter is the first segment of metadata for the collection. That is to say, it *is* the collnum.1.xlsx or collnum.1.txt file.


[edit] Workflow Slide Presentations

Workflow between Digital Services and Metadata Services regarding Excel files/metadata - This does not cover the creation of MODS files or how Metadata Services delivers tab-delimited metadata for long term Storage.

Personal tools