Tracking for the long term

From UA Libraries Digital Services Planning and Documentation
(Difference between revisions)
Jump to: navigation, search
Line 6: Line 6:
  
 
== The InfoTrack database ==
 
== The InfoTrack database ==
Currently has several tables.  Here are some of them:
 
  
 
'''allColls'''
 
'''allColls'''
  
This table contains information about each collection sufficient for a PHP script to be able to dynamically deliver an alphabetized list of current online collections and EAD finding aids, descriptions, icons, links to the content (and if available, the finding aid associated, and the link to that online).  Most of this information comes from the [[Collection_Information]] file created by Digital Services personnel when they begin to digitize a collection, drawing information from the spreadsheets filled out by archivists.  This information is uploaded by the collToDbase script described in step 10 of [[Moving_Content_To_Long-Term_Storage]].  That script also adds the expected canned link for retrieving content, and specifies if the collection is online yet.  Other information that may at some point be stored in this table includes the long-term storage location of the content, the date it went online, query terms and query fields used to retrieve the content.
+
This table contains information about each collection sufficient for a PHP script to be able to dynamically deliver an alphabetized list of current online collections and EAD finding aids, descriptions, icons, links to the content (and if available, the finding aid associated, and the link to that online).  Most of this information comes from the [[Collection_Information]] file created by Digital Services personnel when they begin to digitize a collection, drawing information from the spreadsheets filled out by archivists.  This information is uploaded by the collToDbase script described in step 10 of [[Moving_Content_To_Long-Term_Storage]] or the moveContent script described in the 3rd section of [[Most Content]].  These scripts also add the expected canned link for retrieving content, and specify if the collection is online yet.  More information about this table is available here:  [[allColls]]
  
  
'''archival_formats'''
 
  
This table is designed to capture the type of format an file is in, a URL to information on that format, the quality of the capture, and the version of the format.  For example, a TIFF version 6.0 file captured at 600 dpi would have a URL entered from the Unified Digital Format Registry ([[http://www.udfr.org/]] similar to this one now available via the PRONOM Digital Format Registry:  [[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=612]].
+
'''lookup'''
  
By maintaining a record of the current format, version, and quality of each file, in a database, we can easily identify and locate all files in need of migration or emulation in the face of approaching obsolescence.
+
This table was created to support persistent identifiers.  It's a lookup table to provide redirects.  Each item for which we would like to provide this support is assigned a number.  Retrieval of that item will be by using a URL of the form:  http://purl.lib.ua.edu/3234  where the number following the last forward slash is the number of the item.  The actual url is stored in this table (realurl), along with the assigned number (purlnum), an original identifier (id_2009), a datestamp, and a history of any changes (history).  This table is accessed by the script redirect.pl which lives in the cgi-bin of libcontent1.lib.ua.edu.  A URL rewrite and a virtual host configuration, along with the DNS registration of purl.lib.ua.edu, were the only other support necessary for this to work.  Whenever a file must be moved, the database is updated, and the persistent URL continues to work.  In this fashion, we may enter URLs into metadata, webpages, online catalogs, etc., and never have to change them.
  
  
'''metadataTypes'''
 
  
Similarly, this table is designed to capture the current type, version, schema of both descriptive and technical metadata for an item, and also the location of any existing data dictionaries which may help decipher how particular fields were used.  A query on this table should be able to tell us what metadata needs to be revamped to meet the current pressing need or software change.
+
'''bornDigital''
  
 +
This table tracks born digital content such as Electronic Theses and Dissertations, which may have embargoes on web delivery which must be tracked and supported.  Fields here include the identifier (id_2009), first and last name of the primary author, collection number, datestamp entered, title, and the date the content should be made available.
  
'''file_relations'''
 
  
This table is a temporary holding place for information about how files are related, until it can be captured in a METS file.  This table probably is not long for this world.  Currently, it is designed to hold the parent ID number, the collection ID number, the item's ID number, and the number of child files this item has.
 
  
 +
'''archival_formats'''
  
'''identifiers'''
+
This table is designed to capture the type of format an file is in, a URL to information on that format, the quality of the capture, and the version of the format.  For example, a TIFF version 6.0 file captured at 600 dpi would have a URL entered from the Unified Digital Format Registry ([[http://www.udfr.org/]] similar to this one now available via the PRONOM Digital Format Registry:  [[http://www.nationalarchives.gov.uk/PRONOM/Format/proFormatSearch.aspx?status=detailReport&id=612]].
  
As we have migrated legacy content to our standardized [[File_naming_schemes]], and in and out of CONTENTdm (which assigns its own identifiers, database numbers, and OAI identifiers), we've struggled to keep track of all the names associated with each item.  This is the centralized table in which that should happen.  Again, this table is in transition, and it may lose some CONTENTdm identifiers after we've left that system, and will probably gain other identifier types over time.
+
By maintaining a record of the current format, version, and quality of each file, in a database, we can easily identify and locate all files in need of migration or emulation in the face of approaching obsolescence.
  
  
'''lookup'''
 
  
This table was created to support persistent identifiers.  It's a lookup table to provide redirects.  Each item for which we would like to provide this support will be assigned a number.  Retrieval of that item will be by using a URL of the form:  http://purl.lib.ua.edu/3234  where the number following the last forward slash is the number of the item.  The actual url is stored in this table, along with the assigned number, and possibly an OAI identifier, an original identifier, but certainly a history of any changes.  This table is accessed by the script redirect.pl which lives in the cgi-bin of libcontent1.lib.ua.edu.  A URL rewrite and a virtual host configuration, along with the DNS registration of purl.lib.ua.edu, were the only other support necessary for this to work.  Whenever a file must be moved, the database is updated, and the persistent URL continues to work.  In this fashion, we may enter URLs into metadata, webpages, online catalogs, etc., and never have to change them.
+
'''Donors'''
 
+
'''bornDigital''
+
  
This table tracks born digital content such as Electronic Theses and Dissertations, which may have embargoes on web delivery which must be tracked and supportedFields here include the identifier, first and last name of the primary author, collection number, datestamp entered, title, and the date the content should be made available.
+
This table is not yet in use, and will likely expandThe purpose is to track which donors have provided support for digitization, processing, or donated content, and be able to link to their website and use a logo for the display of content.

Revision as of 08:46, 28 July 2010

We're developing a tracking database for management of content over time. Recognizing that this is still software-dependent, and that relational databases are inherently unstable, the plan is to periodically print reports from the database and store these as flat files in the top levels of the storage system, as a form of manifest.

The location of InfoTrack is on libcontent1.lib.ua.edu.

The InfoTrack database

allColls

This table contains information about each collection sufficient for a PHP script to be able to dynamically deliver an alphabetized list of current online collections and EAD finding aids, descriptions, icons, links to the content (and if available, the finding aid associated, and the link to that online). Most of this information comes from the Collection_Information file created by Digital Services personnel when they begin to digitize a collection, drawing information from the spreadsheets filled out by archivists. This information is uploaded by the collToDbase script described in step 10 of Moving_Content_To_Long-Term_Storage or the moveContent script described in the 3rd section of Most Content. These scripts also add the expected canned link for retrieving content, and specify if the collection is online yet. More information about this table is available here: allColls


lookup

This table was created to support persistent identifiers. It's a lookup table to provide redirects. Each item for which we would like to provide this support is assigned a number. Retrieval of that item will be by using a URL of the form: http://purl.lib.ua.edu/3234 where the number following the last forward slash is the number of the item. The actual url is stored in this table (realurl), along with the assigned number (purlnum), an original identifier (id_2009), a datestamp, and a history of any changes (history). This table is accessed by the script redirect.pl which lives in the cgi-bin of libcontent1.lib.ua.edu. A URL rewrite and a virtual host configuration, along with the DNS registration of purl.lib.ua.edu, were the only other support necessary for this to work. Whenever a file must be moved, the database is updated, and the persistent URL continues to work. In this fashion, we may enter URLs into metadata, webpages, online catalogs, etc., and never have to change them.


'bornDigital

This table tracks born digital content such as Electronic Theses and Dissertations, which may have embargoes on web delivery which must be tracked and supported. Fields here include the identifier (id_2009), first and last name of the primary author, collection number, datestamp entered, title, and the date the content should be made available.


archival_formats

This table is designed to capture the type of format an file is in, a URL to information on that format, the quality of the capture, and the version of the format. For example, a TIFF version 6.0 file captured at 600 dpi would have a URL entered from the Unified Digital Format Registry ([[1]] similar to this one now available via the PRONOM Digital Format Registry: [[2]].

By maintaining a record of the current format, version, and quality of each file, in a database, we can easily identify and locate all files in need of migration or emulation in the face of approaching obsolescence.


Donors

This table is not yet in use, and will likely expand. The purpose is to track which donors have provided support for digitization, processing, or donated content, and be able to link to their website and use a logo for the display of content.

Personal tools