{"id":2795,"date":"2014-08-02T17:01:34","date_gmt":"2014-08-02T21:01:34","guid":{"rendered":"http:\/\/www.maineinfonet.org\/mscs\/?page_id=2795"},"modified":"2015-02-21T23:24:16","modified_gmt":"2015-02-22T04:24:16","slug":"hathirecs","status":"publish","type":"page","link":"http:\/\/www.maineinfonet.org\/mscs\/about\/people\/technical-services-subcommittee\/hathirecs\/","title":{"rendered":"Hathi Records: Loading into Catalog"},"content":{"rendered":"<h2><strong>Loading Records<\/strong><\/h2>\n<p><span style=\"text-decoration: underline;\">Copies of m2bmaps and m2btab are located on:<\/span><\/p>\n<p style=\"padding-left: 30px;\">Dropbox\/MSCS Project Team\/HathiRecords\/LoadProfiles<\/p>\n<p><span style=\"text-decoration: underline;\">Load profiles accomplish the following:<\/span><\/p>\n<p style=\"padding-left: 30px;\">1) Prefix 001 with &#8220;hathi&#8221; (m2bmap.hathi001s). \u00a0 This to prevent overlaying on current records based on 001. This may or may not be desireable. \u00a0Note that in MaineCat matching is based on more than 001, so sometimes records are matching in MaineCat.<\/p>\n<p style=\"padding-left: 30px;\">2) Create Read Online from HathiTrust links &#8211; m2bmap.hathitext . Includes Google Analytics tracking link.<\/p>\n<p style=\"padding-left: 30px;\"><a href=\"#note\">**SEE Note<\/a> regarding problem when record has multiple 856s!!!<\/p>\n<p style=\"padding-left: 30px;\">3) Create Google Book link &#8211; this references http:\/\/mainecat.maine.edu\/screens\/gbcheck.js which controls text and links output. \u00a0(m2bmap.hathiurls).<\/p>\n<p style=\"padding-left: 30px;\">4) Create POD link. (m2bmap.mscspod) \u00a0This references http:\/\/mainecat.maine.edu\/screens\/mscspod.html.<\/p>\n<p style=\"padding-left: 30px;\">5) Removes 9xx fields<\/p>\n<p style=\"padding-left: 30px;\">6) Uses &#8216;hathib&#8217; template for bibs, does not create items. (As of Feb 2015 hathib needs to be made a template on Ursus)<\/p>\n<p>Links that need to be in the page head (toplogo):<\/p>\n<p style=\"padding-left: 30px;\">&lt;script src=&#8221;https:\/\/code.jquery.com\/jquery-1.9.1.min.js&#8221;&gt;&lt;\/script&gt;<\/p>\n<p style=\"padding-left: 30px;\">and on mainecat:<br \/>\n&lt;script src=&#8221;\/screens\/ga.js&#8221;&gt;&lt;\/script&gt;<br \/>\n&lt;script type=&#8221;text\/javascript&#8221; src=&#8221;\/screens\/sharedprint.js&#8221;&gt; &lt;\/script&gt;<\/p>\n<p>Files that need to exist\u00a0:<\/p>\n<blockquote><p>http:\/\/mainecat.maine.edu\/screens\/ga.js<br \/>\nhttp:\/\/mainecat.maine.edu\/screens\/gbcheck.js<br \/>\nhttp:\/\/mainecat.maine.edu\/screens\/mscspod.html<br \/>\nhttp:\/\/mainecat.maine.edu\/screens\/sharedprint.js<br \/>\nhttp:\/\/mainecat.maine.edu\/screens\/umaine.png<br \/>\nhttp:\/\/mainecat.maine.edu\/\/screens\/google.png<br \/>\nhttp:\/\/mainecat.maine.edu\/screens\/hathi_logo.png<\/p><\/blockquote>\n<p><strong><a name=\"note\"><\/a>\u00a0**NOTE regarding multiple 856s:<\/strong><\/p>\n<p>Some, thought not many, \u00a0records have more than one 856 field. \u00a0 Possible field text is below.<\/p>\n<pre>85640 $uhttp:\/\/catalog.hathitrust.org\/api\/volumes\/oclc\/5518087.html$zHathiTrust Public Domain only in US Access<\/pre>\n<pre>85640 $uhttp:\/\/catalog.hathitrust.org\/api\/volumes\/oclc\/5518087.html$zHathiTrust Public Domain Access<\/pre>\n<pre>85640 $uhttp:\/\/catalog.hathitrust.org\/api\/volumes\/oclc\/36909847.html$zHathiTrust Creative Commons - No Copyright<\/pre>\n<pre>85640 $uhttp:\/\/catalog.hathitrust.org\/api\/volumes\/oclc\/132582276.html$zHathiTrust World Access<\/pre>\n<p>If the record has more than one 856, the load table creates 3 urls for each\u00a0856. \u00a0(E.g. if there are 2, it creates 6.) \u00a0 In theory one could use the %first directive in the load table to just process the first instance. \u00a0This would be ideal EXCEPT that we are also using the %map directive, and from what we&#8217;ve see so far, the system ONLY respects the first directive and not the second, so something like this still processes all urls:\u00a0856|85641|+|0|0|b|y|0|y|N|0|%map=(&#8220;m2bmap.hathitextPD&#8221;)%first.<\/p>\n<p>Unless or until this is fixed, there are two possible workarounds:<\/p>\n<p>1) \u00a0Use four separate load tables, one\u00a0for each input file, e.g. CC, PD, US, and World, \u00a0and use translation maps that exclude matches to text in all other files. \u00a0E.g. in the load table for Public Domain Access:<\/p>\n<p style=\"padding-left: 30px;\">856|85641|+|0|0|b|y|0|y|N|0|%map=(&#8220;m2bmap.hathitextPD&#8221;)<br \/>\n856|85641|+|0|0|b|y|0|y|N|0|%map=(&#8220;m2bmap.hathiurlsPD&#8221;)<br \/>\n856|85641|+|0|0|b|y|0|y|N|0|%map=(&#8220;m2bmap.mscspodPD&#8221;)<\/p>\n<p style=\"padding-left: 30px;\">In PD translation tables put regexs that exclude the other possible types of text:<\/p>\n<p style=\"padding-left: 30px;\">@delimiter=\/<br \/>\n\/.*only in US.*\/<br \/>\n\/.*Creative.*\/<br \/>\n\/.*World.*\/<\/p>\n<p>2) \u00a0Use Marc Edit or perl Marc::Record to remove extra 856 fields before loading.<\/p>\n<p>A sample record that had two 856s is\u00a0<a href=\"http:\/\/www.worldcat.org\/oclc\/729489102\">http:\/\/www.worldcat.org\/oclc\/729489102<\/a> , and was contained in the HathiTrustUS.5.mrc file.<\/p>\n<hr \/>\n<h2><strong>Acquiring Records\u00a0From <a href=\"https:\/\/colby.share.worldcat.org\/wms\">OCLC\u00a0WorldShare\u00a0Kb<\/a><\/strong><\/h2>\n<p>NOTE: A Complete set of records\u00a0from October 2014\u00a0are available on Dropbox\/MSCS Project Team\/HathiRecords\/WorldShareRecords in preparation for loading into URSUS.<\/p>\n<p>These directions assume\u00a0that the Hathi collections are not already selected. \u00a0If they are, and a new set of records is desired, they need to be deselected and wait 1-3 weeks for holdings to be removed and then reselected via the process below. \u00a0(This as of Summer 2014, it might be worth checking with OCLC again if creating a custom collection is possible and\/or if record deselection is faster now. Records were left unselected after download in October 2014.)<\/p>\n<p>In WorldShare choose Manage Collections. \u00a0 \u00a0Search &#8220;Collection&#8221; for &#8220;hathitrust&#8221;.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2797\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb1.png\" alt=\"worldsharekb1\" width=\"211\" height=\"456\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb1.png 211w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb1-160x345.png 160w\" sizes=\"auto, (max-width: 211px) 100vw, 211px\" \/><\/p>\n<p>Select the 4 public domain collections, as shown below. \u00a0Note that selection may take some time on the larger collections.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2798\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb2.png\" alt=\"worldsharekb2\" width=\"717\" height=\"265\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb2.png 717w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb2-160x59.png 160w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb2-300x110.png 300w\" sizes=\"auto, (max-width: 717px) 100vw, 717px\" \/><\/p>\n<p>Once selected, click on the title to bring up the Holdings and Marc Records option, and open it.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2985\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/HathiMarc.png\" alt=\"HathiMarc\" width=\"255\" height=\"182\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/HathiMarc.png 255w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/HathiMarc-160x114.png 160w\" sizes=\"auto, (max-width: 255px) 100vw, 255px\" \/><\/p>\n<p>If you don&#8217;t want holdings adding in WorldCat for these records, make sure the following is set to &#8220;Disable..&#8221; :<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2800\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb4.png\" alt=\"worldsharekb4\" width=\"438\" height=\"120\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb4.png 438w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb4-160x43.png 160w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb4-300x82.png 300w\" sizes=\"auto, (max-width: 438px) 100vw, 438px\" \/><\/p>\n<p>Under &#8220;Enable MARC Record Delivery&#8221; choose &#8220;Use institution setting&#8221;. \u00a0 Choose &#8220;Deliver Records for this collection in a separate file&#8221; and give it a name that you will recognize later, e.g.:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2946\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/ws32.png\" alt=\"ws3\" width=\"666\" height=\"445\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/ws32.png 666w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/ws32-160x106.png 160w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/ws32-300x200.png 300w\" sizes=\"auto, (max-width: 666px) 100vw, 666px\" \/><\/p>\n<p>Specify the frequency of delivery. \u00a0In most cases you will only be grabbing the new set of files once they are generated, at which point you may want to deselect the holdings. \u00a0However, if you wish to continue to receive updated files it is possible to do so:<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-2799\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb3.png\" alt=\"worldsharekb3\" width=\"860\" height=\"241\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb3.png 860w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb3-160x44.png 160w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb3-300x84.png 300w\" sizes=\"auto, (max-width: 860px) 100vw, 860px\" \/><\/p>\n<p style=\"padding-left: 30px;\">Finally, Under the main menu &#8220;Manage Collection&#8221; \/ &#8220;Library Holdings&#8221; \/ &#8220;Enable Marc Delivery&#8221; &#8211; make sure Yes is selected.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-2801 size-full\" src=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb5.png\" alt=\"worldsharekb5\" width=\"690\" height=\"83\" srcset=\"http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb5.png 690w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb5-160x19.png 160w, http:\/\/www.maineinfonet.org\/mscs\/wp-content\/uploads\/worldsharekb5-300x36.png 300w\" sizes=\"auto, (max-width: 690px) 100vw, 690px\" \/><\/p>\n<p style=\"padding-left: 30px;\">Records will now be delivered for FTP pickup, and will continue to be delivered at the frequency specified above.<\/p>\n<p><strong>Picking Up FTP Marc Records:<\/strong><\/p>\n<p style=\"padding-left: 30px;\">1. Enter host: ftp2.oclc.org (or scp.oclc.org)<br \/>\n2. Enter your institution\u2019s username and your password<br \/>\n3. Navigate through the following folders: metacoll\u2014out\u2014ongoing<br \/>\n4. Choose a folder: new, updates or deletes. \u00a0In most cases files should be in &#8220;New&#8221;.<\/p>\n<p style=\"padding-left: 30px;\">Look for the file name you used in the &#8216;deliver records for this collection in a separate file&#8217;. \u00a0Files usually take 24 hours to appear.<\/p>\n<p>&nbsp;<\/p>\n<hr \/>\n<p>&nbsp;<\/p>\n<h6 style=\"text-align: center;\"><a href=\"http:\/\/www.maineinfonet.net\/mscs\/\">MSCS<\/a> &gt;&gt; <a href=\"http:\/\/www.maineinfonet.net\/mscs\/about\/people\/\">People<\/a> &gt;&gt; <a href=\"http:\/\/www.maineinfonet.net\/mscs\/about\/people\/technical-services-subcommittee\/\">Technical Services Subcommittee<\/a> &gt;&gt; Hathi Records: Loading into Catalog<\/h6>\n","protected":false},"excerpt":{"rendered":"<p>Loading Records Copies of m2bmaps and m2btab are located on: Dropbox\/MSCS Project Team\/HathiRecords\/LoadProfiles Load profiles accomplish the following: 1) Prefix 001 with &#8220;hathi&#8221; (m2bmap.hathi001s). \u00a0 This&hellip;<\/p>\n","protected":false},"author":5,"featured_media":0,"parent":202,"menu_order":0,"comment_status":"open","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-2795","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/pages\/2795","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/comments?post=2795"}],"version-history":[{"count":30,"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/pages\/2795\/revisions"}],"predecessor-version":[{"id":3133,"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/pages\/2795\/revisions\/3133"}],"up":[{"embeddable":true,"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/pages\/202"}],"wp:attachment":[{"href":"http:\/\/www.maineinfonet.org\/mscs\/wp-json\/wp\/v2\/media?parent=2795"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}