Skip to content

Instantly share code, notes, and snippets.

@ross-spencer
Last active December 4, 2019 17:05
Show Gist options
  • Select an option

  • Save ross-spencer/d93188eb51c617a75e0b658451fb33e4 to your computer and use it in GitHub Desktop.

Select an option

Save ross-spencer/d93188eb51c617a75e0b658451fb33e4 to your computer and use it in GitHub Desktop.
Useful Archivematica SQL Queries

Return task and module descriptions:

select MicroServiceChainLinks.pk, MicroServiceChainLinks.microserviceGroup, 
       TasksConfigs.description, StandardTasksConfigs.execute,
       StandardTasksConfigs.arguments
from MicroServiceChainLinks
inner join TasksConfigs 
on TasksConfigs.pk = MicroServiceChainLinks.currentTask
inner join StandardTasksConfigs
on StandardTasksConfigs.pk = TasksConfigs.taskTypePKReference
where MicroServiceChainLinks.microserviceGroup = "Prepare AIP"

Results:

+--------------------------------------+-------------------+-------------------------------------------+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| pk                                   | microserviceGroup | description                               | execute                 | arguments                                                                                                                                                       |
+--------------------------------------+-------------------+-------------------------------------------+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 002716a1-ae29-4f36-98ab-0d97192669c4 | Prepare AIP       | Move to compressionAIPDecisions directory | moveSIP_v0.0            | "%SIPDirectory%" "%watchDirectoryPath%workFlowDecisions/compressionAIPDecisions/." "%SIPUUID%" "%sharedPath%"                                                   |
| 0a63befa-327d-4655-a021-341b639ee9ed | Prepare AIP       | Copy submission documentation             | copySubmissionDocs_v0.0 | "%SIPDirectory%" "%SIPName%-%SIPUUID%"                                                                                                                          |
| 746b1f47-2dad-427b-8915-8b0cb7acccd8 | Prepare AIP       | Removed bagged files                      | removeDirectories_v0.0  | "%SIPDirectory%%SIPName%-%SIPUUID%" "%SIPLogsDirectory%" "%SIPObjectsDirectory%" "%SIPDirectory%thumbnails/"                                                    |
| 63f35161-ba76-4a43-8cfa-c38c6a2d5b2f | Prepare AIP       | Remove bagged files                       | remove_v0.0             | -R "%SIPLogsDirectory%" "%SIPObjectsDirectory%" "%SIPDirectory%thumbnails/"                                                                                     |
| f1e286f9-4ec7-4e19-820c-dae7b8ea7d09 | Prepare AIP       | Check if DIP should be generated          | test_v0.0               | -d "%SIPDirectory%DIP"                                                                                                                                          |
| d55b42c8-c7c5-4a40-b626-d248d2bd883f | Prepare AIP       | Compress AIP                              | compressAIP_v0.0        | %AIPCompressionAlgorithm% %AIPCompressionLevel% %SIPDirectory% %SIPName% %SIPUUID%                                                                              |
| 3e25bda6-5314-4bb4-aa1e-90900dce887d | Prepare AIP       | Prepare AIP                               | bagit_v0.0              | create "%SIPDirectory%%SIPName%-%SIPUUID%" "%SIPDirectory%" "logs/" "objects/" "METS.%SIPUUID%.xml" "README.html" "thumbnails/" "metadata/" --writer filesystem |
| 91dc1ab1-487e-4121-a6c5-d8441da7a422 | Prepare AIP       | Check if AIP is a file or directory       | test_v0.0               | -d "%SIPDirectory%%AIPFilename%"                                                                                                                                |
| 5fbc344c-19c8-48be-a753-02dac987428c | Prepare AIP       | Set bag file permissions                  | setFilePermission_v0.0  | 775 "%SIPDirectory%%AIPFilename%"                                                                                                                               |
+--------------------------------------+-------------------+-------------------------------------------+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------+
9 rows in set (0.01 sec)

Return Transfer UUID and SIP UUID and Transfer Name

select Files.transferUUID, Files.sipUUID, SIPs.aipFilename
from Files
inner join SIPs
on SIPs.sipUUID = Files.sipUUID
inner join Transfers
on Transfers.transferUUID = Files.transferUUID
where Files.transferUUID is not Null

Results:

+--------------------------------------+--------------------------------------+-------------------------------------------+
| transferUUID                         | sipUUID                              | aipFilename                               |
+--------------------------------------+--------------------------------------+-------------------------------------------+
| 3ac3b282-4015-437d-88fd-172c605514b4 | 523ee501-c61b-4bac-8364-efacde21f526 | 1-523ee501-c61b-4bac-8364-efacde21f526.7z |
| c5e8ae95-3cdc-4dd9-bbfc-1fa48ae167d5 | 66330846-f41d-4615-adc0-bcb31f31c99e | 2-66330846-f41d-4615-adc0-bcb31f31c99e.7z |
+--------------------------------------+--------------------------------------+-------------------------------------------+
2 rows in set (0.00 sec)

Return formats and counts in the DB

select FilesIDs.formatRegistryKey as "id",
	   FilesIDs.formatName as "formatname",
	   FilesIDs.formatVersion as "formatversion",
       count(*) as count
from Files
inner join FilesIDs
where fileGrpUse = 'original'
and Files.fileUUID = FilesIDs.fileUUID
group by FilesIDs.formatRegistryKey
+-----------+-------------------------------+---------------+-------+
| id        | formatname                    | formatversion | count |
+-----------+-------------------------------+---------------+-------+
| fmt/11    | Portable Network Graphics     | 1.0           |    13 |
| fmt/116   | Windows Bitmap                | 3.0           |    10 |
| fmt/124   | Encapsulated PostScript       | 3             |    10 |
| fmt/134   | MPEG 1/2 Audio Layer 3        |               |     1 |
| fmt/353   | Tagged Image File Format      |               |    11 |
| fmt/4     | Graphics Interchange Format   | 1989a         |    12 |
| fmt/402   | Truevision TGA Bitmap         | 2.0           |    12 |
| fmt/41    | Raw JPEG Stream               |               |     1 |
| fmt/414   | Audio Interchange File Format | 1.2           |     1 |
| fmt/43    | JPEG                          | 1.01          |    16 |
| fmt/563   | Adobe Illustrator             | 14.0          |    10 |
| fmt/91    | Scalable Vector Graphics      | 1.0           |    10 |
| x-fmt/111 | Plain Text                    |               |     1 |
| x-fmt/392 | JP2 (JPEG 2000 part 1)        |               |    10 |
+-----------+-------------------------------+---------------+-------+
14 rows in set (0.00 sec)

Return files without ID in the DB

SELECT Files.fileUUID, Files.checksum, Files.currentLocation
FROM  Files
WHERE Files.fileGrpUse = "original"
AND   Files.fileUUID NOT IN (SELECT FilesIDs.fileUUID FROM FilesIDs)
+--------------------------------------+------------------------------------------------------------------+-----------------------------------------+
| fileUUID                             | checksum                                                         | currentLocation                         |
+--------------------------------------+------------------------------------------------------------------+-----------------------------------------+
| 189c4526-3421-42a8-bb44-838e7a70a107 | 7193cfad92ea2f22c20061c6db2224b9d8ab2eff94e17a7aa669e1d32a34d307 | %SIPDirectory%objects/cassette.format   |
| 39e3e217-dae4-42a3-aa5b-890781811210 | e36dd8438ed6b2432aee806199681583d403c8ef857a58bc6cf2fb72f61156fb | %SIPDirectory%objects/caboose.format    |
| 594be7c6-9ea6-474f-9729-dd20d0a21a0f | f7b75fb84e81792c98f62cd637a65dab560604dcd602e8efe2a3ddf967ed2a62 | %SIPDirectory%objects/looseleaf.format  |
| 6035fc16-05da-4f2a-8bf7-f37868fcac32 | 172c631afc1adffebe3d793eb1f3558aeb802d00181fd15215bdd0dbc96ee344 | %SIPDirectory%objects/debateable.format |
| 6f00f075-7f73-479f-ab3f-a408685d32d3 | ec1c269ad43ba6fd32f4096dd6c391fa8f9873fbe7882480d5814836c29ed317 | %SIPDirectory%objects/baseball.format   |
| 8ea1bdca-071c-4b16-bf4e-c7c381783c2b | e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 | %SIPDirectory%objects/zero-bytes.jpg    |
| 97e8cbd0-bdb8-4075-a6cc-e9e0ae47b138 | e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855 | %SIPDirectory%objects/zero-bytes        |
+--------------------------------------+------------------------------------------------------------------+-----------------------------------------+
7 rows in set (0.00 sec)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment