harvest.log summary numbers not consistent with number of expected files

[plawton-umd]

Checked for duplicates

Yes - I've already checked

🐛 Describe the bug

When I ran harvest on a new bundle, I noticed the summary numbers were not consistent with the available files.

🕵️ Expected behavior

I expected the available file to equal

• the number of "Loaded files" plus the number of "Failed files" OR
• the number of "Loaded files" plus the number of "Failed files" plus the number of "Skipped files"

📜 To Reproduce

1. If you want to try the same bundle, it is available at https://pdssbn.astro.umd.edu/holdings/pds4-dart-v1.0/. The collections have gzipped tar files available for download in data_dracocal/SUPPORT/DOWNLOAD/, data_dracoraw/SUPPORT/DOWNLOAD/, and document_draco/SUPPORT/DOWNLOAD/.

🖥 Environment Info

• Version of this software 3.8.2
• Operating System: Linux

🩺 Test Data / Additional context

See above

🦄 Related requirements

Tightly coupled with

• harvest.log summary not correct #149
• harvest.log summary does not agree with OpenSearch counts #147

[tloubrieu-jpl]

Hi @al-niessner ,

Could the fix made on NASA-PDS/registry-mgr#116 also help here ?