Read harvest auth credentials from AWS secret manager

[ramesh-maddegoda]

💡 Description

Currently harvest tool is reading auth credentials to connect OpenSearch from a configuration file in file system. Nucleus uses a dockerized version of harvest too. It is required to implement a way to read these harvest auth credentials from AWS Secret Manager.

⚔️ Parent Epic / Related Tickets

No response

[jordanpadams]

Status: Issues trying to access secrets manager. Potential issue with security boundary.

[ramesh-maddegoda]

I was able to implement this by reading Opensearch credentials from AWS secret manager and create a credential file inside the temporary docker container to be used by harvest.

The changes were added to the pull request #98