Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

aws msk configs for hmda-platform #4914

Draft
wants to merge 31 commits into
base: master
Choose a base branch
from
Draft

aws msk configs for hmda-platform #4914

wants to merge 31 commits into from

Commits on Aug 1, 2024

  1. Update build.sbt 

    add msk package
    @zencircle
    zencircle authored Aug 1, 2024
    Configuration menu
    Copy the full SHA
    5cf31bb View commit details
    Browse the repository at this point in the history

  2. Update Dependencies.scala 

    add msk maven package
    @zencircle
    zencircle authored Aug 1, 2024
    Configuration menu
    Copy the full SHA
    30964ba View commit details
    Browse the repository at this point in the history

  3. Update build.sbt

    @zencircle
    zencircle authored Aug 1, 2024
    Configuration menu
    Copy the full SHA
    883bf4e View commit details
    Browse the repository at this point in the history

  4. Update persistence.conf 

    add sasl configuration to point to MSK
    @zencircle
    zencircle authored Aug 1, 2024
    Configuration menu
    Copy the full SHA
    4c959da View commit details
    Browse the repository at this point in the history

  5. Update KafkaUtils.scala

    @zencircle
    zencircle authored Aug 1, 2024
    Configuration menu
    Copy the full SHA
    7430876 View commit details
    Browse the repository at this point in the history

  6. Update Dependencies.scala 

    https://www.scala-sbt.org/1.x/docs/Library-Dependencies.html#Getting+the+right+Scala+version+with i
    @zencircle
    zencircle authored Aug 1, 2024
    Configuration menu
    Copy the full SHA
    13da838 View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2024

  1. Update Dependencies.scala 

    remove test
    @zencircle
    zencircle authored Aug 3, 2024
    Configuration menu
    Copy the full SHA
    fa91acb View commit details
    Browse the repository at this point in the history

  2. Update KafkaUtils.scala 

    add sasl mechanism and handler class
    @zencircle
    zencircle authored Aug 3, 2024
    Configuration menu
    Copy the full SHA
    eee4aa2 View commit details
    Browse the repository at this point in the history

  3. Update persistence.conf

    @zencircle
    zencircle authored Aug 3, 2024
    Configuration menu
    Copy the full SHA
    fd54652 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Update KafkaUtils.scala 

    remove ssl settings, add sasl config
    @zencircle
    zencircle authored Sep 13, 2024
    Configuration menu
    Copy the full SHA
    26f0b38 View commit details
    Browse the repository at this point in the history

  2. Update persistence.conf 

    add msk module and class path
    @zencircle
    zencircle authored Sep 13, 2024
    Configuration menu
    Copy the full SHA
    c777902 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Update KafkaUtils.scala 

    remove private to allow access from hmda analytics
    @zencircle
    zencircle authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    cd46b87 View commit details
    Browse the repository at this point in the history

  2. Update HmdaAnalyticsApp.scala 

    add msk consumer settings
    @zencircle
    zencircle authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    f751b37 View commit details
    Browse the repository at this point in the history

  3. Update IrsPublisherApp.scala 

    add MSK config
    @zencircle
    zencircle authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    98c8d18 View commit details
    Browse the repository at this point in the history

  4. Update application.conf 

    typo compiling fails
    @zencircle
    zencircle authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    960aee4 View commit details
    Browse the repository at this point in the history

  5. Update application.conf 

    remove kafka configuration it already exists in persistence.conf
    @zencircle
    zencircle authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    a1f3241 View commit details
    Browse the repository at this point in the history

  6. Update ModifiedLarApp.scala 

    add MSK config for consumer
    @zencircle
    zencircle authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    b8125b8 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2024

  1. Update application.conf 

    remove kafka config irs-publisher since its included in persistence.conf
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    504afb2 View commit details
    Browse the repository at this point in the history

  2. Update application.conf 

    remove kafka config from hmda-analytics since it included in persistence.conf
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    dd2cc74 View commit details
    Browse the repository at this point in the history

  3. Update application.conf 

    remove kafka config in lieu of persistence.conf
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    e81328b View commit details
    Browse the repository at this point in the history

  4. Update HmdaInstitutionApi.scala 

    add kafka config SSL
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    3928aab View commit details
    Browse the repository at this point in the history

  5. Update build.sbt 

    workaround for IAMClientCallbackHandler could not be found error
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    7bff36b View commit details
    Browse the repository at this point in the history

  6. Update Stream.scala 

    add MSK configuration
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    0c05ae9 View commit details
    Browse the repository at this point in the history

  7. Update application.conf 

    Note in future this configuration can be merged with persistence.conf. Added for msk
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    fa534e0 View commit details
    Browse the repository at this point in the history

  8. Update application.conf 

    add MSK configuration
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    f34241e View commit details
    Browse the repository at this point in the history

  9. Update SubmissionErrorsApp.scala 

    add MSK consumer settings
    @zencircle
    zencircle authored Oct 9, 2024
    Configuration menu
    Copy the full SHA
    3eedacc View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. Update persistence.conf 

    fix the logic for plaintext configuration
    @zencircle
    zencircle authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    f4f0c6a View commit details
    Browse the repository at this point in the history

  2. Update KafkaUtils.scala 

    fix logic for security protocol, add produsettings for other objects
    @zencircle
    zencircle authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    38d0fa8 View commit details
    Browse the repository at this point in the history

  3. Update application.conf 

    fix logic for plaintext
    @zencircle
    zencircle authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    50b175f View commit details
    Browse the repository at this point in the history

  4. Update application.conf 

    fix logic for plaintext
    @zencircle
    zencircle authored Oct 10, 2024
    Configuration menu
    Copy the full SHA
    efa0fa7 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Update KafkaUtils.scala 

    fix the SASL setting
    @zencircle
    zencircle authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    142e996 View commit details
    Browse the repository at this point in the history