Prefetch pnc

[MohammadiIram]

No description provided.

[MohammadiIram]

@kosciCZ Could you please review the PR?

[kosciCZ]

Here you'd put in the files you need, these are just examples.

• download_url is the url the files is available from
• target is optional and specifies a subpath the file will be saved as. If not defined, it will be derived from the url
• checksums is a list of pairs of algorithm and hash, that is necessary to verify file identity

[MohammadiIram]

I see. Could you please let me know which files you’re referring to here?

[kosciCZ]

Those would be the files that you download from the internet during the build, which would violate the hermetic build condition. Having a brief look into your Dockerfile, I would say it's these files

[MohammadiIram]

should it be this one: https://github.com/red-hat-data-services/RHOAI-Build-Config/blob/rhoai-2.16/trustyai-pig-builds/build-config.yaml or https://gitlab.cee.redhat.com/project-ncl/utils.git as we have updated tekton file for PNC https://github.com/red-hat-data-services/trustyai-explainability/blob/rhoai-2.16/.tekton/odh-trustyai-service-v2-16-push.yaml#L284C4-L392C1

[kosciCZ]

Also, please also follow step 6 here to enable dev package managers (generic package fetcher still has just experimental support)

[MohammadiIram]

task prefetch-dependencies has the status "Failed":
Error: InvalidInput: 1 validation error for user input
packages -> 0
  Input tag 'generic' found using 'type' does not match any of the expected tags: 'bundler', 'gomod', 'npm', 'pip', 'rpm', 'yarn'

@kosciCZ I see this error during the pipeline run, any idea what could be added for generic fetcher to prefetch type

[kosciCZ]

@MohammadiIram that's gonna be the developer flag, see my other comment

[MohammadiIram]

Also, please also follow step 6 here to enable dev package managers (generic package fetcher still has just experimental support)

yeah, i will add the rpms.in.yaml, but for generic fetcher what can we add the type?

[MohammadiIram]

@kosciCZ Ay idea why do we need ["./fedora.repo"] we would want upi.repo

Something like this will be the rpms.in.yaml

contentOrigin:
  repofiles:
    - ubi.repo
packages:
  - unzip
  - jq
  - wget

[MohammadiIram]

@kosciCZ Could we merge this PR and look what we find in the pipeline run?

[kosciCZ]

Also, please also follow step 6 here to enable dev package managers (generic package fetcher still has just experimental support)

yeah, i will add the rpms.in.yaml, but for generic fetcher what can we add the type?

You can specify a json array like this: [{"path": ".", "type": "rpm"}, {"path": ".", "type": "generic"}]

[MohammadiIram]

task prefetch-dependencies has the status "Failed":
Error: InvalidInput: 1 validation error for user input
packages -> 0
Input tag 'generic' found using 'type' does not match any of the expected tags: 'bundler', 'gomod', 'npm', 'pip', 'rpm', 'yarn'

yeah, but that is not supported i guess we hit this error

task prefetch-dependencies has the status "Failed":
Error: InvalidInput: 1 validation error for user input
packages -> 0
  Input tag 'generic' found using 'type' does not match any of the expected tags: 'bundler', 'gomod', 'npm', 'pip', 'rpm', 'yarn'

[kosciCZ]

It should be supported now that you added the "dev-package-managers" flag

[MohammadiIram]

It should be supported now that you added the "dev-package-managers" flag

Added, but still i see same error https://github.com/red-hat-data-services/trustyai-explainability/pull/44/checks?check_run_id=32322784387

[kosciCZ]

It is possible that the prefetch task is fixed to the previous version of cachi2. Could you please try updating the reference from

quay.io/konflux-ci/tekton-catalog/task-prefetch-dependencies:0.1@sha256:fe7234e3824d1e65d6a7aac352e7a6bbce623d90d8d7da9aceeee108ad2c61be

to

quay.io/konflux-ci/tekton-catalog/task-prefetch-dependencies:0.1@sha256:17b60ada3c2adb88fc2af6964cc73d386b41c235424c815f8e21f9b01a34a4f5

[kosciCZ]

Also, you should update the Dockerfile to remove the ARG PNC_FILES_JSON and you don't need the jq and wget deps (can be removed from Dockerfile and the rpms.in.yaml/rpms.lock.yaml)

[MohammadiIram]

It is possible that the prefetch task is fixed to the previous version of cachi2. Could you please try updating the reference from

quay.io/konflux-ci/tekton-catalog/task-prefetch-dependencies:0.1@sha256:fe7234e3824d1e65d6a7aac352e7a6bbce623d90d8d7da9aceeee108ad2c61be

to

quay.io/konflux-ci/tekton-catalog/task-prefetch-dependencies:0.1@sha256:17b60ada3c2adb88fc2af6964cc73d386b41c235424c815f8e21f9b01a34a4f5

After updating i see this

Task Statuses:
Pipeline rhoai-tenant/odh-trustyai-service-v2-16-on-pull-request-b88gg can't be Run; it contains Tasks that don't exist: Couldn't retrieve Task "resolver type bundles\nname = prefetch-dependencies\n": error requesting remote resource: error getting "bundleresolver" "rhoai-tenant/bundles-1c2b8a693f3a93dfd98b741fedd6b54a": cannot retrieve the oci image: GET https://quay.io/v2/konflux-ci/tekton-catalog/task-prefetch-dependencies/manifests/sha256:17b60ada3c2adb88fc2af6964cc73d386b41c235424c815f8e21f9b01a34a4f5: MANIFEST_UNKNOWN: manifest unknown; map[]

[MohammadiIram]

@kosciCZ I also tried to update it with the latest digest which is sha256:3be04adda63fc843db5eea837cabe33317a6d4f378c559de0c7ef888103e7fd4
the latest run still says https://github.com/red-hat-data-services/trustyai-explainability/pull/44/checks?check_run_id=32332061259

Error: InvalidInput: 1 validation error for user input
packages -> 1
Input tag 'generic' found using 'type' does not match any of the expected tags: 'bundler', 'gomod', 'npm', 'pip', 'rpm', 'yarn'

[MohammadiIram]

@kosciCZ I still see same error with prefetch-task

https://konflux.apps.stone-prod-p02.hjvn.p1.openshiftapps.com/application-pipeline/workspaces/rhoai/applications/rhoai-v2-16/pipelineruns/odh-trustyai-service-v2-16-on-pull-request-ctdhd/logs?task=pnc-cli-build