Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QA Epic: add more automated tests #359

Closed
9 tasks done
kravciak opened this issue May 19, 2023 · 0 comments
Closed
9 tasks done

QA Epic: add more automated tests #359

kravciak opened this issue May 19, 2023 · 0 comments
Assignees

Comments

@kravciak
Copy link
Collaborator

kravciak commented May 19, 2023

  • Policy servers #370

    • create new Policy Server (wait until it's active)
    • create new CA, A policy on this server
    • PS overview page
      • check PS is active
      • check it has 2 policies
      • check it uses the same image as default PS
    • PS details page
      • check it has 2 policies - 1 A, 1 CA policy
      • check all policies are active
    • delete policy server
    • check policy server and both policies are removed
    • check I can't create policy server with the same name
  • Cluster admission policies #371

    • Create CA policy:
      • can't create it without name | module
      • use default | custom PS (create it)
      • use mode: monitor | protect
      • use ignore rancher namespaces - yes | no
      • check users can't edit rules
    • After creation check CA policies landing page
      • status is active
      • mode, PS options are set as expected
      • in yaml are/aren't ignore namespaces as expected
    • Policy details page
      • check ignored namespaces
      • policyserver: default
  • Admission policies #372

    • same as CA policy plus check namespace
    • ignore rancher namespaces option should not be visible
  • Kubewarden Overview page #373

    • create PS, A, CA resources
    • check overview page shows increased numbers in (Monitor | Protect) modes
  • Additional policy checks #374

    • choose some CA & A policy for additional checks
    • Check that policy actually works (currently we just check it goes into active state)
    • check logs in monitor mode
    • check that request get denied in protect mode
    • check that namespaced (A) policy has effect on selected namespace, not others
  • Broken resources #375

    • add CA policy, A policy, PS with broken settings
    • check that overview page shows red flags
    • check that resource list pages (tables) show red flags
    • check that resource detail page shows red flags
  • Setup tracing as part of end-to-end testing #376

    • set up telemetry
    • create CA, A, PS
    • perform some action that would result in in log event
    • check telmetry shows that action on CA, A, PS

  • Add tableRow handler - Add TableRow class to manage table resources #367
    Most of our resources (policy servers, (cluster)admission policies) are displayed in sortable table.

    • Add a helper class allowing to get specific values from table, check, perform actions on them.
  • Rewrite policy tests to use POM #377
    Currently policy tests install all available policies 1 by 1 and check they get into active state.

    • use common base for Cluster Admission Policy as base for Admission Policy page.
    • move policy definitions and setup functions out of test file

Notes

  • does it make sense to show policy server pods as a number
  • can we auto-enable artifacthub?
  • test policies are signed / official
@jvanz jvanz added this to Kubewarden May 12, 2023
@kravciak kravciak converted this from a draft issue May 19, 2023
@kravciak kravciak self-assigned this May 19, 2023
@kravciak kravciak changed the title QA: add more automated tests QA Epic: add more automated tests May 23, 2023
@kravciak kravciak moved this from Todo to In Progress in Kubewarden May 25, 2023
@kravciak kravciak removed the status in Kubewarden May 29, 2023
@viccuad viccuad moved this to Todo in Kubewarden Jun 16, 2023
@kravciak kravciak closed this as completed Feb 6, 2024
@github-project-automation github-project-automation bot moved this from Todo to Done in Kubewarden Feb 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant