Failing tests, flaky tests, and other improvements

Tests that fail 100% of the time (25)

Resolution: Research and resolve

Average age: 60.4d, Avg wait: 2.3d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
10674 Fix containerd Timeout Test failure 9h 9h
kind/failing-test
priority/important-soon
assigned
open-milestone
10640 Flake Test: TestMultiNode/serial/RestartMultiNode: node X has unwanted condition "Ready" : Reason "NodeStatusUnknown" Message: "Kubelet stopped posting node status.". will try. 3d 5h 5h
help wanted
kind/failing-test
kind/flake
priority/important-soon
assigned
assignee-updated
commented
member-last
open-milestone
10628 Failing test: TestErrorSpam on Windows Docker 4d 9h
co/docker-driver
help wanted
kind/failing-test
os/windows
priority/important-soon
open-milestone
similar
10627 Failing test: TestFunctional/DockerEnv on Windows Docker 4d 9h
co/docker-driver
help wanted
kind/failing-test
os/windows
priority/important-soon
open-milestone
10626 Failing test: TestForceSystemdFlag on Windows Docker 4d 9h 4d
co/docker-driver
help wanted
kind/failing-test
os/windows
priority/important-soon
commented
member-last
open-milestone
send
similar
10625 Failing test: TestForceSystemdEnv on Windows Docker 4d 9h
co/docker-driver
help wanted
kind/failing-test
os/windows
priority/important-soon
open-milestone
similar
10624 Failing test: TestDockerFlag on Windows Docker 4d 9h
co/docker-driver
help wanted
kind/failing-test
os/windows
priority/important-soon
open-milestone
similar
10622 Failing test: TestCertOptions on Windows Docker 4d 9h 9h
co/docker-driver
help wanted
kind/failing-test
os/windows
priority/important-soon
commented
member-last
open-milestone
send
10591 Fix TestJSONOutput/start/parallel/DistinctCurrentSteps & IncreasingCurrentSteps tests failing 5d 3d 5d
area/testing
kind/failing-test
priority/important-soon
assigned
assignee-updated
commented
member-last
open-milestone
pr-new-commits
10492 Stabilize TestFunctional/parallel/DockerEnv integration test 13d 3d 3d
kind/failing-test
kind/flake
priority/important-soon
commented
member-last
send
10403 Run full integration suite on linux ARM64 3wk 7d 3wk
arch/arm64
kind/failing-test
priority/important-soon
assigned
assignee-updated
commented
member-last
open-milestone
10377 Fix TestFunctional/parallel/TunnelCmd/serial/WaitService flake 3wk 11d
kind/failing-test
kind/flake
priority/important-soon
contributor-last
recv-q
similar
10376 Fix TestFunctional/parallel/TunnelCmd/serial/AccessDirect test 3wk 11d
kind/failing-test
kind/flake
priority/important-soon
contributor-last
similar
10292 Flaky tests: docker.sock: connect: permission denied 4wk 3wk 3wk
kind/failing-test
kind/flake
priority/important-soon
assigned
assignee-updated
commented
contributor-last
recv
10133 Flake TestPause/serial/Pause: kubelet Default-Start contains no runlevels, aborting
6wk 5wk
help wanted
kind/failing-test
kind/flake
priority/important-soon
pr-merged
10128 Flaky TestFunctional/parallel: NodeLabels, ComponentHealth: connection refused 6wk 4wk 5wk
help wanted
kind/failing-test
kind/flake
priority/important-soon
commented
contributor-last
recv
similar
10113 Flake TestFunctional/parallel/ComponentHealth" bind: address already in use 7wk 5wk
help wanted
kind/failing-test
kind/flake
priority/important-soon
similar
9839 TestScheduledStopUnix flake: process 14245 running but should have been killed on reschedule 2mo 6d 2mo
kind/failing-test
kind/flake
priority/important-longterm
commented
member-last
send
9795 Unit test TestDeleteAllProfiles fails: delete_test.go:203: ListProfiles length = 9, expected 8 3mo 2mo 2mo
kind/failing-test
priority/backlog
commented
member-last
send
9785 "TestFunctional/parallel/DryRun" fails on HyperV github action tests 3mo 5d 5d
kind/failing-test
priority/important-soon
assigned
assignee-updated
commented
member-last
pr-unreviewed
9654 TestSkaffold Failure: 'The server probably has client authentication (--tlsverify) enabled'
3mo 5wk 3mo
kind/failing-test
priority/important-longterm
commented
member-last
pr-closed
send
9623 flake TestStartStop: "Second Start" fails on "Error: No such network" 3mo 5wk
kind/failing-test
priority/important-longterm
9568 TestPause times out on github action ubuntu agents 4mo 2mo
kind/failing-test
priority/important-longterm
pr-reviewed-with-comment
pr-unreviewed
8303 Fix validateMountCmd functional test on windows 9mo 7wk
help wanted
kind/failing-test
lifecycle/frozen
priority/important-longterm
8013 TestFunctional/parallel/ServiceCmd flake: GET http://172.17.0.3:30602 giving up after 5 attempts
10mo 2mo 7mo
kind/failing-test
kind/flake
priority/important-longterm
commented
member-last
pr-merged

Tests that fail some of the time (3)

Resolution: Research and resolve

Average age: 104.6d, Avg wait: 0.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
9827 TestFunctional/parallel/DockerEnv: healthz reason Forbidden 2mo 6d
kind/flake
priority/important-longterm
9652 Flake Test: TestPause/serial/SecondStartNoReconfiguration 3mo 5wk
kind/flake
priority/important-longterm
9650 The debian ISO build machine is crashing when running buildroot 3mo 5wk 3mo
area/build-release
area/testing
kind/bug
kind/flake
priority/important-longterm
commented
member-last

Other testing related issues (19)

Resolution: Research and resolve

Average age: 166.6d, Avg wait: 0.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
10600 TryMacStudio VMs for integration tests 5d 3d
area/testing
kind/feature
priority/important-soon
assigned
open-milestone
10591 Fix TestJSONOutput/start/parallel/DistinctCurrentSteps & IncreasingCurrentSteps tests failing 5d 3d 5d
area/testing
kind/failing-test
priority/important-soon
assigned
assignee-updated
commented
member-last
open-milestone
pr-new-commits
10555 investigate running minikube inside a pod 8d 3d
area/testing
kind/feature
priority/important-soon
assigned
open-milestone
10451 Add more complex integration tests for `minikube image load` 18d 6d 6d
area/testing
good first issue
help wanted
kind/feature
priority/important-soon
assigned
assignee-updated
commented
contributor-last
10334 Run Debian 9 baremetal and docker integration tests on PRs with ok-to-test label 4wk 11h 3wk
area/testing
co/docker-driver
kind/process
os/linux
priority/important-soon
assigned
assignee-updated
commented
member-last
open-milestone
10231 Add validatePodmanEnv subtest for crio runtime to TestFunctional 5wk 5wk
area/testing
co/runtime/crio
kind/feature
priority/important-longterm
10181 Add clean up job for GitHub Action runner hosts 5wk 5wk
area/testing
kind/cleanup
priority/important-soon
10140 Add gopogh to scheduled stop windows github actions test 6wk 5wk
area/testing
kind/feature
priority/important-soon
10089 Add functional test for older versions of Ubuntu on GitHub Actions 1mo 3wk 3wk
area/testing
co/docker-driver
co/podman-driver
help wanted
kind/feature
os/linux
priority/important-longterm
commented
member-last
send
10057 Run functional test and measure on windows GCP 2mo 7wk 2mo
area/testing
kind/cleanup
priority/backlog
assigned
assignee-updated
commented
member-last
send
9925 add multinode integration test two pods should get two different ips on different nodes
2mo 9d 2wk
area/testing
kind/feature
priority/important-soon
assigned
assignee-updated
commented
contributor-last
pr-changes-requested
recv-q
9581 Some TestMirrorCountry unit tests take a very long time to run 4mo 7h 11d
area/testing
kind/bug
priority/important-soon
commented
member-last
open-milestone
send
9397 Add --delete-on-failure integration test if existing config references unusable driver 4mo 6h 3wk
area/testing
kind/feature
priority/important-soon
ux/embedded
assigned
assignee-updated
commented
contributor-last
open-milestone
send
8304 Fix Tunnel AccessDirect test on windows
9mo 6d
area/testing
help wanted
kind/cleanup
lifecycle/frozen
priority/backlog
pr-closed
7733 add integration test for registry addon for non-linux kics 10mo 12d 4mo
area/addons
area/testing
kind/process
lifecycle/frozen
priority/backlog
commented
member-last
send
7019 improve preload integration test to use minikube docker env 11mo 7mo
area/testing
co/preload
kind/cleanup
lifecycle/frozen
priority/backlog
6922 add integration test for ingress addon 1y 2mo 7mo
area/testing
help wanted
kind/cleanup
lifecycle/frozen
priority/backlog
commented
member-last
send
6280 Request: add arm64 machine to CI
1y 12d 2mo
area/testing
kind/process
priority/important-soon
assigned
commented
member-last
open-milestone
send
3552 Add CI testing for Fedora & CentOS
2y 11d 11d
area/testing
kind/process
lifecycle/frozen
priority/important-longterm
commented
member-last
send
Triage Party v1.4.0-beta.1