Failing tests, flaky tests, and other improvements

Tests that fail 100% of the time (75)

Resolution: Research and resolve

Average age: 58.8d, Avg wait: 0.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
12697 Frequent test failures of `TestFunctional/parallel/AddonsCmd` 7d 1h
priority/backlog
kind/failing-test
similar
12682 Frequent test failures of `TestPause/serial/VerifyDeletedResources` 9d 1h
priority/backlog
kind/failing-test
12660 Frequent test failures of `TestErrorSpam/setup` 12d 1h
priority/backlog
kind/failing-test
12639 Frequent test failures of `TestStartStop/group/no-preload/serial/FirstStart` 17d 1h
priority/backlog
kind/failing-test
similar
12631 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/DeployApp` 18d 1h
priority/backlog
kind/failing-test
similar
12630 Frequent test failures of `TestNetworkPlugins/group/auto/Start` 18d 1h
priority/backlog
kind/failing-test
similar
12629 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/AccessDirect` 18d 1h
priority/backlog
kind/failing-test
similar
12628 Frequent test failures of `TestFunctional/parallel/StatusCmd` 18d 1h
priority/backlog
kind/failing-test
similar
12625 Frequent test failures of `TestFunctional/parallel/Version/short` 19d 1h
priority/backlog
kind/failing-test
similar
12624 Frequent test failures of `TestFunctional/parallel/MountCmd/specific-port` 19d 1h
priority/backlog
kind/failing-test
similar
12621 Frequent test failures of `TestMultiNode/serial/RestartKeepsNodes` 19d 1h
priority/backlog
kind/failing-test
similar
12620 Frequent test failures of `TestFunctional/parallel/InternationalLanguage` 19d 1h
priority/backlog
kind/failing-test
similar
12619 Frequent test failures of `TestFunctional/parallel/DryRun` 19d 1h
priority/backlog
kind/failing-test
similar
12611 Frequent test failures of `TestPause/serial/Start` 2wk 1h
priority/backlog
kind/failing-test
similar
12610 Frequent test failures of `TestPause/serial/SecondStartNoReconfiguration` 2wk 1h
priority/backlog
kind/failing-test
similar
12609 Frequent test failures of `TestMultiNode/serial/StopNode` 2wk 1h
priority/backlog
kind/failing-test
similar
12608 Frequent test failures of `TestMultiNode/serial/StartAfterStop` 2wk 1h
priority/backlog
kind/failing-test
similar
12607 Frequent test failures of `TestMultiNode/serial/ProfileList` 2wk 1h
priority/backlog
kind/failing-test
similar
12606 Frequent test failures of `TestMultiNode/serial/FreshStart2Nodes` 2wk 1h
priority/backlog
kind/failing-test
similar
12605 Frequent test failures of `TestMultiNode/serial/AddNode` 2wk 1h
priority/backlog
kind/failing-test
similar
12604 Frequent test failures of `TestJSONOutput/start/Command` 2wk 1h
priority/backlog
kind/failing-test
similar
12603 Frequent test failures of `TestJSONOutput/start/Audit` 2wk 1h
priority/backlog
kind/failing-test
similar
12602 Frequent test failures of `TestFunctional/serial/StartWithProxy` 2wk 1h
priority/backlog
kind/failing-test
similar
12601 Frequent test failures of `TestFunctional/serial/SoftStart` 2wk 1h
priority/backlog
kind/failing-test
similar
12600 Frequent test failures of `TestFunctional/serial/ExtraConfig` 2wk 1h
priority/backlog
kind/failing-test
similar
12599 Frequent test failures of `TestFunctional/parallel/Version/components` 2wk 1h
priority/backlog
kind/failing-test
similar
12598 Frequent test failures of `TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster` 2wk 1h
priority/backlog
kind/failing-test
similar
12597 Frequent test failures of `TestFunctional/parallel/UpdateContextCmd/no_clusters` 2wk 1h
priority/backlog
kind/failing-test
similar
12596 Frequent test failures of `TestFunctional/parallel/UpdateContextCmd/no_changes` 2wk 1h
priority/backlog
kind/failing-test
similar
12595 Frequent test failures of `TestFunctional/parallel/DashboardCmd` 2wk 1h
priority/backlog
kind/failing-test
similar
12573 Frequent test failures of `TestFunctional/parallel/PersistentVolumeClaim` 3wk 1h
priority/backlog
kind/failing-test
similar
12527 Frequent test failures of `TestFunctional/parallel/ImageCommands/ImageLoadFromFile` 4wk 1h
priority/backlog
kind/failing-test
similar
12525 Frequent test failures of `TestFunctional/parallel/ImageCommands/ImageList` 4wk 1h
priority/backlog
kind/failing-test
similar
12524 Frequent test failures of `TestFunctional/parallel/ImageCommands/ImageBuild` 4wk 1h
priority/backlog
kind/failing-test
similar
12513 Frequent test failures of `TestFunctional/parallel/UpdateContextCmd` 4wk 1h
priority/backlog
kind/failing-test
similar
12400 Frequent test failures of `TestFunctional/parallel/MountCmd/any-port` 6wk 1h 4wk
priority/backlog
kind/failing-test
commented
member-last
send
similar
12340 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/Pause` 7wk 1h
priority/backlog
kind/failing-test
similar
12306 Frequent test failures of `TestNetworkPlugins/group/kindnet/Start` 2mo 1h
priority/backlog
kind/failing-test
similar
12296 Frequent test failures of `TestAddons/Setup` 2mo 1h
priority/backlog
kind/failing-test
similar
12290 Frequent test failures of `TestStoppedBinaryUpgrade/Upgrade` 2mo 1h
priority/backlog
kind/failing-test
similar
12289 Frequent test failures of `TestStoppedBinaryUpgrade/MinikubeLogs` 2mo 1h
priority/backlog
kind/failing-test
similar
12287 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup` 2mo 1h
priority/backlog
kind/failing-test
similar
12285 Frequent test failures of `TestScheduledStopUnix` 2mo 1h
priority/backlog
kind/failing-test
12284 TestPause/serial/Pause failing 2mo 7wk 2mo
priority/important-longterm
kind/failing-test
commented
member-last
12269 Frequent test failures of `TestNetworkPlugins/group/enable-default-cni/DNS` 2mo 1h
priority/backlog
kind/failing-test
similar
12235 Frequent test failures of `TestNetworkPlugins/group/custom-weave/Start` 2mo 1h
priority/backlog
kind/failing-test
similar
12226 Frequent test failures of `TestNetworkPlugins/group/kubenet/DNS` 2mo 1h
priority/backlog
kind/failing-test
similar
12225 Frequent test failures of `TestNetworkPlugins/group/kindnet/DNS` 2mo 1h
priority/backlog
kind/failing-test
similar
12222 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop` 2mo 1h
priority/backlog
kind/failing-test
similar
12221 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/SecondStart` 2mo 1h
priority/backlog
kind/failing-test
similar
12220 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop` 2mo 1h
priority/backlog
kind/failing-test
similar
12218 Frequent test failures of `TestRunningBinaryUpgrade` 2mo 1h
priority/backlog
kind/failing-test
similar
12217 Frequent test failures of `TestPreload` 2mo 1h
priority/backlog
kind/failing-test
similar
12213 Frequent test failures of `TestNetworkPlugins/group/cilium/Start` 2mo 1h
priority/backlog
kind/failing-test
similar
12212 Frequent test failures of `TestNetworkPlugins/group/calico/Start` 2mo 1h
priority/backlog
kind/failing-test
similar
12211 Frequent test failures of `TestNetworkPlugins/group/bridge/Start` 2mo 1h
priority/backlog
kind/failing-test
similar
12210 Frequent test failures of `TestNetworkPlugins/group/bridge/DNS` 2mo 1h
priority/backlog
kind/failing-test
similar
12209 Frequent test failures of `TestMultiNode/serial/PingHostFrom2Pods` 2mo 1h
priority/backlog
kind/failing-test
similar
12208 Frequent test failures of `TestMultiNode/serial/DeployApp2Nodes` 2mo 1h
priority/backlog
kind/failing-test
member-last
similar
12207 Frequent test failures of `TestMissingContainerUpgrade` 2mo 1h
priority/backlog
kind/failing-test
12202 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil` 2mo 1h
priority/backlog
kind/failing-test
similar
12201 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig` 2mo 1h
priority/backlog
kind/failing-test
similar
12200 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS` 2mo 1h
priority/backlog
kind/failing-test
similar
12199 Frequent test failures of `TestFunctional/parallel/ServiceCmd` 2mo 1h
priority/backlog
kind/failing-test
similar
12194 Frequent test failures of `TestDownloadOnly/v1.14.0/preload-exists` 2mo 1h
priority/backlog
kind/failing-test
similar
12193 Frequent test failures of `TestDownloadOnlyKic` 2mo 1h
priority/backlog
kind/failing-test
similar
12192 Frequent test failures of `TestCertOptions` 2mo 1h
priority/backlog
kind/failing-test
12191 Frequent test failures of `TestAddons/parallel/Registry` 2mo 1h
priority/backlog
kind/failing-test
similar
12190 Frequent test failures of `TestAddons/parallel/Olm` 2mo 1h
priority/backlog
kind/failing-test
similar
12189 Frequent test failures of `TestAddons/parallel/Ingress` 2mo 1h
priority/backlog
kind/failing-test
similar
11839 TestRunningBinaryUpgrade: 3mo 5wk
priority/important-longterm
kind/flake
kind/failing-test
similar
11735 document all "docker Arm64" integration failed test 3mo 4wk
priority/important-longterm
lifecycle/stale
kind/failing-test
arch/arm64
10128 Flaky TestFunctional/parallel: NodeLabels, ComponentHealth: connection refused 9mo 6wk 3mo
help wanted
priority/important-longterm
kind/flake
kind/failing-test
commented
member-last
open-milestone
send
9623 flake TestStartStop: "Second Start" fails on "Error: No such network" 11mo 4wk
priority/backlog
lifecycle/frozen
kind/failing-test
8303 Fix validateMountCmd functional test on windows 1y 5mo
help wanted
priority/backlog
lifecycle/frozen
kind/failing-test

Tests that fail some of the time (4)

Resolution: Research and resolve

Average age: 183.7d, Avg wait: 0.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
11615 [flake test] TestStartStop/group/old-k8s-version/serial/Pause - "sudo systemctl disable kubelet" failed 4mo 5d 4mo
area/testing
priority/important-longterm
lifecycle/rotten
kind/flake
commented
similar
11614 [flake test] TestStartStop/group/old-k8s-version/serial/Pause - Executing: /lib/systemd/systemd-sysv-install disable kubelet" 4mo 5d
area/testing
priority/important-longterm
lifecycle/rotten
kind/flake
similar
11442 Test Flake: "TestFunctional/parallel/LogsCmd" 5mo 5d 4mo
area/testing
priority/important-longterm
kind/flake
assigned
assignee-updated
commented
contributor-last
open-milestone
pr-approved
9839 TestScheduledStopUnix flake: process 14245 running but should have been killed on reschedule 10mo 3mo 10mo
priority/important-longterm
lifecycle/frozen
kind/flake
commented
send

Other testing related issues (15)

Resolution: Research and resolve

Average age: 334.2d, Avg wait: 6.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
12456 request: cgroup v2 CI infra (for testing Rootless Docker driver) 5wk 3wk 3wk
area/testing
priority/important-soon
kind/process
assigned
assignee-updated
commented
member-last
open-milestone
send
12436 Need some more regression tests for image build
5wk 5wk
kind/feature
area/testing
priority/important-longterm
12004 Docker_Linux_containerd_arm64 integration tests broken
3mo 2mo 3mo
kind/bug
area/testing
priority/backlog
assigned
assignee-updated
pr-closed
recv
11890 Add integration test in TestPause to ensure `namespace` flag works 3mo 18d
area/testing
priority/important-longterm
lifecycle/stale
kind/improvement
assigned
assignee-updated
pr-merged
pr-reviewed-with-comment
11571 add detailed info about what each integration test is doing to the site
4mo 2mo
kind/documentation
area/testing
priority/important-longterm
good first issue
assigned
assignee-updated
contributor-last
pr-merged
recv-q
10790 Add addon registry build integration test
7mo 2mo 2mo
area/testing
priority/important-longterm
lifecycle/frozen
kind/process
commented
member-last
pr-closed
similar
10593 Add integration test for a VM changing IP and cert not working 7mo 3wk 5mo
co/hyperv
area/testing
priority/important-longterm
lifecycle/frozen
kind/process
commented
send
10451 Add more complex integration tests for `minikube image load`
2
8mo 5d 5d
help wanted
kind/feature
area/testing
priority/important-longterm
lifecycle/frozen
good first issue
assigned
assignee-updated
commented
member-last
pr-changes-requested
send
10144 Some integration tests are disabled on linux/arm64
9mo 5h 5mo
kind/bug
area/testing
priority/important-longterm
arch/arm64
commented
open-milestone
pr-merged
send
9397 Add --delete-on-failure integration test if existing config references unusable driver 1y 1d 8mo
kind/feature
area/testing
priority/important-longterm
lifecycle/stale
ux/embedded
assigned
assignee-updated
commented
open-milestone
recv-q
send
8304 Fix Tunnel AccessDirect test on windows
1y 7mo
help wanted
area/testing
priority/backlog
lifecycle/frozen
kind/cleanup
pr-closed
7733 add integration test for registry addon for non-linux kics 2y 8mo 11mo
area/testing
area/addons
priority/backlog
lifecycle/frozen
kind/process
commented
member-last
send
similar
7019 improve preload integration test to use minikube docker env 2y 1y
area/testing
priority/backlog
lifecycle/frozen
kind/cleanup
co/preload
6922 add integration test for ingress addon 2y 9mo 1y
help wanted
area/testing
priority/backlog
lifecycle/frozen
kind/cleanup
commented
member-last
send
similar
3552 Add CI testing for Fedora & CentOS
2y 4mo 8mo
area/testing
priority/backlog
lifecycle/frozen
kind/process
commented
member-last
send
Triage Party v1.4.0-beta.3