Failing tests, flaky tests, and other improvements

Tests that fail 100% of the time (55)

Resolution: Research and resolve

Average age: 56.9d, Avg wait: 0.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
12573 Frequent test failures of `TestFunctional/parallel/PersistentVolumeClaim` 1d 5h
priority/backlog
kind/failing-test
similar
12527 Frequent test failures of `TestFunctional/parallel/ImageCommands/ImageLoadFromFile` 5d 5h
priority/backlog
kind/failing-test
similar
12525 Frequent test failures of `TestFunctional/parallel/ImageCommands/ImageList` 5d 5h
priority/backlog
kind/failing-test
similar
12524 Frequent test failures of `TestFunctional/parallel/ImageCommands/ImageBuild` 5d 5h
priority/backlog
kind/failing-test
similar
12513 Frequent test failures of `TestFunctional/parallel/UpdateContextCmd` 7d 5h
priority/backlog
kind/failing-test
similar
12485 Frequent test failures of `TestAddons/serial/GCPAuth` 10d 5h
priority/backlog
kind/failing-test
similar
12468 Frequent test failures of `TestDebPackageInstall/install_amd64_ubuntu_20.10/kvm2-driver` 12d 5h
priority/backlog
kind/failing-test
similar
12466 Frequent test failures of `TestDebPackageInstall/install_amd64_ubuntu_18.04/kvm2-driver` 12d 5h
priority/backlog
kind/failing-test
similar
12453 Frequent test failures of `TestAddons/parallel/HelmTiller` 14d 5h
priority/backlog
kind/failing-test
similar
12452 Frequent test failures of `TestAddons/parallel/CSI` 14d 5h
priority/backlog
kind/failing-test
similar
12400 Frequent test failures of `TestFunctional/parallel/MountCmd/any-port` 3wk 5h 5d
priority/backlog
kind/failing-test
commented
member-last
send
similar
12356 Frequent test failures of `TestFunctional/parallel/SaveImage` 4wk 5h
priority/backlog
kind/failing-test
similar
12340 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/Pause` 4wk 13h
priority/backlog
kind/failing-test
similar
12306 Frequent test failures of `TestNetworkPlugins/group/kindnet/Start` 5wk 5h
priority/backlog
kind/failing-test
similar
12296 Frequent test failures of `TestAddons/Setup` 5wk 5h
priority/backlog
kind/failing-test
similar
12290 Frequent test failures of `TestStoppedBinaryUpgrade/Upgrade` 5wk 13h
priority/backlog
kind/failing-test
similar
12289 Frequent test failures of `TestStoppedBinaryUpgrade/MinikubeLogs` 5wk 13h
priority/backlog
kind/failing-test
similar
12287 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup` 5wk 5h
priority/backlog
kind/failing-test
similar
12285 Frequent test failures of `TestScheduledStopUnix` 5wk 5h
priority/backlog
kind/failing-test
12284 TestPause/serial/Pause failing 5wk 4wk 5wk
priority/important-longterm
kind/failing-test
commented
member-last
12269 Frequent test failures of `TestNetworkPlugins/group/enable-default-cni/DNS` 6wk 5h
priority/backlog
kind/failing-test
similar
12235 Frequent test failures of `TestNetworkPlugins/group/custom-weave/Start` 6wk 5h
priority/backlog
kind/failing-test
similar
12226 Frequent test failures of `TestNetworkPlugins/group/kubenet/DNS` 6wk 5h
priority/backlog
kind/failing-test
similar
12225 Frequent test failures of `TestNetworkPlugins/group/kindnet/DNS` 6wk 5h
priority/backlog
kind/failing-test
similar
12222 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop` 6wk 13h
priority/backlog
kind/failing-test
similar
12221 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/SecondStart` 6wk 13h
priority/backlog
kind/failing-test
similar
12220 Frequent test failures of `TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop` 6wk 5h
priority/backlog
kind/failing-test
similar
12219 Frequent test failures of `TestSkaffold` 6wk 5h
priority/backlog
kind/failing-test
12218 Frequent test failures of `TestRunningBinaryUpgrade` 6wk 5h
priority/backlog
kind/failing-test
similar
12217 Frequent test failures of `TestPreload` 6wk 5h
priority/backlog
kind/failing-test
similar
12216 Frequent test failures of `TestNetworkPlugins/group/kubenet/Start` 6wk 5h
priority/backlog
kind/failing-test
similar
12215 Frequent test failures of `TestNetworkPlugins/group/false/Start` 6wk 5h
priority/backlog
kind/failing-test
similar
12213 Frequent test failures of `TestNetworkPlugins/group/cilium/Start` 6wk 5h
priority/backlog
kind/failing-test
similar
12212 Frequent test failures of `TestNetworkPlugins/group/calico/Start` 6wk 5h
priority/backlog
kind/failing-test
similar
12211 Frequent test failures of `TestNetworkPlugins/group/bridge/Start` 6wk 5h
priority/backlog
kind/failing-test
similar
12210 Frequent test failures of `TestNetworkPlugins/group/bridge/DNS` 6wk 5h
priority/backlog
kind/failing-test
similar
12209 Frequent test failures of `TestMultiNode/serial/PingHostFrom2Pods` 6wk 5h
priority/backlog
kind/failing-test
12208 Frequent test failures of `TestMultiNode/serial/DeployApp2Nodes` 6wk 5h
priority/backlog
kind/failing-test
member-last
similar
12207 Frequent test failures of `TestMissingContainerUpgrade` 6wk 5h
priority/backlog
kind/failing-test
12202 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil` 6wk 5h
priority/backlog
kind/failing-test
similar
12201 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig` 6wk 5h
priority/backlog
kind/failing-test
similar
12200 Frequent test failures of `TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS` 6wk 5h
priority/backlog
kind/failing-test
similar
12194 Frequent test failures of `TestDownloadOnly/v1.14.0/preload-exists` 6wk 5h
priority/backlog
kind/failing-test
similar
12193 Frequent test failures of `TestDownloadOnlyKic` 6wk 5h
priority/backlog
kind/failing-test
similar
12192 Frequent test failures of `TestCertOptions` 6wk 5h
priority/backlog
kind/failing-test
similar
12191 Frequent test failures of `TestAddons/parallel/Registry` 6wk 5h
priority/backlog
kind/failing-test
similar
12190 Frequent test failures of `TestAddons/parallel/Olm` 6wk 5h
priority/backlog
kind/failing-test
similar
12189 Frequent test failures of `TestAddons/parallel/Ingress` 6wk 5h
priority/backlog
kind/failing-test
similar
12145 Fix `TestAddons/parallel/HelmTiller` failing to pull the image
7wk 7wk 7wk
area/addons
kind/failing-test
commented
member-last
pr-merged
send
similar
12128 Fix `TestStoppedBinaryUpgrade/MinikubeLogs` on Windows 7wk 10d 10d
os/windows
priority/important-soon
kind/failing-test
assigned
assignee-updated
commented
member-last
open-milestone
pr-new-commits
similar
11839 TestRunningBinaryUpgrade: 2mo 17d
priority/important-longterm
kind/flake
kind/failing-test
similar
11735 document all "docker Arm64" integration failed test 3mo 5d
priority/important-longterm
lifecycle/stale
kind/failing-test
arch/arm64
10128 Flaky TestFunctional/parallel: NodeLabels, ComponentHealth: connection refused 8mo 3wk 2mo
help wanted
priority/important-longterm
kind/flake
kind/failing-test
commented
member-last
open-milestone
send
9623 flake TestStartStop: "Second Start" fails on "Error: No such network" 10mo 11d
priority/backlog
lifecycle/frozen
kind/failing-test
8303 Fix validateMountCmd functional test on windows 1y 4mo
help wanted
priority/backlog
lifecycle/frozen
kind/failing-test

Tests that fail some of the time (4)

Resolution: Research and resolve

Average age: 161.5d, Avg wait: 0.0d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
11615 [flake test] TestStartStop/group/old-k8s-version/serial/Pause - "sudo systemctl disable kubelet" failed 3mo 12d 3mo
area/testing
priority/important-longterm
lifecycle/stale
kind/flake
commented
similar
11614 [flake test] TestStartStop/group/old-k8s-version/serial/Pause - Executing: /lib/systemd/systemd-sysv-install disable kubelet" 3mo 12d
area/testing
priority/important-longterm
lifecycle/stale
kind/flake
similar
11442 Test Flake: "TestFunctional/parallel/LogsCmd" 4mo 3wk 4mo
area/testing
priority/important-soon
kind/flake
assigned
assignee-updated
commented
contributor-last
open-milestone
pr-approved
9839 TestScheduledStopUnix flake: process 14245 running but should have been killed on reschedule 9mo 2mo 9mo
priority/important-longterm
lifecycle/frozen
kind/flake
commented
send

Other testing related issues (16)

Resolution: Research and resolve

Average age: 301.7d, Avg wait: 4.2d
ID Au Desc As Rea Cr Up Re Cmntrs Labels Tags
12456 request: cgroup v2 CI infra (for testing Rootless Docker driver) 13d 4d 4d
area/testing
priority/important-soon
kind/process
assigned
assignee-updated
commented
member-last
open-milestone
send
12436 Need some more regression tests for image build 18d 18d
kind/feature
area/testing
priority/important-longterm
12004 Docker_Linux_containerd_arm64 integration tests broken 2mo 1mo 2mo
kind/bug
area/testing
priority/backlog
assigned
assignee-updated
pr-unreviewed
recv
11890 Add integration test in TestPause to ensure `namespace` flag works 2mo 2mo
area/testing
priority/important-longterm
kind/improvement
assigned
assignee-updated
contributor-last
pr-merged
pr-reviewed-with-comment
11571 add detailed info about what each integration test is doing to the site 3mo 1mo
kind/documentation
area/testing
priority/important-longterm
good first issue
assigned
assignee-updated
pr-new-commits
recv-q
11272 Re-enable integration tests for HyperV
4mo 3wk 4mo
os/windows
co/hyperv
area/testing
priority/important-soon
kind/process
assigned
assignee-updated
commented
member-last
open-milestone
10790 Add addon registry build integration test
6mo 7wk 7wk
area/testing
priority/important-longterm
lifecycle/frozen
kind/process
commented
member-last
pr-closed
similar
10593 Add integration test for a VM changing IP and cert not working 7mo 4d 4mo
co/hyperv
area/testing
priority/important-longterm
lifecycle/frozen
kind/process
commented
send
10451 Add more complex integration tests for `minikube image load`
2
7mo 11d 7mo
help wanted
kind/feature
area/testing
priority/important-longterm
lifecycle/frozen
good first issue
assigned
assignee-updated
commented
pr-changes-requested
recv-q
10144 Some integration tests are disabled on linux/arm64
8mo 3wk 4mo
kind/bug
area/testing
priority/important-soon
arch/arm64
commented
open-milestone
pr-merged
send
9397 Add --delete-on-failure integration test if existing config references unusable driver 11mo 2mo 7mo
kind/feature
area/testing
priority/important-longterm
ux/embedded
assigned
assignee-updated
commented
contributor-last
open-milestone
recv-q
send
8304 Fix Tunnel AccessDirect test on windows
1y 7mo
help wanted
area/testing
priority/backlog
lifecycle/frozen
kind/cleanup
pr-closed
7733 add integration test for registry addon for non-linux kics 1y 7mo 11mo
area/testing
area/addons
priority/backlog
lifecycle/frozen
kind/process
commented
member-last
send
similar
7019 improve preload integration test to use minikube docker env 2y 1y
area/testing
priority/backlog
lifecycle/frozen
kind/cleanup
co/preload
6922 add integration test for ingress addon 2y 9mo 1y
help wanted
area/testing
priority/backlog
lifecycle/frozen
kind/cleanup
commented
member-last
send
similar
3552 Add CI testing for Fedora & CentOS
2y 3mo 7mo
area/testing
priority/backlog
lifecycle/frozen
kind/process
commented
member-last
send
Triage Party v1.4.0-beta.3