Skip to content

Instantly share code, notes, and snippets.

@matthewpi
Created January 18, 2024 17:45
Show Gist options
  • Save matthewpi/891e2f03d3a88b4cf47d473b2d5b22a8 to your computer and use it in GitHub Desktop.
Save matthewpi/891e2f03d3a88b4cf47d473b2d5b22a8 to your computer and use it in GitHub Desktop.
CRI-O negative WaitGroup counter panic
Jan 18 17:39:07 cp002 crio[2238]: panic: sync: negative WaitGroup counter
Jan 18 17:39:07 cp002 crio[2238]: panic: sync: negative WaitGroup counter
Jan 18 17:39:07 cp002 crio[2238]: goroutine 293 [running]:
Jan 18 17:39:07 cp002 crio[2238]: sync.(*WaitGroup).Add(0xc000991c58?, 0x1?)
Jan 18 17:39:07 cp002 crio[2238]: sync/waitgroup.go:62 +0xd8
Jan 18 17:39:07 cp002 crio[2238]: sync.(*WaitGroup).Done(...)
Jan 18 17:39:07 cp002 crio[2238]: sync/waitgroup.go:87
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server.(*Server).broadcastEvents.func1({0x1b699b3?, 0x2e85aa0?}, {0x26e4e80?, 0xc0004b0180?})
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server/container_events.go:47 +0x36
Jan 18 17:39:07 cp002 crio[2238]: sync.(*Map).Range(0xc0002b96e8, 0x2c459b8)
Jan 18 17:39:07 cp002 crio[2238]: sync/map.go:476 +0x228
Jan 18 17:39:07 cp002 crio[2238]: panic({0x2740780?, 0x2e7bd90?})
Jan 18 17:39:07 cp002 crio[2238]: runtime/panic.go:914 +0x21f
Jan 18 17:39:07 cp002 crio[2238]: sync.(*WaitGroup).Add(0x2e85560?, 0xc0007801c8?)
Jan 18 17:39:07 cp002 crio[2238]: sync/waitgroup.go:62 +0xd8
Jan 18 17:39:07 cp002 crio[2238]: sync.(*WaitGroup).Done(...)
Jan 18 17:39:07 cp002 crio[2238]: sync/waitgroup.go:87
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server.(*Server).broadcastEvents.func2({0x299d6a0?, 0xc0006ca390?}, {0x26e4e80?, 0xc0004b0180})
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server/container_events.go:71 +0x131
Jan 18 17:39:07 cp002 crio[2238]: sync.(*Map).Range(0xc0002b96e8, 0xc000991f40)
Jan 18 17:39:07 cp002 crio[2238]: sync/map.go:476 +0x228
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server.(*Server).broadcastEvents(0xc0002b9000)
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server/container_events.go:52 +0x14c
Jan 18 17:39:07 cp002 crio[2238]: created by github.com/cri-o/cri-o/server.(*Server).GetContainerEvents.func1 in goroutine 292
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server/container_events.go:24 +0x56
Jan 18 17:39:07 cp002 crio[2238]: panic: sync: WaitGroup is reused before previous Wait has returned
Jan 18 17:39:07 cp002 crio[2238]: goroutine 292 [running]:
Jan 18 17:39:07 cp002 crio[2238]: sync.(*WaitGroup).Wait(0xc0002b96e8?)
Jan 18 17:39:07 cp002 crio[2238]: sync/waitgroup.go:118 +0x74
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server.(*Server).GetContainerEvents(0xc0002b9000, 0x2a41de0?, {0x2ea5160?, 0xc0006ca390})
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server/container_events.go:35 +0xe8
Jan 18 17:39:07 cp002 crio[2238]: k8s.io/cri-api/pkg/apis/runtime/v1._RuntimeService_GetContainerEvents_Handler({0x2b1dd20?, 0xc0002b9000}, {0x2ea1c50, 0xc0004b0160})
Jan 18 17:39:07 cp002 crio[2238]: k8s.io/[email protected]/pkg/apis/runtime/v1/api.pb.go:11478 +0xd0
Jan 18 17:39:07 cp002 crio[2238]: main.main.func2.StreamInterceptor.func10({0x2b1dd20, 0xc0002b9000}, {0x2ea2128, 0xc000c9c000}, 0xc00086e0a8, 0x2c45bb8)
Jan 18 17:39:07 cp002 crio[2238]: github.com/cri-o/cri-o/server/otel-collector/interceptors.go:42 +0xd5
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/grpc.(*Server).processStreamingRPC(0xc000572000, {0x2e9d988, 0xc0007fa240}, {0x2ea7440, 0xc0006036c0}, 0xc000c80000, 0xc000437710, 0x3e1d540, 0x0)
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/[email protected]/server.go:1644 +0x1327
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/grpc.(*Server).handleStream(0xc000572000, {0x2ea7440, 0xc0006036c0}, 0xc000c80000)
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/[email protected]/server.go:1741 +0xbfb
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/grpc.(*Server).serveStreams.func1.1()
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/[email protected]/server.go:986 +0x86
Jan 18 17:39:07 cp002 crio[2238]: created by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 310
Jan 18 17:39:07 cp002 crio[2238]: google.golang.org/[email protected]/server.go:997 +0x145
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment