Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crashback loop in temporal history pods #7159

Open
gasaha12331 opened this issue Jan 24, 2025 · 0 comments
Open

Crashback loop in temporal history pods #7159

gasaha12331 opened this issue Jan 24, 2025 · 0 comments

Comments

@gasaha12331
Copy link

gasaha12331 commented Jan 24, 2025

Expected Behavior

Workflow history/activity should be visible in temporal ui.

Actual Behavior

Not able to see history/activity of any workflow in temporal.
Getting this error in temporal history pods.

panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x0 pc=0x172da60]
goroutine 33806 [running]:
go.temporal.io/server/common/persistence/sql.(*sqlExecutionStore).getVisibilityTasks(0xc00078ed50, {0x2d8cd50, 0xc005c15aa0}, 0xc003668480)
 /home/builder/temporal/common/persistence/sql/execution_tasks.go:767 +0x440
go.temporal.io/server/common/persistence/sql.(*sqlExecutionStore).getHistoryImmediateTasks(0x0?, {0x2d8cd50?, 0xc005c15aa0?}, 0x0?)
 /home/builder/temporal/common/persistence/sql/execution_tasks.go:137 +0x319
go.temporal.io/server/common/persistence/sql.(*sqlExecutionStore).GetHistoryTasks(0x1?, {0x2d8cd50?, 0xc005c15aa0?}, 0x0?)
 /home/builder/temporal/common/persistence/sql/execution_tasks.go:89 +0x106
go.temporal.io/server/common/persistence.(*executionManagerImpl).GetHistoryTasks(0xc0006b0a00, {0x2d8cd50, 0xc005c15aa0}, 0xc003668480)
 /home/builder/temporal/common/persistence/execution_manager.go:855 +0xba
go.temporal.io/server/common/persistence.(*executionRateLimitedPersistenceClient).GetHistoryTasks(0xc00078ed80, {0x2d8cd50, 0xc005c15aa0}, 0xc003668480)
 /home/builder/temporal/common/persistence/persistence_rate_limited_clients.go:353 +0xa2
go.temporal.io/server/common/persistence.(*executionPersistenceClient).GetHistoryTasks(0xc0006afc80, {0x2d8cd50, 0xc005c15aa0}, 0xc003668480)
 /home/builder/temporal/common/persistence/persistence_metric_clients.go:402 +0x2dc
go.temporal.io/server/common/persistence.(*executionRetryablePersistenceClient).GetHistoryTasks.func1({0x2d8cd50?, 0xc005c15aa0?})
 /home/builder/temporal/common/persistence/persistence_retryable_clients.go:380 +0x49
go.temporal.io/server/common/backoff.ThrottleRetryContext({0x2d8cd50, 0xc005c15aa0}, 0xc003fcf9e8, {0x2d6fce0, 0xc000055fb0}, 0x0?)
 /home/builder/temporal/common/backoff/retry.go:145 +0x20a
go.temporal.io/server/common/persistence.(*executionRetryablePersistenceClient).GetHistoryTasks(0x1?, {0x2d8cd50?, 0xc005c15aa0?}, 0x0?)
 /home/builder/temporal/common/persistence/persistence_retryable_clients.go:384 +0x73
go.temporal.io/server/service/history/queues.NewImmediateQueue.func1.1({0x0, 0x0, 0x0})
 /home/builder/temporal/service/history/queues/queue_immediate.go:80 +0x278
go.temporal.io/server/common/collection.(*PagingIteratorImpl[...]).getNextPage(0x0)
 /home/builder/temporal/common/collection/paging_iterator.go:116 +0x34
go.temporal.io/server/common/collection.NewPagingIterator[...](0xc003668360)
 /home/builder/temporal/common/collection/paging_iterator.go:52 +0x88
go.temporal.io/server/service/history/queues.(*IteratorImpl).HasNext(0xc008defce0, 0x0)
 /home/builder/temporal/service/history/queues/iterator.go:74 +0xb8
go.temporal.io/server/service/history/queues.(*SliceImpl).SelectTasks(0xc007122000, 0x0?, 0x64)
 /home/builder/temporal/service/history/queues/slice.go:375 +0x199
go.temporal.io/server/service/history/queues.(*ReaderImpl).loadAndSubmitTasks(0xc003400160)
 /home/builder/temporal/service/history/queues/reader.go:468 +0x216
go.temporal.io/server/service/history/queues.(*ReaderImpl).eventLoop(0xc003400160)
 /home/builder/temporal/service/history/queues/reader.go:436 +0x66
created by go.temporal.io/server/service/history/queues.(*ReaderImpl).Start
 /home/builder/temporal/service/history/queues/reader.go:178 +0x8a

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant