Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to load the dashboard in Sentry version 24.5.1 when querying large datasets with a history exceeding 5 days #3510

Open
1 task done
NikhilYN opened this issue Jan 6, 2025 · 2 comments

Comments

@NikhilYN
Copy link

NikhilYN commented Jan 6, 2025

Self-Hosted Version

24.5.1

CPU Architecture

x86_64

Docker Version

20.10.16

Docker Compose Version

2.6.0

Machine Specification

  • My system meets the minimum system requirements of Sentry

Steps to Reproduce

Install or upgrade Sentry to 24.5.1 and load the dashboard for live data.

Expected Result

Dashboard should load WITHOUT 504 errors.

Actual Result

Attaching screenshot link: https://pic.surf/3ip

Event ID

No response

@aldy505
Copy link
Collaborator

aldy505 commented Jan 11, 2025

Can you provide anything from your Docker container logs during that 504 error? Some logs from web and snuba-api container would help a lot.

@NikhilYN
Copy link
Author

Please find the logs below:

Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/api/base.py", line 320, in handle_exception
response = super().handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/usr/src/sentry/src/sentry/api/base.py", line 453, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/api/endpoints/organization_metrics_details.py", line 28, in get
metrics = get_metrics_meta(
^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 42, in get_metrics_meta
stored_metrics = get_available_mris(organization, projects, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 117, in get_available_mris
project_id_to_mris = fetch_metric_mris(organization.id, project_ids, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 543, in fetch_metric_mris
return _query_meta_table(org_id, project_ids, use_case_id, app_id=app_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 620, in query_meta_table
results = bulk_snuba_queries(requests, f"generic_metrics_meta
{column_name}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 890, in bulk_snuba_queries
return _apply_cache_and_build_results(params, referrer=referrer, use_cache=use_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 953, in _apply_cache_and_build_results
query_results = _bulk_snuba_query([item[1] for item in to_query], headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1042, in _bulk_snuba_query
raise clickhouse_error_codes_map.get(error["code"], QueryExecutionError)(
sentry.utils.snuba.QueryExecutionError: DB::Exception: Table default.generic_metric_counters_meta_dist doesn't exist. Stack trace:

  1. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, bool) @ 0x8febd9a in /usr/bin/clickhouse
  2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x9102da3 in /usr/bin/clickhouse
  3. void std::__1::__optional_storage_base<DB::Exception, false>::__construct<int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x1010cfb1 in /usr/bin/clickhouse
  4. DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>, std::__1::optionalDB::Exception*) const @ 0x100ff04a in /usr/bin/clickhouse
  5. DB::DatabaseCatalog::getTable(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>) const @ 0x10105708 in /usr/bin/clickhouse
  6. DB::JoinedTables::getLeftTableStorage() @ 0x10692c5c in /usr/bin/clickhouse
  7. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, std::__1::shared_ptrDB::IBlockInputStream const&, std::__1::optionalDB::Pipe, std::__1::shared_ptrDB::IStorage const&, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x1047ac7c in /usr/bin/clickhouse
  8. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x1047a25e in /usr/bin/clickhouse
  9. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x106571fa in /usr/bin/clickhouse
  10. DB::InterpreterFactory::get(std::__1::shared_ptrDB::IAST&, std::__1::shared_ptrDB::Context, DB::SelectQueryOptions const&) @ 0x10265837 in /usr/bin/clickhouse
  11. ? @ 0x1081bc66 in /usr/bin/clickhouse
  12. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::shared_ptrDB::Context, bool, DB::QueryProcessingStage::Enum, bool) @ 0x1081a5a3 in /usr/bin/clickhouse
  13. DB::TCPHandler::runImpl() @ 0x110c08be in /usr/bin/clickhouse
  14. DB::TCPHandler::run() @ 0x110d3859 in /usr/bin/clickhouse
  15. Poco::Net::TCPServerConnection::start() @ 0x13c4ca2f in /usr/bin/clickhouse
  16. Poco::Net::TCPServerDispatcher::run() @ 0x13c4e4ba in /usr/bin/clickhouse
  17. Poco::PooledThread::run() @ 0x13d80739 in /usr/bin/clickhouse
  18. Poco::ThreadImpl::runnableEntry(void*) @ 0x13d7c9ca in /usr/bin/clickhouse
  19. start_thread @ 0x9609 in /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
  20. __clone @ 0x122293 in /usr/lib/x86_64-linux-gnu/libc-2.31.so

05:44:42 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_metrics_details.OrganizationMetricsDetailsEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/metrics/meta/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.087611436843872 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:42 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/metrics/meta/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/metrics/meta/?project=4&useCase=sessions'>)
05:44:43 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=200 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=29.54003643989563 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:43 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=200 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=29.785099744796753 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:44 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.05721163749695 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:44 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3AVALIDATE_USER_FAILED%20AND%20message%3AjathreException%20AND%20device.online%3ATrue&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:44 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.084510564804077 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:44 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.08565354347229 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:44 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3ALOCATION_SEARCH_FAILED%20AND%20message%3AjathreException&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:44 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3AFETCH_USER_LOCATION_FAILED%20AND%20message%3AjathreException&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:44 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.096680402755737 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:44 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3ASUBSCRIBE_LIVE_WIDGET_FAILED%20AND%20message%3AjathreException&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:45 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.080162048339844 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:45 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3AFETCH_KILL_SWITCH_FAILED%20AND%20message%3AjathreException%20AND%20device.online%3ATrue&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:45 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.053364753723145 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:45 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3AUPDATE_DEVICE_FINGERPRINT_FAILED%20AND%20message%3AjathreException&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:45 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.073275804519653 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:45 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count%28%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3AUPDATE_ONBOARDING_INFO_FAILED%20AND%20message%3AjathreException&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count%28%29'>)
05:44:45 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events.OrganizationEventsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.07873034477234 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:45 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events/?environment=release&field=count_unique%28asset.url%29&name=&onDemandType=dynamic_query&per_page=20&project=4&query=message%3ACONTENT_PAYLOAD_TOO_LARGE%20AND%20message%3AjathreException%20AND%20device.online%3ATrue&referrer=api.dashboards.bignumberwidget&statsPeriod=7d&useOnDemandMetrics=false&yAxis=count_unique%28asset.url%29'>)
05:44:49 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events_stats.OrganizationEventsStatsEndpoint' response=400 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events-stats/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=42.35281038284302 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:49 [WARNING] django.request: Bad Request: /api/0/organizations/jathre-sentry/events-stats/ (status_code=400 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events-stats/?environment=release&field=transaction&field=count%28%29&interval=30m&orderby=-count%28%29&partial=1&project=4&query=message%3AFETCH_WIDGET_DATA_FAILED%20AND%20message%3AjathreException%20AND%20device.online%3ATrue&referrer=api.dashboards.widget.line-chart&statsPeriod=2d&topEvents=5&yAxis=count%28%29'>)
Traceback (most recent call last):
File "/.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 537, in _make_request
response = conn.getresponse()
^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/urllib3/connection.py", line 461, in getresponse
httplib_response = super().getresponse()
^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/sentry_sdk/integrations/stdlib.py", line 126, in getresponse
rv = real_getresponse(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/http/client.py", line 1390, in getresponse
response.begin()
File "/usr/local/lib/python3.11/http/client.py", line 325, in begin
version, status, reason = self._read_status()
^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/http/client.py", line 286, in _read_status
line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/socket.py", line 706, in readinto
return self._sock.recv_into(b)
^^^^^^^^^^^^^^^^^^^^^^^
TimeoutError: timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1096, in _snuba_query
return _raw_snql_query(request, thread_hub, headers), forward, reverse
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1133, in _raw_snql_query
return _snuba_pool.urlopen(
^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 845, in urlopen
retries = retries.increment(
^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 440, in increment
raise error.with_traceback(_stacktrace)
File "/.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 791, in urlopen
response = self._make_request(
^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 539, in _make_request
self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
File "/.venv/lib/python3.11/site-packages/urllib3/connectionpool.py", line 371, in _raise_timeout
raise ReadTimeoutError(
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='jathre-prod-sentry-sg1-snuba', port=1218): Read timed out. (read timeout=30)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/api/base.py", line 320, in handle_exception
response = super().handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/usr/src/sentry/src/sentry/api/base.py", line 453, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/api/endpoints/organization_releases.py", line 280, in get
debounce_update_release_health_data(organization, filter_params["project_id"])
File "/usr/src/sentry/src/sentry/api/endpoints/organization_releases.py", line 171, in debounce_update_release_health_data
project_releases = release_health.backend.get_changed_project_release_model_adoptions(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/release_health/metrics.py", line 1244, in get_changed_project_release_model_adoptions
raw_result = get_series(
^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics/datasource.py", line 1089, in get_series
snuba_result = raw_snql_query(
^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 866, in raw_snql_query
return bulk_snuba_queries([request], referrer, use_cache)[0]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 890, in bulk_snuba_queries
return _apply_cache_and_build_results(params, referrer=referrer, use_cache=use_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 953, in _apply_cache_and_build_results
query_results = _bulk_snuba_query([item[1] for item in to_query], headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1001, in _bulk_snuba_query
_snuba_query((snuba_param_list[0], Hub(Hub.current), headers, parent_api))
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1098, in _snuba_query
raise SnubaError(err)
sentry.utils.snuba.SnubaError: HTTPConnectionPool(host='jathre-prod-sentry-sg1-snuba', port=1218): Read timed out. (read timeout=30)
05:44:55 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_releases.OrganizationReleasesEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/releases/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=30.270795345306396 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:44:55 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/releases/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/releases/?environment=release&per_page=50&project=4&query=&sort=date'>)
05:45:05 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.02153635025024414 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:45:06 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.02138376235961914 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:45:06 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.022819042205810547 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:45:09 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.030018329620361328 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:09 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.02491307258605957 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:10 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.028857707977294922 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:10 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.020218610763549805 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:10 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.03025984764099121 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:11 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.022516250610351562 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:11 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.020037412643432617 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:12 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.28.6' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.02425980567932129 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='zih4')
05:45:12 [WARNING] sentry.integrations.utils.scope: Can't bind org context - no orgs are associated with integration id=3. (webhook='issue_updated')
05:45:12 [INFO] sentry.integrations.jira.utils.api: jira.assignee-not-in-changelog (issue_key='GLMONETIZN-33838' integration_id=3)
05:45:12 [INFO] sentry.integrations.jira.utils.api: jira.handle_status_change.unchanged (issue_key='GLMONETIZN-33838' integration_id=3)
05:45:12 [INFO] sentry.access.api: api.access (method='POST' view='sentry.integrations.jira.webhooks.issue_updated.JiraIssueUpdatedWebhook' response=200 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/extensions/jira/issue-updated/' caller_ip='104.192.137.244' user_agent='Atlassian Webhook HTTP Client' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.014451980590820312 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='PWoQ')
05:45:13 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.project_events.ProjectEventsEndpoint' response=200 user_id='49' is_app='False' token_type='api_token' is_frontend_request='False' organization_id='1' auth_id='None' path='/api/0/projects/jathre-sentry/python-django/events/' caller_ip='20.237.76.18' user_agent='python-requests/2.32.3' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.24716401100158691 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='6579')
05:45:26 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_events_stats.OrganizationEventsStatsEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/events-stats/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=72.78327202796936 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:45:26 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/events-stats/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/events-stats/?environment=release&field=transaction&field=count%28%29&interval=30m&orderby=-count%28%29&partial=1&project=4&query=message%3AFETCH_HIERARCHY_FAILED%20AND%20message%3AjathreException%20AND%20device.online%3ATrue&referrer=api.dashboards.widget.line-chart&statsPeriod=7d&topEvents=5&yAxis=count%28%29'>)
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 890, in validate_referrer
raise Exception(error_message)
Exception: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
05:45:43 [WARNING] sentry.snuba.referrer: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 890, in validate_referrer
raise Exception(error_message)
Exception: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
05:45:43 [WARNING] sentry.snuba.referrer: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 890, in validate_referrer
raise Exception(error_message)
Exception: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
05:45:43 [WARNING] sentry.snuba.referrer: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/snuba/referrer.py", line 890, in validate_referrer
raise Exception(error_message)
Exception: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
05:45:43 [WARNING] sentry.snuba.referrer: referrer generic_metrics_meta_metric_id is not part of Referrer Enum
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/api/base.py", line 320, in handle_exception
response = super().handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/usr/src/sentry/src/sentry/api/base.py", line 453, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/api/endpoints/organization_metrics_details.py", line 28, in get
metrics = get_metrics_meta(
^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 42, in get_metrics_meta
stored_metrics = get_available_mris(organization, projects, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 117, in get_available_mris
project_id_to_mris = fetch_metric_mris(organization.id, project_ids, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 543, in fetch_metric_mris
return _query_meta_table(org_id, project_ids, use_case_id, app_id=app_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 620, in query_meta_table
results = bulk_snuba_queries(requests, f"generic_metrics_meta
{column_name}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 890, in bulk_snuba_queries
return _apply_cache_and_build_results(params, referrer=referrer, use_cache=use_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 953, in _apply_cache_and_build_results
query_results = _bulk_snuba_query([item[1] for item in to_query], headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1042, in _bulk_snuba_query
raise clickhouse_error_codes_map.get(error["code"], QueryExecutionError)(
sentry.utils.snuba.QueryExecutionError: DB::Exception: Table default.generic_metric_counters_meta_dist doesn't exist. Stack trace:

  1. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, bool) @ 0x8febd9a in /usr/bin/clickhouse
  2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x9102da3 in /usr/bin/clickhouse
  3. void std::__1::__optional_storage_base<DB::Exception, false>::__construct<int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x1010cfb1 in /usr/bin/clickhouse
  4. DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>, std::__1::optionalDB::Exception*) const @ 0x100ff04a in /usr/bin/clickhouse
  5. DB::DatabaseCatalog::getTable(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>) const @ 0x10105708 in /usr/bin/clickhouse
  6. DB::JoinedTables::getLeftTableStorage() @ 0x10692c5c in /usr/bin/clickhouse
  7. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, std::__1::shared_ptrDB::IBlockInputStream const&, std::__1::optionalDB::Pipe, std::__1::shared_ptrDB::IStorage const&, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x1047ac7c in /usr/bin/clickhouse
  8. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x1047a25e in /usr/bin/clickhouse
  9. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x106571fa in /usr/bin/clickhouse
  10. DB::InterpreterFactory::get(std::__1::shared_ptrDB::IAST&, std::__1::shared_ptrDB::Context, DB::SelectQueryOptions const&) @ 0x10265837 in /usr/bin/clickhouse
  11. ? @ 0x1081bc66 in /usr/bin/clickhouse
  12. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::shared_ptrDB::Context, bool, DB::QueryProcessingStage::Enum, bool) @ 0x1081a5a3 in /usr/bin/clickhouse
  13. DB::TCPHandler::runImpl() @ 0x110c08be in /usr/bin/clickhouse
  14. DB::TCPHandler::run() @ 0x110d3859 in /usr/bin/clickhouse
  15. Poco::Net::TCPServerConnection::start() @ 0x13c4ca2f in /usr/bin/clickhouse
  16. Poco::Net::TCPServerDispatcher::run() @ 0x13c4e4ba in /usr/bin/clickhouse
  17. Poco::PooledThread::run() @ 0x13d80739 in /usr/bin/clickhouse
  18. Poco::ThreadImpl::runnableEntry(void*) @ 0x13d7c9ca in /usr/bin/clickhouse
  19. start_thread @ 0x9609 in /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
  20. __clone @ 0x122293 in /usr/lib/x86_64-linux-gnu/libc-2.31.so

05:45:43 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_metrics_details.OrganizationMetricsDetailsEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/metrics/meta/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.14464044570922852 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:45:43 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/metrics/meta/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/metrics/meta/?project=4&useCase=spans'>)
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/api/base.py", line 320, in handle_exception
response = super().handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/usr/src/sentry/src/sentry/api/base.py", line 453, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/api/endpoints/organization_metrics_details.py", line 28, in get
metrics = get_metrics_meta(
^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 42, in get_metrics_meta
stored_metrics = get_available_mris(organization, projects, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 117, in get_available_mris
project_id_to_mris = fetch_metric_mris(organization.id, project_ids, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 543, in fetch_metric_mris
return _query_meta_table(org_id, project_ids, use_case_id, app_id=app_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 620, in query_meta_table
results = bulk_snuba_queries(requests, f"generic_metrics_meta
{column_name}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 890, in bulk_snuba_queries
return _apply_cache_and_build_results(params, referrer=referrer, use_cache=use_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 953, in _apply_cache_and_build_results
query_results = _bulk_snuba_query([item[1] for item in to_query], headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1042, in _bulk_snuba_query
raise clickhouse_error_codes_map.get(error["code"], QueryExecutionError)(
sentry.utils.snuba.QueryExecutionError: DB::Exception: Table default.generic_metric_counters_meta_dist doesn't exist. Stack trace:

  1. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, bool) @ 0x8febd9a in /usr/bin/clickhouse
  2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x9102da3 in /usr/bin/clickhouse
  3. void std::__1::__optional_storage_base<DB::Exception, false>::__construct<int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x1010cfb1 in /usr/bin/clickhouse
  4. DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>, std::__1::optionalDB::Exception*) const @ 0x100ff04a in /usr/bin/clickhouse
  5. DB::DatabaseCatalog::getTable(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>) const @ 0x10105708 in /usr/bin/clickhouse
  6. DB::JoinedTables::getLeftTableStorage() @ 0x10692c5c in /usr/bin/clickhouse
  7. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, std::__1::shared_ptrDB::IBlockInputStream const&, std::__1::optionalDB::Pipe, std::__1::shared_ptrDB::IStorage const&, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x1047ac7c in /usr/bin/clickhouse
  8. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x1047a25e in /usr/bin/clickhouse
  9. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x106571fa in /usr/bin/clickhouse
  10. DB::InterpreterFactory::get(std::__1::shared_ptrDB::IAST&, std::__1::shared_ptrDB::Context, DB::SelectQueryOptions const&) @ 0x10265837 in /usr/bin/clickhouse
  11. ? @ 0x1081bc66 in /usr/bin/clickhouse
  12. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::shared_ptrDB::Context, bool, DB::QueryProcessingStage::Enum, bool) @ 0x1081a5a3 in /usr/bin/clickhouse
  13. DB::TCPHandler::runImpl() @ 0x110c08be in /usr/bin/clickhouse
  14. DB::TCPHandler::run() @ 0x110d3859 in /usr/bin/clickhouse
  15. Poco::Net::TCPServerConnection::start() @ 0x13c4ca2f in /usr/bin/clickhouse
  16. Poco::Net::TCPServerDispatcher::run() @ 0x13c4e4ba in /usr/bin/clickhouse
  17. Poco::PooledThread::run() @ 0x13d80739 in /usr/bin/clickhouse
  18. Poco::ThreadImpl::runnableEntry(void*) @ 0x13d7c9ca in /usr/bin/clickhouse
  19. start_thread @ 0x9609 in /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
  20. __clone @ 0x122293 in /usr/lib/x86_64-linux-gnu/libc-2.31.so

05:45:43 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_metrics_details.OrganizationMetricsDetailsEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/metrics/meta/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.16696786880493164 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:45:43 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/metrics/meta/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/metrics/meta/?project=4&useCase=custom'>)
Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/api/base.py", line 320, in handle_exception
response = super().handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/usr/src/sentry/src/sentry/api/base.py", line 453, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/api/endpoints/organization_metrics_details.py", line 28, in get
metrics = get_metrics_meta(
^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 42, in get_metrics_meta
stored_metrics = get_available_mris(organization, projects, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 117, in get_available_mris
project_id_to_mris = fetch_metric_mris(organization.id, project_ids, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 543, in fetch_metric_mris
return _query_meta_table(org_id, project_ids, use_case_id, app_id=app_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 620, in query_meta_table
results = bulk_snuba_queries(requests, f"generic_metrics_meta
{column_name}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 890, in bulk_snuba_queries
return _apply_cache_and_build_results(params, referrer=referrer, use_cache=use_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 953, in _apply_cache_and_build_results
query_results = _bulk_snuba_query([item[1] for item in to_query], headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1042, in _bulk_snuba_query
raise clickhouse_error_codes_map.get(error["code"], QueryExecutionError)(
sentry.utils.snuba.QueryExecutionError: DB::Exception: Table default.generic_metric_counters_meta_dist doesn't exist. Stack trace:

  1. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, bool) @ 0x8febd9a in /usr/bin/clickhouse
  2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x9102da3 in /usr/bin/clickhouse
  3. void std::__1::__optional_storage_base<DB::Exception, false>::__construct<int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x1010cfb1 in /usr/bin/clickhouse
  4. DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>, std::__1::optionalDB::Exception*) const @ 0x100ff04a in /usr/bin/clickhouse
  5. DB::DatabaseCatalog::getTable(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>) const @ 0x10105708 in /usr/bin/clickhouse
  6. DB::JoinedTables::getLeftTableStorage() @ 0x10692c5c in /usr/bin/clickhouse
  7. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, std::__1::shared_ptrDB::IBlockInputStream const&, std::__1::optionalDB::Pipe, std::__1::shared_ptrDB::IStorage const&, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x1047ac7c in /usr/bin/clickhouse
  8. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x1047a25e in /usr/bin/clickhouse
  9. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x106571fa in /usr/bin/clickhouse
  10. DB::InterpreterFactory::get(std::__1::shared_ptrDB::IAST&, std::__1::shared_ptrDB::Context, DB::SelectQueryOptions const&) @ 0x10265837 in /usr/bin/clickhouse
  11. ? @ 0x1081bc66 in /usr/bin/clickhouse
  12. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::shared_ptrDB::Context, bool, DB::QueryProcessingStage::Enum, bool) @ 0x1081a5a3 in /usr/bin/clickhouse
  13. DB::TCPHandler::runImpl() @ 0x110c08be in /usr/bin/clickhouse
  14. DB::TCPHandler::run() @ 0x110d3859 in /usr/bin/clickhouse
  15. Poco::Net::TCPServerConnection::start() @ 0x13c4ca2f in /usr/bin/clickhouse
  16. Poco::Net::TCPServerDispatcher::run() @ 0x13c4e4ba in /usr/bin/clickhouse
  17. Poco::PooledThread::run() @ 0x13d80739 in /usr/bin/clickhouse
  18. Poco::ThreadImpl::runnableEntry(void*) @ 0x13d7c9ca in /usr/bin/clickhouse
  19. start_thread @ 0x9609 in /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
  20. __clone @ 0x122293 in /usr/lib/x86_64-linux-gnu/libc-2.31.so

Traceback (most recent call last):
File "/usr/src/sentry/src/sentry/api/base.py", line 320, in handle_exception
response = super().handle_exception(exc)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
self.raise_uncaught_exception(exc)
File "/.venv/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
raise exc
File "/usr/src/sentry/src/sentry/api/base.py", line 453, in dispatch
response = handler(request, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/api/endpoints/organization_metrics_details.py", line 28, in get
metrics = get_metrics_meta(
^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 42, in get_metrics_meta
stored_metrics = get_available_mris(organization, projects, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/sentry_metrics/querying/metadata/metrics.py", line 117, in get_available_mris
project_id_to_mris = fetch_metric_mris(organization.id, project_ids, use_case_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 543, in fetch_metric_mris
return _query_meta_table(org_id, project_ids, use_case_id, app_id=app_id)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/snuba/metrics_layer/query.py", line 620, in query_meta_table
results = bulk_snuba_queries(requests, f"generic_metrics_meta
{column_name}")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 890, in bulk_snuba_queries
return _apply_cache_and_build_results(params, referrer=referrer, use_cache=use_cache)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 953, in _apply_cache_and_build_results
query_results = _bulk_snuba_query([item[1] for item in to_query], headers)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/sentry/src/sentry/utils/snuba.py", line 1042, in _bulk_snuba_query
raise clickhouse_error_codes_map.get(error["code"], QueryExecutionError)(
sentry.utils.snuba.QueryExecutionError: DB::Exception: Table default.generic_metric_counters_meta_dist doesn't exist. Stack trace:

  1. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, int, bool) @ 0x8febd9a in /usr/bin/clickhouse
  2. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x9102da3 in /usr/bin/clickhouse
  3. void std::__1::__optional_storage_base<DB::Exception, false>::__construct<int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > >(int const&, char const (&) [23], std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >&&) @ 0x1010cfb1 in /usr/bin/clickhouse
  4. DB::DatabaseCatalog::getTableImpl(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>, std::__1::optionalDB::Exception*) const @ 0x100ff04a in /usr/bin/clickhouse
  5. DB::DatabaseCatalog::getTable(DB::StorageID const&, std::__1::shared_ptr<DB::Context const>) const @ 0x10105708 in /usr/bin/clickhouse
  6. DB::JoinedTables::getLeftTableStorage() @ 0x10692c5c in /usr/bin/clickhouse
  7. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, std::__1::shared_ptrDB::IBlockInputStream const&, std::__1::optionalDB::Pipe, std::__1::shared_ptrDB::IStorage const&, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&) @ 0x1047ac7c in /usr/bin/clickhouse
  8. DB::InterpreterSelectQuery::InterpreterSelectQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x1047a25e in /usr/bin/clickhouse
  9. DB::InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery(std::__1::shared_ptrDB::IAST const&, std::__1::shared_ptr<DB::Context const>, DB::SelectQueryOptions const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > > > const&) @ 0x106571fa in /usr/bin/clickhouse
  10. DB::InterpreterFactory::get(std::__1::shared_ptrDB::IAST&, std::__1::shared_ptrDB::Context, DB::SelectQueryOptions const&) @ 0x10265837 in /usr/bin/clickhouse
  11. ? @ 0x1081bc66 in /usr/bin/clickhouse
  12. DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits, std::__1::allocator > const&, std::__1::shared_ptrDB::Context, bool, DB::QueryProcessingStage::Enum, bool) @ 0x1081a5a3 in /usr/bin/clickhouse
  13. DB::TCPHandler::runImpl() @ 0x110c08be in /usr/bin/clickhouse
  14. DB::TCPHandler::run() @ 0x110d3859 in /usr/bin/clickhouse
  15. Poco::Net::TCPServerConnection::start() @ 0x13c4ca2f in /usr/bin/clickhouse
  16. Poco::Net::TCPServerDispatcher::run() @ 0x13c4e4ba in /usr/bin/clickhouse
  17. Poco::PooledThread::run() @ 0x13d80739 in /usr/bin/clickhouse
  18. Poco::ThreadImpl::runnableEntry(void*) @ 0x13d7c9ca in /usr/bin/clickhouse
  19. start_thread @ 0x9609 in /usr/lib/x86_64-linux-gnu/libpthread-2.31.so
  20. __clone @ 0x122293 in /usr/lib/x86_64-linux-gnu/libc-2.31.so

05:45:43 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_metrics_details.OrganizationMetricsDetailsEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/metrics/meta/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.2135145664215088 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:45:43 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/metrics/meta/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/metrics/meta/?project=4&useCase=transactions'>)
05:45:44 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.organization_metrics_details.OrganizationMetricsDetailsEndpoint' response=500 user_id='111' is_app='False' token_type='None' is_frontend_request='True' organization_id='1' auth_id='None' path='/api/0/organizations/jathre-sentry/metrics/meta/' caller_ip='59.144.134.146' user_agent='Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.40024805068969727 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
05:45:44 [ERROR] django.request: Internal Server Error: /api/0/organizations/jathre-sentry/metrics/meta/ (status_code=500 request=<WSGIRequest: GET '/api/0/organizations/jathre-sentry/metrics/meta/?project=4&useCase=sessions'>)
05:45:57 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.01753711700439453 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:45:58 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.016219377517700195 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:45:59 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.018987655639648438 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:46:12 [WARNING] sentry.integrations.utils.scope: Can't bind org context - no orgs are associated with integration id=3. (webhook='issue_updated')
05:46:12 [INFO] sentry.integrations.jira.utils.api: jira.assignee-not-in-changelog (issue_key='AIP-30583' integration_id=3)
05:46:12 [INFO] sentry.integrations.jira.utils.api: jira.handle_status_change.unchanged (issue_key='AIP-30583' integration_id=3)
05:46:12 [INFO] sentry.access.api: api.access (method='POST' view='sentry.integrations.jira.webhooks.issue_updated.JiraIssueUpdatedWebhook' response=200 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/extensions/jira/issue-updated/' caller_ip='104.192.137.244' user_agent='Atlassian Webhook HTTP Client' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.012884378433227539 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='OTUU')
05:46:14 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.017294883728027344 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:46:15 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.018444061279296875 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:46:15 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.index.IndexEndpoint' response=200 user_id='None' is_app='None' token_type='org_auth_token' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/' caller_ip='59.144.134.146' user_agent='sentry-cli/2.25.0' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.01628422737121582 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='QXfc')
05:46:16 [WARNING] sentry.integrations.utils.scope: Can't bind org context - no orgs are associated with integration id=3. (webhook='issue_updated')
05:46:16 [INFO] sentry.integrations.jira.utils.api: jira.assignee-not-in-changelog (issue_key='AIP-30583' integration_id=3)
05:46:16 [INFO] sentry.integrations.jira.utils.api: jira.handle_status_change.unchanged (issue_key='AIP-30583' integration_id=3)
05:46:16 [INFO] sentry.access.api: api.access (method='POST' view='sentry.integrations.jira.webhooks.issue_updated.JiraIssueUpdatedWebhook' response=200 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/extensions/jira/issue-updated/' caller_ip='104.192.137.244' user_agent='Atlassian Webhook HTTP Client' rate_limited='False' rate_limit_category='None' request_duration_seconds=0.010690927505493164 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None' token_last_characters='XUUs')

Also, the issue is occuring for one particular dashboard when we load the data for more than 4 days. The quantum of data is huge in this dashboard. We upgraded from version 24.2.0 to 24.5.1. In this version, we are facing this issue.

@getsantry getsantry bot moved this from Waiting for: Community to Waiting for: Product Owner in GitHub Issues with 👀 3 Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Waiting for: Product Owner
Status: No status
Development

No branches or pull requests

2 participants