Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Searching for a traceId in grafana / jaeger does not work after 3 days. #5579

Open
uptickmetachu opened this issue Dec 9, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@uptickmetachu
Copy link

uptickmetachu commented Dec 9, 2024

Describe the bug
Versions:
quickwit v0.8.2
Grafana v11.8.3
jaegertracing/jaeger-query:1.53.0

Datasources:

  • 1 jaeger datasource against jaeger query
  • 1 jaeger datasource against quickwit (api/v1/otel-traces-v0_7/jaeger)

I make a search for a trace in grafana explore against a trace_id and I can see it. A few days later I cannot find the trace via the jaeger search (whereas I can still find it via the quickwit datasource).

I manually test trace Ids and I've isolated that traceIds fail to be searched (via jaeger) exactly after 3 days.

Expected behavior
I expect the trace to still be viewable via the quickwit viewer after a few days.

Configuration:
Please provide:

  1. Output of quickwit --version
  2. The index_config.yaml
@uptickmetachu uptickmetachu added the bug Something isn't working label Dec 9, 2024
@uptickmetachu
Copy link
Author

uptickmetachu commented Dec 9, 2024

Actually I found the conversation on discord about jaeger config
lookback_period_hours which defaults to 72hours which matches this experience but unfortunately isn't documented anywhere on the website.

@uptickmetachu
Copy link
Author

uptickmetachu commented Dec 9, 2024

I'm assuming we configure it via:

jager:
   lookback_period_hours: XXX

And inside the helm chart:

config:
  jager:
    lookback_period_hours:

@uptickmetachu
Copy link
Author

I guess the intention is to limit the lookback period once a trace has been found. The problem is that this isn't working as intended and is excluding the trace ID if it doens't even land within the lookback period.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant