Prometheus
v3.14.0Observability2026년 8월 18일
이번 릴리스에는 API 사용 중단 예고와 대상 검색 동작 변경, 기본 설정 변경이 포함되며 새 기능, 성능 개선, 정확성 수정도 함께 포함됩니다. 보안 권고나 명시적으로 설명된 보안 취약점은 없습니다.
조치 필요 (1)
breakingPromQL 기간 표현식 기본 활성화
기간 표현식이 기본으로 활성화됩니다. 이에 따라
promql-duration-expr기능 플래그는 더 이상 동작을 변경하지 않습니다.
영향 확인 (1)
breaking
hcloud대상의__meta_hetzner_datacenter레이블 제거hcloud대상을 사용하는 경우에 적용됩니다.hcloud대상에서 Hetzner Cloud API에서 제거된__meta_hetzner_datacenter레이블이 더 이상 제공되지 않습니다.
미리 준비 (1)
deprecated쿼리 API의
stats값 일부 사용 중단 예고제거 시점 미정stats를true나all이 아닌 값으로 설정한 경우에 적용됩니다./api/v1/query와/api/v1/query_range의stats쿼리 매개변수에서true와all이외의 값이 사용 중단 예고 대상이 됩니다. 해당 값은 기본 통계를 계속 활성화하지만 이제 사용 중단 경고를 반환하며, 다음 주요 릴리스부터는 거부됩니다.
그 외 기록된 변경 39건 전체fixes 22 · additions 8 · value changes 8 · constraints 1
fixes (22)
- [CHANGE] API:
/api/v1/status/confignow correctly showsseparator: ""andreplacement: ""in relabel configs when explicitly set to empty, instead of omitting them. - [BUGFIX] Alerting: Fix 100% CPU usage on shutdown that could delay graceful shutdown and trigger timeout-based kills.
- [BUGFIX] Discovery/AWS: Stop
promtool check configfrom making AWS metadata service (IMDS) network calls when theregionfield is omitted in EC2, ECS, RDS, MSK, ElastiCache, and Lightsail service discovery configs. - [BUGFIX] Discovery/Docker: Set a request timeout for
docker_sdanddockerswarm_sdonunix,npipe, andtcphosts. Previously an unresponsive daemon could freeze discovery indefinitely, silently pinning targets to a stale snapshot. - [BUGFIX] Discovery/Docker: Fix panic in Docker Swarm service discovery when a service runs as a plugin or network-attachment.
- [BUGFIX] Discovery/Docker: Fix discovery of IPv6-only containers.
- [BUGFIX] PromQL: Fix case-insensitive regex label matchers silently dropping matching values.
- [BUGFIX] PromQL: Fix
mad_over_timereturning 0 instead ofNaNwhen the range contains aNaNsample. - [BUGFIX] Promtool: Accept
--enable-feature=promql-binop-fill-modifiersincheck rules, which previously rejected validfill()/fill_left()/fill_right()expressions. - [BUGFIX] Remote write: Respect the
AZURE_FEDERATED_TOKEN_FILEenvironment variable for workload identity authentication instead of hardcoding the token file path. - [BUGFIX] Rules: Clean up stale
rule_group_last_rule_duration_sum_secondsandrule_group_last_restore_duration_secondsseries when a rule group is removed or renamed on reload. Previously each reload leaked two series per dropped group, growing/metricscardinality over time. - [BUGFIX] Scrape: Fix scrape manager spinning at 100% CPU on shutdown.
- [BUGFIX] TSDB: Fix silent data loss and potential crash loop when
stale_series_compaction_thresholdis used in the config file. - [BUGFIX] TSDB: Fix potential data loss on restart when out-of-order ingestion is enabled and blocks are compacted.
- [BUGFIX] TSDB: Fix
prometheus_tsdb_head_stale_seriesover-counting and early eviction of series that change between float, integer histogram, and float histogram sample types. - [BUGFIX] TSDB: Fix goroutine and file handle leaks when Prometheus fails to open a corrupt TSDB. On Windows, the leaked directory handle also prevented TSDB directory removal.
- [BUGFIX] TSDB: Fix out-of-order queries blocking compaction for hours, causing memory usage to grow.
- [BUGFIX] TSDB: Fix deleted series causing missing samples and errors after restart.
- [BUGFIX] TSDB: Fix native histogram data becoming incorrect after restart.
- [BUGFIX] TSDB: Surface query errors that were previously silently discarded.
- [BUGFIX] TSDB: Honour the configured float chunk encoding when compaction rewrites chunks; previously chunks encoded with
--enable-feature=xor2-encodingcould silently revert to XOR after compaction. - [BUGFIX] UI: Show the delete-series form on the TSDB Status page when
--web.is enabled.enable-admin-api
additions (8)
- [FEATURE] Discovery: Add Oracle Cloud Infrastructure compute service discovery (
oci_sd_configs). - [FEATURE] PromQL: Add experimental
start_timestamp(instant-vector)function returning the start timestamp of each sample in the given vector. Requires theuse-start-timestampsfeature flag. - [FEATURE] TSDB: Add experimental support for encoding start timestamps in histograms and float histograms. Hidden behind the
histograms-st-encodingfeature flag. - [ENHANCEMENT] OTLP: Emit a warning when OTLP attribute names collide into the same Prometheus label after sanitization (e.g.
k8s.andpod. name k8s_pod_nameboth becomek8s_pod_name), and expose theprometheus_api_otlp_translation_warnings_totalcounter labelled bycategoryto track such warnings. - [ENHANCEMENT] Promtool: Add
--remote-write.flag topath push metricsfor backends that use a non-default remote-write endpoint. - [ENHANCEMENT] TSDB: Add
prometheus_tsdb_head_native_histogram_seriesandprometheus_tsdb_head_native_histogram_bucketsgauges tracking the number of native histogram series and buckets in the head. - [ENHANCEMENT] UI: Add syntax highlighting, autocompletion, and linting for PromQL duration expressions (
step(),range(),min_of(),max_of()) in range selectors and subqueries. - [ENHANCEMENT] UI: Add copy button next to rule names on the Rules and Alerts pages.
value changes (8)
- [CHANGE] PromQL: Promote
first_over_timeto stable. It no longer requires thepromql-experimental-functionsfeature flag. - [ENHANCEMENT] Remote write: Forward histogram start timestamps in the remote write V2 protocol.
- [ENHANCEMENT] UI: Improve rule group title contrast on the Rules page.
- [PERF] Speed up regex label matchers matching a set of literal values (e.g.
{job=~"foo|bar|baz"}). - [PERF] Remote read: Improve remote read throughput by removing unnecessary per-write flushing.
- [PERF] Scrape: Parse text and OpenMetrics formats without recursion, preventing stack overflow from deeply nested or malicious exposition input.
- [PERF] Scrape: Reduce native histogram scrape parsing allocations by ~49%.
- [PERF] TSDB: Speed up queries on series with many in-memory chunks.
constraints (1)
- [FEATURE] PromQL: Allow
rate()andincrease()to use start timestamps as an alternative for rate extrapolation. Hidden behind theuse-start-timestampsfeature flag.
Prometheus 스택에 추가
조치가 필요한 릴리스가 나왔을 때 주간 메일로 알려드립니다. 이번 릴리스의 브레이킹 체인지 같은 것들입니다.