v0.1.88 (latest) - Thursday, November 30 2023, 07:34 UTC

• #agent [VPB-906] Improve Validation of Duration Based fields in Config (#11762)
• #agent [VPB-833] Add CEL validation for additional CEL fields (#11763)
• Use agent selfconfiguration initial value for nodehealth/tailer #agent (#11747)
• #agent [VPB-930] Update CEL first_non_empty to account for invalid fields (#11697)
• #agent [Hackathon] Implement K8s events tailer (#11652)

v0.1.87 - Monday, November 20 2023, 19:09 UTC

• [VPB-902] [Agent v1] add field_path to parse JSON attributes #agent (#11609)
• [VPB-917] #agent Control production & ingestion of Health metrics (#11581)
• #api #agent [LS-448] [LS-585] reduce archive interval, compactor enforcement (#11604)
• #agent [VPB-889] Fix Parse Json Bug (#11599)
• [VPB-719] #agent Allow Env Vars in ConfigV3 (#11510)
• [VPB-799] #api #agent Validate tag of config (#11378)
• #agent Error on validation should stop the Agent Runner. (#11279)

v0.1.86 - Monday, November 6 2023, 20:02 UTC

• #misc #agent Nodespec Update - Datadog Output (#11542)
• additional Kafka pusher health data #agent (#11545)
• #agent [MET-287] [Metrics] Agent changes for new OTEL-formatted metric ingestion flow (#11479)
• [ED-9872] #agent Fix bug while flattening map (#11541)
• #agent [ED-9871] Add different MessagePack library for FluentD inputs (#11521)
• [VPB-811] [Agent v0] add health features to Kafka output in #agent v0 (#11524)

v0.1.85 - Monday, October 30 2023, 20:41 UTC

• [ED-9872] #agent Improve sampling in logtopattern processor (#11461)
• #agent [VPB-886] Remove default value for regex field_path (#11457)
• [VPB-881] [Agent v1] fix empty slack message when slack integration is used #agent #api (#11423)
• [ED-9872] #agent Better perf on flattening attributes (#11396)
• #agent [ED-9871] Update message pack and FluentD libraries used for ED port FluentD schema (#11398)
• [VPB-820] #agent Create config content ID (#11171)

v0.1.84 - Friday, October 20 2023, 00:06 UTC

• #agent Upsert Transformation bug fix (#11350)
• #agent [MET-294] Set no-op collector for KSM and node-exporter once they are not available (#11334)
• #agent [ED-9828] [MET-294] [MET-295] Bugfix for agent start flow error suppression and K8s deployment spec updates (#11306)
• Sort array of CH settings to ensure order #test #agent (#11328)
• [VPB-793] #agent Add Merge CEL macro (#11297)
• #agent [ED-9828] Fix performance benchmark test, don't suppress agent start errors and some error refactoring (#11295)
• [VPB-751] [Agent v1] consistency in field path addressing #agent (#11280)
• #agent Add steps to verify and warn users for non-coupled processor & aggregator interaction (#11244)
• [Metrics] #agent Bugfix for cAdvisor collector of K8s metrics (#11261)

v0.1.83 - Tuesday, October 17 2023, 00:18 UTC

• #agent [VPB-790] Log Transform Upsert Improvements (#11252)
• #misc #agent [ED-9782] Gather licenses used by backend (api, agent etc) (#11186)
• [VPB-820] #agent Rename method in config interface (#11195)
• [VPB-761] [Agent v1] suppression window for Teams and Webhook output #agent (#11191)
• [VPB-814] [Agent v1] fix missing k8s labels and annotations in OTEL item attributes #agent (#11172)
• Replace direct usage of env variable name #agent (#11158)
• #agent #misc #api Update Log Transform Validation (#11150)

v0.1.82 - Sunday, October 8 2023, 21:29 UTC

• Match Splunk HEC input with docs #agent (#11154)
• Replace direct usage of env variable name #agent (#11155)
• [VPB-738] #agent Expose node IO as native metrics (#11082)
• Replace direct usage of env variable name #agent (#11139)
• #agent Fix ED Port pipeline builder when schema is not FlattenedObservation (#11125)
• [VBP-737] #agent Gather node's subcomponents health (#11054)

v0.1.81 - Thursday, October 5 2023, 20:22 UTC

• #agent [VPB-756] Otel format for specifying k8s includes and excludes (#11079)
• [VPB-691] #agent Extend flattening of attributes by another layer (#11136)
• Replace direct usage of env variable name #agent (#11132)
• Replace direct usage of env variable name #agent (#11123)
• Replace direct usage of env variable name #agent (#11112)
• #agent Support ED_CUSTOM_TAGS environment variable for config v3 (#11094)
• [VPB-827] [Agent v1] Bugfix: node doesn't pass item to failure path if processor returns StopProcessing but no errors #agent (#11122)
• [VPB-691] #agent Flatten user attributes for archive load (#11119)
• #api #agent [VPB-823] Promote released nodes status (#11114)
• [VPB-824] [Agent v1] first bandaid fix to parse JSON attributes #agent (#11115)
• Replace direct usage of env variable name #agent (#11110)
• Replace direct usage of env varaible name #agent (#11090)
• [VPB-791] #agent Continue processing transforms even after an error (#11053)
• Replace direct usage of env varaible name #agent (#11089)
• [VPB-804] [Agent v1] fix config id being missed from heartbeat and outgoing metrics #agent (#11085)
• [VPB-804] [Agent v1] update heartbeat item to support OTEL schema #agent (#11051)
• [VPB-788] [Agent v1] update health item to support OTEL schema #agent (#11052)
• [VPB-667] [Agent v1] update alert items to OTEL schema #agent (#11050)
• #agent Enable some protocols to have latency eBPF metrics, change source type for compactor metrics and some small fixes (#11057)
• [VPB-589] #agent Allow endpoints for datadog output node (#10974)
• [VPB-795] [Agent v1] update extract JSON logs to avoid return errs #agent (#11018)
• [VPB-806] #agent Update missing field_path into nodespec for regex filter (#11024)
• #agent [ED-9668] Process cloudtrail logs even if decompress fails (#11021)
• #agent [ED-9746] Fetch missing root controllers for Kubernetes replica sets and cron jobs (#11016)
• [VPB-774] [Agent v1] remove field_name from log level detector #agent (#10992)
• #agent Add handling of []byte to datadog/splunk (#10991)
• #agent removed unused snowflake_table_schema type (#10970)
• #agent [Metrics] Add support for new cGroups format for cAdvisor and tags with spaces for Prometheus format (#10985)
• [VPB-784] [Agent v1] add log level to log fields in ArchiveLogPayload #agent (#10989)
• #agent Nodespecs fix for Kubernetes metrics (#10981)
• [VPB-733] [Agent v1] fix mask node processor bug #agent (#10978)
• #agent #test [VPB-781] Fix Datadog Mapper Output (#10980)

v0.1.80 - Wednesday, September 20 2023, 17:31 UTC

• #agent #misc [Metrics] Change visible name and category for K8s metrics node's spec (#10966)
• Remove some trace files #agent (#10968)
• #agent Fix nil pointer in tracer_utils (#10953)
• #agent Update Node Status (#10934)
• #agent #misc Bugfix for incorrect trace file logic for logger (#10950)
• #agent Fix missing synchronization for nodespecs (#10945)
• #agent [MET-192] [Metrics] Update K8s metrics configuration details and nodespec updates (#10874)

v0.1.79 - Monday, September 18 2023, 18:50 UTC

• #agent Updater splunk/datadog payload items marshalling (#10896)
• #agent Set packet capture buffer size according to buffer size in v3 config (#10894)
• [VPB-750] [Agent v1] move k8s labels and annotations to attributes in OTEL schema #agent (#10906)
• #agent #api [VPB-755] Update Node Status and Suggestions Endpoint (#10897)
• [VPB-753] [Agent v1] move the parsed JSON attributes to top level of attribute section in OTEL schema #agent (#10895)
• #agent #test Fix agent with internal archiving crash when backend is disabled and some test changes (#10898)
• [MET-158] #agent Fix missing fields in HTTP track record caused by out-of-order packets (#10888)
• [LP-292] #agent Pool worker should continue to work on next ingestion instead of quit on error (#10872)
• #agent [Metrics] Bugfix for pod listener component (#10878)
• #agent [Metrics] Add buffer size configuration field for K8s traffic node (#10834)
• [VPB-721] [Agent v1] add missing predefined paths for parse JSON attributes node #agent (#10871)
• [VPB-731] [Agent v1] Update k8s container attribute name in OTEL schema #agent (#10853)
• [LP-284] #agent Create agent self log in avro format by default (#10865)
• #agent [VPB-625] [VPB-728] Updated ed schema references and source manipulate node to otel (#10809)
• #agent [VPB-739] [VPB-748] Update Custom Item Formatting (#10851)
• [VPB-729] [Agent v1] Remove returning error from regex filter node #agent (#10852)
• [MET-158] #agent Log HTTP record with empty fields to help trace related packets (#10850)
• [MET-173] #agent Verify XDP is still loaded on pod interface periodically (#10831)
• [ED-9684] #agent Reduce batchSize if compact request is too big (#10829)
• #agent [MET-180] [Metrics] Change Avro schema used by metric ingestion to resemble Elastic Metrics (#10816)
• #agent #misc Add trace log level support for logger and some other changes (#10799)
• [DP-133] [Agent v1] update metric item types to OTEL schema #agent (#10731)
• #agent Fix a typo in tracer logging and adjust test condition (#10810)
• [MET-173] #agent Add logging to investigate the issue of missing ebpf metrics (#10792)
• [VPB-673] [Agent v1] Some nodespec update for Parse JSON Attributes node #agent (#10778)
• [MET-158] #agent Delay communication report until associated samples are read (#10759)
• [VPB-661] [Agent v1] Fix cluster being missed in ED backend with OTEL schema #agent (#10776)
• [DP-76] [Agent v1] add parse JSON attributes node #agent (#10713)
• [DP-134] [Agent v1] update cluster item types to OTEL schema #agent (#10729)
• add tls config to elastic output for config v3 #agent (#10727)
• [ED-9650] #agent Support avro archive output with config V3 (#10678)

v0.1.78 - Friday, August 25 2023, 21:45 UTC

• [DP-141] [Agent v1] make OTEL schema the default for #agent (#10637)
• #agent [DP-144] Add defaults for Splunk and Datadog mappers (#10636)
• #agent [DP-127] Fix marshalling, validation, and CEL for mappers (#10622)
• #agent #test [Metrics] Separate validation tests, add extra filter for K8s traffic tests and fetch K8s parent controllers at the startup (#10652)
• #agent [Metrics] Fix missing kube-state metrics bug and instrument links (#10640)
• [DP-77] [Agent v1] accommodate log level detector node to OTEL schema #agent (#10580)
• [DP-117] [Agent v1] make k8s input filter keys be consistent with OTEL semconv #agent (#10582)
• #agent Update mappers config validations (#10584)
• #agent [Metrics] Bugfix for kube_state collector caused by inaccessible URL (#10598)
• [MET-121] #agent Derive connection role from protocol and packet direction (#10591)
• [DP-117] [Agent v1] make source manipulator node field be consistent with OTEL semconv #agent (#10589)
• #agent [Metrics] Support kube-state metrics scraping for K8s metrics (#10546)
• #agent #api Fix link validation error for integrations (#10590)
• #agent [Metrics] Add local and remote process dimensions for Unknown role of K8s Traffic (#10577)
• [DP-109] #agent Performance Test for Mapper and Transformers and Elastic Updates (#10339)
• #agent #api Skip node reference validation in some cases (#10587)
• [Agent v1] [DP-132] Update archive items with OTEL schema #agent (#10533)
• #agent [Metrics] Bugfix for K8s Traffic metrics ingested without source information (#10572)
• #agent Change logging levels of some processor logs (#10562)
• Dont update compaction without a configuration #agent (#10563)
• [DP-123] #agent Conversion of ED map in cluster item (#10561)
• [DP-123] #agent Conversion of ED map in metric item (#10560)
• #agent Fix deadlock issue between K8s pod listener and K8s tracer pod monitor (#10536)
• trigger build #agent (#10532)
• [MET-121] #agent Exclude agent's namespace from tracer monitoring (#10505)
• [DP-78] #agent Add Transformation Handling to Pusher Strategies (#10321)
• #agent [Metrics] Use parent controller for K8s traffic instead of upper controller (#10508)
• [Agent v1] [DP-114][DP-115] finalizing resource section for OTEL schema #agent (#10494)
• Agent container integration tests #misc #test #agent (#10451)
• Update visibility and release status of nodes #agent (#10495)
• [Agent v1] [DP-128] fix enrichment being missed in archiving flows #agent (#10472)
• [DP-121] #agent Detect and capture HTTP2/GRPC connection info using EBPF (#10440)
• #test #agent [Metrics] Add user metrics validation dogfood test and fix category bug for K8s metrics (#10459)
• #agent #misc [Metrics] Increase buffer sizes for K8s traffic and some minor changes (#10434)
• [DP-123] #agent Aggregator to handle OTEL schema. (#10422)
• [DP-125] #agent Data race in logtometric/reporter (#10439)
• #agent [VPB-496] Add tag prefix field to nodespecs (#10417)
• #agent [Metrics] Multiply processor requests' to aggregator expiry period by divisor (#10406)
• [DP-110] #agent Rename interfaces for item and log item (#10398)
• #agent [Metrics] Enable aggregator for production dogfood and remove unnecessary environment variables (#10405)
• [DP-110] #agent Rename OTEL item (#10397)
• [DP-110] #agent Rename ED item (#10396)
• #api #agent [VPB-473] Fix custom tag unmarshal error (#10367)
• #agent [Metrics] Restrict latency logic for tracer (#10361)
• [ED-9557] [Agent v1] add fluentd support to port output for #agent v1 (#10305)
• [DP-110] #agent Combine item decorators (#10360)
• [DP-110] #agent Extend interface for log item (#10301)
• #agent LogLevelDetector and ExtractJSON Visibility (#10266)

v0.1.77 - Wednesday, August 9 2023, 14:09 UTC

• #agent [VPB-503] Add transformation subcategory to log and output transform nodes (#10332)
• #agent [ED-9554] [Agent v1] Fix missing logic for aggregator reporting (#10345)
• #misc #agent Only get first line for Go version while downloading latest Go version (#10320)
• #agent [Agent v1] Some changes to investigate & mitigate deadlocks caused by aggregator (#10316)
• #agent [Agent v1] Enable stack trace printing for staging dogfood environment (#10308)
• #api #agent #misc [VPB-493] CEL Suggestions Endpoint (#10260)
• [DP-106] #agent Reduce memory usage of ebpf packet capture event (#10263)
• Use circleci tests run to rerun only failed tests #test #misc #agent (#10272)
• #agent [Agent v1] Add node health input node to aggregator enabled input nodes (#10281)
• [ED-9137] #agent Change visibility of ED Pipeline IO Stats node (#10258)
• #agent [Agent v1] Enable pipeline IO stats for aggregator (#10250)
• #agent [Agent v1] Fix some problems regarding aggregator execution flow (#10246)
• #agent [VPB-495] Update visibility of experimental processor nodes (#10225)
• #agent [Metrics] [Agent v1] Enable aggregator for dogfood staging (#10234)
• #agent #api fix null pointer issue in processor (#10233)
• [DP-90] #agent Add default OTEL item and make it an option for log item (#10199)
• [ED-9137] #agent Pipeline IO Stats input node (#9949)
• [DP-90] [Agent v1] Expose item_schema in #agent setting (#10222)
• [DP-90] #agent Use only item factory to build metric item (#10200)
• [DP-90] #agent Update metric item to use factory (#10198)

v0.1.76 - Thursday, August 3 2023, 14:04 UTC

• [MET-78] add unit tests to k8s metrics input node #agent (#10171)
• [DP-90] #agent Create multi item via factory (#10201)
• #agent [Agent v1] [DP-103] [DP-104] Add clustering and top K integration tests together with aggregator versions (#10180)
• [MET-79] add granularity to k8s metrics input node #agent (#10185)
• [DP-90] #agent Update log item to use factory (#10190)
• [DP-90] #agent Update default ED item to use factory (#10165)
• [DP-90] #agent Update OTLP to use item factory (#10163)
• [DP-90] #agent Delete k8s traffic item (#10162)
• [DP-90] #agent Update k8s event to use item factory (#10161)
• [DP-90] #agent Update decorators to use factory (#10158)
• [DP-90] #agent Update health item to use factory (#10135)
• [DP-90] #agent Update custom item to use factory (#10166)
• [DP-90] #agent Update EDAC item to use factory (#10164)
• #agent [Agent v1] [DP-101] Aggregator support for top K node (#10140)
• #agent [Agent v1] [DP-86] Aggregator support for log to pattern node (#10125)
• [DP-90] #agent Update cluster item to use factory (#10159)
• [DP-90] #agent Update archive item to use factory (#10157)
• [DP-90] #agent Update hearteat item to use factory (#10153)
• [DP-13] #agent Fill in timestamp if there is none (#10116)
• #agent #test [Agent v1] [ED-9527] Fix for metric aggregator case and re-enable integration tests (#10142)
• #agent [Agent v1] [MET-66] Recovery flow for aggregator crash scenario (#10123)
• [DP-90] [Agent v1] [1/n] DefaultItem interface #agent (#10130)
• [DP-90] [Agent v1] [2/n] ItemFactory #agent (#10131)

v0.1.75 - Sunday, July 30 2023, 19:32 UTC

• #agent #test [Agent v1] [MET-62] Enable integration tests for aggregator metrics (#10103)
• [DP-13] #agent Docker input tailer. (#10039)
• #agent [Metrics] Kubelet collector fixes for K8s metrics (#10104)
• fix kubelet metric names for histograms #agent (#10100)
• #agent [ED-9467] Final Transformation Node (#9950)
• #agent #misc [Agent v1] [MET-53] Adapt ratio processor to aggregator (#10008)
• #agent [MET-59] [Metrics] Add outgoing uncompressed bytes support (#10071)
• #agent [Metrics] Add new segment at metric configuration for K8s metrics (#10086)
• #agent #misc [MET-52] [Agent v1] Adapt log to metric (and K8s traffic) nodes to use aggregator when possible (#10007)
• #agent #misc [MET-51] [Agent v1] Aggregator prototype with proto definitions and lifecycle (#10006)
• [DP-73] #agent Fix compactor service name resolving issue when agent runs on host network (#10093)
• [DP-13] #agent Separate regex and noop separators (#10091)
• [DP-74] #agent Let agent self log uploader use compactor client to compact self log (#10059)
• [MET-2] [metrics] kubelet api for k8s metrics input #agent (#9954)
• extend lookback for cloudwatch logstream query #agent (#10078)
• #agent [Agent v1] Update metric categories for new k8s metrics (#10045)

v0.1.74 - Tuesday, July 25 2023, 09:36 UTC

• #agent [Agent v1] Remove archiver leftovers from code base (#10003)
• [ED-9345] Fix prom metrics issues #agent (#9983)
• #agent [ED-9412] Log Transform Processor Node (#9714)
• #agent #test [Agent v1] Fix for agent performance tests (#9994)

v0.1.73 - Thursday, July 20 2023, 09:34 UTC

• #agent [Agent v1] [MET-4] Utilize node-exporter metrics for K8s metrics input node (#9928)
• [ED-9152] #agent Expose Elastic bulk indexer configurations (#9925)
• #agent #api [Agent v1] Add flags for dogfood environments to enable tracer (#9938)
• fixed compactor incorrect metric source type #agent (#9927)
• #agent Fix missing runtime function error (#9929)
• #agent #misc [ED-9370] [Agent v1] K8s traffic input as a single node with its metric processor (#9695)
• #agent [Agent v1] [MET-38] Implement cAdvisor metrics for K8s metrics node (#9897)
• [ED-9142] #test #agent Replace archiver integration with compactor integration test (#9829)
• [ED-9371] #agent Warn if event has no subscribers (#9920)

v0.1.72 - Monday, July 17 2023, 10:59 UTC

• edport output changes for #agent v1 (#9841)
• [ED-9220] #agent Fix type in input source (#9890)
• #agent #api [VPB-441] Add Additional Nodespecs Fields to Catalog (#9888)
• [MET-34] add the template of k8s metrics input node #agent (#9872)
• #api #agent [VPB-438] Node Release Status (#9860)
• #api #agent Fix Route Paths Casing (#9844)
• [ED-9439] parent source fields are missing in parquet files on s3 #agent (#9837)
• #api #agent [VPB-437] Sync Complex Config Fields (#9816)
• Fix windows-server image instead of using 'current' tag #misc #agent (#9826)
• [ED-9426] fix fluentd-input integration test failure #agent (#9791)
• #agent #misc [ED-9410] [ED-9431] [Agent v1] Break deadlock between log_to_pattern processor and reporter (#9809)
• #agent #misc [Agent v1] Freeze new deployments for dogfood agents (#9799)
• [ED-9220] #agent Convert usage of map to set (#9789)
• #agent #misc [Agent v1] Add periodic stack trace printing when trace files are enabled (#9777)
• [ED-9411] [Agent v1] Microsoft teams and Webhook output node #agent (#9685)
• Rename internalv3/integration to internalv3/output #agent (#9767)
• #api #agent [VPB-316] Test Nodes with Multiple Output Paths (#9728)
• [ED-8959] #agent Agent V1 compaction (#9766)
• #agent #misc [ED-9381] [Agent v1] Implement ratio processor (#9712)
• [Agent v1] - LogToPattern Integration Tests #agent #test (#9694)
• [ED-9332] [Agent v1] add topk processor for #agent v1 (#9594)
• #agent #misc [ED-9377] [Agent v1] Implement OpenTSDB parser processor (#9708)
• #agent [VPB-390] Lower Diagnostics Window (#9693)
• [ED-9398] #agent Update lock in log-buffered-pusher (#9737)
• [ED-8856] #agent Add heartbeat and agent stats support to compactor (#9705)
• #agent #test Fix flaky tests (#9706)
• #agent #misc [Agent v1] Add missing attributes to metric items for Datadog integration (#9702)
• #agent #misc [Agent v1] Fix some missing attributes of incoming stats due to recent changes (#9700)
• #agent [ED-9354] [Agent v1] Fix data race in log to metric processor (#9682)
• #agent [Agent v1] Fix log with timestamp from tailer having wrong timestamp bug (#9678)
• #agent [ED-9343] [Agent v1] Synchronize incoming stats histograms' lifecycle with tailer's lifecycle (#9676)
• [ED-9362] - [Agent v1] - User Fields Fix For LogToPattern #agent
• [ED-9361] [Agent v1] fix enrichment override_if_exists place for enrichment node #agent (#9671)
• #agent Make sure incoming_lines.count is reported for silent file based sources (#9623)

v0.1.71 - Wednesday, June 21 2023, 20:32 UTC

• #agent Make CompactServer.Stop() return after GRPC server stops. (#9639)
• [ED-9348] make edport output hidden for #agent config v3 #api (#9636)
• [ED-9324] #agent Improve compactor stability and fault tolerance (#9607)
• #agent Evict clusters in a separate routine (#9614)
• [ED-9184] #agent #test Dogfood to check node health (#9558)

v0.1.70 - Friday, June 16 2023, 17:15 UTC

• #api #agent [VPB-328] Mock ED Fields when Testing (#9556)
• #agent #misc enabling editing log to metric by e8 customers (#9552)
• [ED-9184] #agent Account for new keys in size of item (#9546)
• #agent [ED-9254] Fix health manager register/deregister deadlock (#9515)
• [ED-9289] #agent Enable agent to upload avro metrics file to s3 (#9502)
• #agent #misc including nodes in the e8 free tier and hiding legacy option (#9495)
• [ED-9209] [Agent v1] decompose edport input into different node types #agent (#9406)
• #agent #misc [Agent v1] Introduce global line settings and other small changes (#9434)
• #agent Add user_description field to config v3 nodes to persist custom user comments (#9410)
• #agent #misc [ED-9254] [Agent v1] Some refactor and increase debug logs (#9426)
• update wizards of some #agent node (#9424)
• #agent #misc [Agent v1] Use concurrent map for item flags and add missing static runtime variables (#9392)
• #agent #misc updating node descriptions to match docs, fixing a … (#9408)
• [ED-9015] #agent Periodic compactor checkpoint to prevent data loss (#9357)
• #agent #misc [ED-9155] [ED-9156] Add adjustable stat collection interval and duplicate internal node check (#9310)
• #agent #misc [ED-9210] [Agent v1] Separate internal incoming & outgoing data types from UI ones for nodespecs (#9364)
• #agent #misc updating field descriptions to match JP's docs (#9377)
• [ED-9207] #agent Limit data size in compact request (#9356)
• [ED-9127][Agent v1] add value hint for complex dynamic enrichment #agent config v3 (#9369)
• #agent #misc [ED-9146] [Agent v1] Support incoming stats for agent micro performance tests (#9314)
• #agent #misc [ED-9195] [Agent v1] Favor config based settings for archiving instead backend config (#9330)
• #agent #misc [ED-9186] [Agent v1] Add extra documentation and performance test for new copy logic (#9300)
• [ED-9185] #misc #agent Synchronous graph (#9299)
• #agent #misc VPB-294 renaming subcategories, adding visibility and light nodespec cleanup (#9286)
• #agent [ED-8637] - Option to send all patterns to 3rd party destinations (#8816)
• [ED-9188] [Agent v1] add enrichment integration tests to source detection #agent (#9305)
• #agent #misc [ED-9122] [Agent v1] Diffuse copy logic into nodespecs & more intelligent copying over pipeline (#9175)
• #agent #misc [ED-9095] [Agent v1] Rename path prefix parameters to align with other source field representations (#9125)
• #agent #misc [ED-9153] [ED-9154] [Agent v1] Migrator rework and additions (#9245)
• #agent #misc [ED-9140] [ED-9150] [Agent v1] Add unit test for execution flow (#9243)
• [VPB-250] Instrument Pipeline Config for Testing (#9263)
• some #agent v1 fixes (#9271)
• [ED-9145] #agent Register ed archive destination to enable ed archive compaction (#9214)

v0.1.69 - Wednesday, May 31 2023, 19:13 UTC

• [ED-8188] #agent ED Container Stats node (#9211)
• #agent Add log_to_pattern to agent v1 bench test suite (#9208)
• [ED-9077] [Agent v1] migration enrichment integration tests to the #agent v1 (#9128)
• [ED-8587] #agent Remove field minReadySeconds in compactor yaml (#9213)
• #agent #misc [Agent v1] Some nodespec changes (#9183)
• #agent #misc [ED-9009] [Agent v1] Handle nodespec failures to find corresponding node type (#9205)
• [ED-8600] [Agent v1] update and integration test for route node #agent (#9202)
• [ED-8188] #agent Add system stats tailer (#9182)
• [VPB-249] Agent Runner #api #agent #misc (#9165)
• nodespec cleanup and visibility #agent #misc (#9181)
• [ED-7882] #agent Set storage class of compactor on admin prod and typo fix (#9207)
• [ED-7882] #agent Set trace files flag on admin backend compactor (#9201)
• [ED-9136] [Agent v1] fix agent v3 configs and renaming k8s_kind to k8s_controller_kind #agent (#9198)
• [ED-9134] #agent Cleanup charts before publish (#9195)
• [ED-9119] [Agent v1] make k8s input filter keys be consistent with item fields #agent (#9155)
• #agent #misc [ED-8896] [Agent v1] Implement group by integration test (#9144)
• #agent #misc [ED-9100] [Agent v1] Adapt source detection tests (#9130)
• #agent #misc [ED-8963] [Agent v1] Histogram limit fix for an edge case (#9121)
• [ED-8853] #agent Make sure not to log secrets in Denstination proto (#9166)
• [ED-7882] #misc #agent Fix typo in compactor chart template (#9157)

v0.1.68 - Friday, May 26 2023, 17:28 UTC

• [ED-8727] #agent Update nodespecs to display friendly names (#9114)
• [ED-8858] #agent Enable ED metrics S3 repo to use compact client (#8969)
• [ED-8857] #agent Enable customer archiving to use compactor (#8968)
• allow container image metric column to be dropped #agent (#9143)
• #agent minor logging improvement in tracer (#9145)
• #agent #misc [ED-8963] [Agent v1] Fix line buffering issues in file tailer (#9127)
• [ED-8854] #agent implement compact client (#8948)
• #agent #misc [ED-9090] [Agent v1] Support multiple links with same from & to nodes (#9098)
• #agent #misc [ED-9083] [Agent v1] Add l2m metric category to log_to_metric processor generated items (#9093)
• #agent #misc [ED-7440] [ED-9034] [Agent v1] Repurpose log buffer as item buffer (#9066)
• #agent #misc [ED-8963] [Agent v1] Honor max histogram limit for log_to_metric node (#8989)
• #agent Support custom annotations for httprecorder in agent helm chart (#9088)
• [VPB-248] In-Memory Input Node #api #misc #agent (#9046)
• #agent [ED-8188] Diagnostics configuration (#8923)
• [ED-8853] #agent Compact server implmentation. (#8926)
• [ED-8781] [Agent v1] add caching to enrichment processors #agent (#9069)
• #agent #misc [ED-8964] Cache item size when Size() is called and do lazy evaluation (#8991)
• #agent Minor logging updates for conf v3 log_to_pattern processor (#9089)
• [ED-9049] [Agent v1] rename enrichment override_existing_value to override_if_exists for #agent config v3 (#9057)
• [ED-8578] - [Agent v1] Add logtopattern #agent config v3 (#8599)
• [ED-8782] [Agent v1] add unified enrichment node #agent (#8974)
• [ED-8817] [Agent v1] trigger destination node #agent (#8872)
• [VPB-247] Observer Node #api #misc #agent (#9033)
• #agent [ED-8961] Fix concurrent map read and write issue in streamer factory (#8990)
• #agent #misc [Agent v1] [ED-8981] [ED-8982] [ED-9002] Bundle of bugfixes after dogfood agent running up (#9012)
• #api #agent Revert cql reserved keyword for cluster_name (#9037)
• #agent [LS-63] - added cql reserved keys to agent config validation (#8949)
• Update CircleCI config #agent (#9011)
• #api #agent [ED-8980] don't call alert related API's when data preference is disabled (#8998)
• Rework update-hosted-env job to use tags #agent (#9005)
• Disable SIGPIPE in update-hostedenv script #agent (#8986)
• #agent #misc [ED-8880] [Agent v1] Change histogram eviction logic for reporters (#8899)
• #agent [ED-8209] Setup dogfood agents for config v3 (#8970)
• #agent Meter input/output of a node per path (#8918)
• #agent #misc [ED-7754] [ED-8710] [Agent v1] Add group by support for log_to_metric node (#8883)
• #agent #misc [ED-8845] [Agent v1] Implement source manipulate node (#8877)
• #agent #misc [ED-8908] [Agent v1] Migrate isRunning and lastXXXErr variables to atomic ones (#8954)
• [ED-8947] [Agent v1] add gcpMetadata macro to cel expression #agent (#8955)
• [ED-8956] #agent Report status for noop filter (#8964)
• add thread safe repo discovery to agent v1 #agent (#8958)

v0.1.67 - Monday, May 15 2023, 06:40 UTC

• #api #agent [LS-100] remove warehouses from configv2 (#8925)
• [ED-8911] [Agent v1] add ec2Metadata macro to cel expression #agent (#8907)
• #agent [ED-8783] Implement thread safe internal repo discovery logic (#8902)
• add metric column options support to v1 #agent (#8932)
• [ED-8855] #agent Define compact service GRPC proto (#8891)
• #api #agent [ED-8607] [ED-8899] Support breakdown by agent version and host names in node counts, and fix missing version for config v3 agents (#8821)
• #agent #misc [ED-8895] [Agent v1] Migrate value adjustment rules to new expression manager (#8884)
• [ED-8835] #agent Add health/manager to elastic/client in repositories (#8869)

v0.1.66 - Wednesday, May 10 2023, 00:06 UTC

• #agent [ED-8741] Support custom worker count for elastic pusher in config v2 (#8867)
• #agent Update openmetrics pusher to support Chronosphere integration (#8753)
• #api #agent [ED-8815] add agent column drop org setting (#8827)
• [ED-8786] [Agent v1] add integration test for test output buffer #agent (#8739)

v0.1.65 - Monday, May 8 2023, 15:04 UTC

• WIP [ED-8742] [Agent v1] add linux base config integration test for #agent v1 (#8694)
• #agent #misc [ED-8810] [Agent v1] Implement expression manager (#8788)
• #agent #api #misc [ED-8837] [Agent v1] Add predefined path support for nodespecs (#8754)
• [ED-8813] [Agent v1] add fromk8s macros to cel expressions #agent v1 (#8795)
• [ED-8601] [Agent v1] threshold node #agent (#8569)
• #agent [ED-8790] Stateful collector for Kubernetes (#8759)
• #agent Wrap ed-trace-files value with quotes (#8807)
• [ED-8805] Fix missing import in selfprofiler package #agent (#8809)
• #agent #api [ED-8792] added tls config option on-prem elastic backend (#8768)
• #agent [ED-8799] fixed outgoing stats calculation #agent (#8785)
• [ED-8805] Fix handleSIGPROF function signature inconsistency #agent (#8783)
• [ED-8797] [Agent v1] add owner for histogram when publish them in expvar #agent (#8771)
• #agent [ED-8789] Stateful collector for Docker (#8757)
• #agent [ED-8360] Stateful stats for System process (#8751)
• [ED-8779] [Agent v1] CEL manager interface #agent (#8731)
• #agent [ED-8359] Stateful stats for Agent/Process (#8747)
• #agent #misc [ED-8266] [Agent v1] Support agent ingestion toggle (#8621)
• #agent #misc [Agent v1] Change internal map structure of items (#8737)
• #agent #api #misc [ED-8765] [Agent v1] Migrate remainder of agent v1 dependent places to use logger interface (#8716)
• #agent #misc [ED-8766] [Agent v1] Add support for 3 integration test cases as well as EDPort output (#8719)
• #agent [ED-8392] Manager of metrics registries (#8687)

v0.1.64 - Monday, May 1 2023, 10:32 UTC

• [ED-8759] [Agent v1] add caching for log enrichment #agent config v3 (#8706)
• [ED-8744] [Agent v1] add integration test for filter component for #agent v3 (#8695)
• add send as is validation to elastic config #api #agent(#8711)
• #agent #misc [Agent v1] Add missing nodespecs for internal nodes (#8625)
• #agent Fix indexing error in container ID parsing (#8710)
• [ED-8532] #agent Upgrade health/manager interface to register/deregister components (#8512)
• #agent [ED-8738] Fix the self container ID parsing (#8688)

v0.1.63 - Thursday, April 27 2023, 18:03 UTC

• [ED-8734] [Agent v1] Fix Windows Build For K8S Tracer Items #agent #misc (#8671)
• [ED-8722] Recreate k8 pod informer to watch cluster-wide pod updates if existing one only watches local pods. #agent (#8663)
• #agent [ED-8728] fixed outgoing stats report interval for third party pushers (#8668)
• Handle null obs return when there's no log in the flush period. #agent (#8650)
• #agent #misc [ED-8230] [Agent v1] Support K8s Traffic item (#8620)
• #agent Log warning when no config is found for workflow's destination. (#8642)
• [ED-8651] [Agent v1] add integration tests for fluentd input #agent config v3 (#8548)
• [ED-6279] #agent Don't log tracer error if precondition is not met. (#8609)
• [ED-8570] [Agent v1] add udp support for edport input for #agent config v3 (#8505)
• handle non retryalbe error for s3 presigned uploader #agent (#8596)
• #agent [ED-8685] Add option to omit root names for wavefront pusher (#8595)
• [ED-8208] #agent v1 pipeline performance tests framework (#8464)

v0.1.62 - Friday, April 21 2023, 02:20 UTC

• [ED-8669] add validation step before agent start #agent (#8580)
• #agent [ED-8465] [Agent v1] Inject logger library as parametrized dependency instead of global dependency (#8555)
• [ED-8638] #agent Set outputbuffer to nil if it fails to start to avoid agent crash (#8532)
• #agent Remove PVC dependency of aggregator (#8519)
• #agent #api [ED-8566] add granular metric drop column option (#8459)

v0.1.61 - Friday, April 14 2023, 08:05 UTC

• #agent #oncall [ED-8597] Fix Helm template bug and add validation on Helm release time (#8484)
• [ED-8532] #agent Health/manager interface (#8488)
• [ED-7954] [Agent v1] route node implementation #agent (#8405)
• [ED-8561] [Agent v1] add fluentd input for #agent config v3 (#8455)
• #agent [ED-8532] Refactor init of agent v1 (#8429)

v0.1.60 - Wednesday, April 12 2023, 15:09 UTC

• [ED-8571] rename TLS disable_verify to ignore_certificate_check #agent #api (#8467)
• #agent [ED-8560] - Add minutely buffer for s3 metric repo to reduce file count (#8451)
• [ED-8477] #api Support v1 rehydration from avro archive and some other improvements (#8427)
• [ED-8114] #agent Dispatch ebpf metrics to repo according to configuration (#8441)
• [ED-8525] [Agent v1] add edport input for #agent config v3 (#8433)
• [ED-8100] increase essential metric reporting interval #agent #api (#8012)
• [ED-8547] [Agent v1] Adapt some agent integration test #agent (#8431)
• [ED-8532] #agent Concentrate initialization of agent v1 (#8440)
• [ED-8532] #agent Default values for agent runtime (#8439)

v0.1.59 - Monday, April 10 2023, 11:52 UTC

• fixed #agent crash due to concurrent map read/write (#8432)
• [ED-8490] [Agent v1] Adapt dimensions agent integration tests to also use config v3 and some bugfixes #agent #misc (#8393)
• [ED-8424] Fix aggregator to have incorrect pipelines via source detection #agent (#8413)
• [ED-7758] Diagnostics upload to S3 #agent (#8281)
• Add an intermediate writer between avro file and zstd encoder to count output size. #agent (#8389)
• [ED-8457] [Agent v1] Add OpenMetrics output node #agent #misc (#8350)
• [ED-8375] add elastic queries for pod_count, distinct counts and min #agent version #api (#8311)
• [ED-8363] [Agent v1] Implement extract JSON field processor #agent #misc (#8332)
• [ED-8408] [Agent v1] Implement Sumologic pusher with legacy output option #agent #misc (#8305)
• [ED-8451] [ED-8452] Fix name collision for multipushers and multinotifiers and other fixes #agent (#8348)
• [ED-8364] [Agent v1] Provide exec input node #agent #misc (#8335)
• [ED-8216] - Inject separate streamers to metric multi repo #agent (#8368)
• [ED-8481] Init contrack client explicitly and enforce one running tracer instance #agent (#8371)
• [ED-8468] Remove ebpf tracer's dependency on CGO by attaching XDP program using netlink #agent (#8357)
• [ED-8471] fix cloudwatch tailer not ingesting issue #agent (#8364)
• Update nodespecs terraform #agent #misc (#8363)
• fix nodespecs-release job #agent (#8362)
• Return error when specified encoding/compression is unknown. #agent (#8361)
• [ED-8456] [Agent v1] nodespecs improvements for #agent config v3 (#8351)
• [ED-8441][Agent v1] remove duplicate object defs for nodespecs #agent v3 #api (#8343)
• [ED-8389] Support creating archive files in avro format #agent (#8297)
• [ED-8232] [Agent v1] Add logs enrichment processor for #agent config v3 #api (#8145)
• [ED-8443] Add volume mounting support for #agent helm charts #misc (#8345)
• [ED-8416] Fix/update #agent backend ingestion settings handling mechanisms (#8325)
• [ED-7552] added distinct count regex processor #agent (#7854)
• add logs to cloudwatch tailer #agent (#8319)
• [Agent v1] Fix config migrator tests #agent #misc (#8327)
• [ED-8231] [Agent v1] Initial iteration for migration tool for v2 configs #agent #misc (#8236)
• [ED-7925] [Agent v1] Rename existing nodes based on architectural decision #agent #misc (#8308)
• [ED-7758] Use conf_id instead of tag for pipelines #agent (#8283)
• Move shared Agent/BE dependencies #agent #api (#8215)
• Fix cast error in diagnostic/manager #agent (#8315)
• [Agent v1] Add config fields and validation for route node type #agent #misc (#8235)
• [Agent v1] Input node lifecycle changes #agent #misc (#8244)
• [ED-8028] fixed set of labels for Prometheus metric to guarantee metric cardinality #agent (#8061)
• [ED-8390] small config unmarshal/validate changes #api #agent (#8279)
• [ED-8241] add granular metric option to #agent (#8141)
• [ED-7757] Gather diagnostics from archiver node #agent (#8247)
• add source type to pod count metric #agent (#8271)
• Fix #agent helm invalid if/end mismatch (#8278)
• Add parent information to source and group names for source detection #agent (#8262)
• [ED-8305] Fix ebpf tracer agent DNS resolve falure #agent (#8245)