Overview
You can use this document learn about the test cases Edge Delta runs to benchmark the Edge Delta agent.
Specifically, Edge Delta uses the Vector Test Harness tool to obtain benchmark results.
- This tool was developed by Timberio.
- This tool is an open source tool, located in the https://github.com/timberio/vector-test-harness public code repository.
Review the following list of test cases used to benchmark Edge Delta agent:
| Test Case | Description |
| TCP to Blackhole |
In this test case, the flow starts with messages from producers and then terminates with the agent when the messages are ingested to itself. |
| TCP to TCP | In this test case, the agent ingests messages from TCP producers and then pushes the processed messages to a TCP consumer. |
| TCP to HTTP |
In this test case, the agent ingests messages from TCP producers and then pushes the processed messages to an HTTP consumer. |
| File to TCP |
In this test case, the agent ingests messages from files and then pushes the processed messages to a TCP consumer. |
| Regex Parsing |
In this test case, the agent ingests messages from a TCP, then applies an Apache common regex processor, and then pushes the processed messages to a TCP consumer. |
Edge Delta retains the results obtained by Vector, as well as adds results for the Edge Delta agent:
| Test | Edge Delta | Vector | Filebeat | FluentBit | FluentD | Logstash | SplunkUF | SplunkHF |
| TCP to Blackhole | 490.3 mib/s | 86mib/s | Not applicable | 64.4mib/s | 27.7mib/s | 40.6mib/s | Not applicable | Not applicable |
| File to TCP | 110.2 mib/s | 76.7mib/s | 7.8mib/s | 35mib/s | 26.1mib/s | 3.1mib/s | 40.1mib/s | 39mib/s |
| Regex Parsing | 17.1 mib/s | 13.2mib/s | Not applicable | 20.5mib/s | 2.6mib/s | 4.6mib/s | Not applicable | 7.8mib/s |
| TCP to HTTP | 211.2 mib/s | 26.7mib/s | Not applicable | 19.6mib/s | <1mib/s | 2.7mib/s | Not applicable | Not applicable |
| TCP to TCP | 212.7 mib/s | 69.9mib/s | 5mib/s | 67.1mib/s | 3.9mib/s | 10mib/s | 70.4mib/s | 7.6mib/s |
Vector has already performed benchmark test and published the results for different APM tools, including:
- Vector
- Filebeat
- FluentBit
- FluentD
- Logstash
- Splunk UF
- Splunk HF
For more information, including listed results, see https://github.com/timberio/vector#performance.
Quick links