Skip to content

chore(codecs): Use simdutf for converting bytes to string#25610

Open
JakubOnderka wants to merge 1 commit into
vectordotdev:masterfrom
JakubOnderka:simdutf-json
Open

chore(codecs): Use simdutf for converting bytes to string#25610
JakubOnderka wants to merge 1 commit into
vectordotdev:masterfrom
JakubOnderka:simdutf-json

Conversation

@JakubOnderka

Copy link
Copy Markdown
Contributor

Summary

Speed up decoding json, elasticsearch sink and journald source by using simdutf8 crate for faster checking if string is UTF-8 valid by utilizing SIMD instructions. simdutf8 is already used in vrl, so I just reuse method that internally uses VRL.

According to crate docs this library is:

x86-64: Up to 23 times faster than the std library on valid non-ASCII, up to four times faster on ASCII
aarch64: Up to eleven times faster than the std library on valid non-ASCII, up to four times faster on ASCII (Apple Silicon)

How did you test this PR?

Standard vector tests

Change Type

  • Bug fix
  • New feature
  • Dependencies
  • Non-functional (chore, refactoring, docs)
  • Performance

Is this a breaking change?

  • Yes
  • No

Does this PR include user facing changes?

Just performance improvement.

  • Yes. Please add a changelog fragment based on our guidelines.
  • No. A maintainer will apply the no-changelog label to this PR.

@JakubOnderka JakubOnderka requested a review from a team as a code owner June 12, 2026 12:39
@github-actions github-actions Bot added domain: sources Anything related to the Vector's sources domain: sinks Anything related to the Vector's sinks labels Jun 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

domain: sinks Anything related to the Vector's sinks domain: sources Anything related to the Vector's sources

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant