Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Searchable tokenization implementation #581

Merged
merged 6 commits into from
Sep 28, 2022

Conversation

Zhaars
Copy link
Contributor

@Zhaars Zhaars commented Sep 21, 2022

Current tokenization simply replaces data when we write or read. The idea of this PR is to make it possible to replace the data even in the search requests, thus the search will work during tokenization, not only encryption. We need to replace type column1=1234 with column1=54872, where 348729 is the corresponding tokenized value if consistent_tokenization setting is provided.

This PR contains an implementation of searchable tokenization for PostgreSQL for text/binary protocols.

Checklist

Implement searchable tokenization for PostgreSQL for text/binary protocols
@Zhaars Zhaars requested a review from Lagovas September 21, 2022 19:22
@Zhaars Zhaars marked this pull request as ready for review September 26, 2022 09:20
CHANGELOG_DEV.md Outdated Show resolved Hide resolved
encryptor/searchable_query_filter.go Outdated Show resolved Hide resolved
encryptor/searchable_query_filter.go Outdated Show resolved Hide resolved
pseudonymization/tokenizeQuery.go Outdated Show resolved Hide resolved
pseudonymization/tokenizeQuery.go Outdated Show resolved Hide resolved
pseudonymization/tokenizeQuery.go Show resolved Hide resolved
pseudonymization/tokenizeQuery_test.go Outdated Show resolved Hide resolved
Extend SQL syntax for searchable tokenization
@Zhaars Zhaars requested a review from Lagovas September 27, 2022 15:56
Copy link
Collaborator

@Lagovas Lagovas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants