adding language analyzers #8591
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
|
Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged. Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer. When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review. |
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
…n analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
…lithuanian,norwegian and persion laguage analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
…rkish language analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
AntonEliatra
requested review from
kolchfa-aws,
Naarcha-AWS,
vagimeli,
AMoo-Miki,
natebower,
dlvenable and
epugh
as code owners
AntonEliatra
changed the title
vagimeli
added
3 - Tech review
kolchfa-aws
requested changes
Nov 6, 2024
There was a problem hiding this comment.
Thank you, @AntonEliatra! Please apply my changes, and we'll get this to editorial review.
| nav_order: 100 | ||
| parent: Analyzers | ||
| has_children: true | ||
| has_toc: false |
There was a problem hiding this comment.
I think it's not a bad idea to have the TOC here. It will list all analyzers on the bottom under Related articles.
|
|
||
| #### Example request | ||
|
|
||
| The following query specifies the `french` language analyzer for the index `my-index`: |
There was a problem hiding this comment.
This request creates a text field with a french subfield configured with the french analyzer. I think we can keep this request but correct the description for it. Also, it would be nice to provide just a plain example with setting an analyzer on the whole index.
There was a problem hiding this comment.
I added additional example
|
|
||
| ## Stem exclusion | ||
|
|
||
| You can also use `stem_exclusion` with this language analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can also use `stem_exclusion` with this language analyzer using the following command: | |
| You can use `stem_exclusion` with this language analyzer using the following command: |
|
|
||
| ## Stem exclusion | ||
|
|
||
| You can also use `stem_exclusion` with this language analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can also use `stem_exclusion` with this language analyzer using the following command: | |
| You can use `stem_exclusion` with this language analyzer using the following command: |
|
|
||
| ## Stem exclusion | ||
|
|
||
| You can also use `stem_exclusion` with this language analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can also use `stem_exclusion` with this language analyzer using the following command: | |
| You can use `stem_exclusion` with this language analyzer using the following command: |
|
|
||
| ## Stem exclusion | ||
|
|
||
| You can also use `stem_exclusion` with this language analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can also use `stem_exclusion` with this language analyzer using the following command: | |
| You can use `stem_exclusion` with this language analyzer using the following command: |
|
|
||
| ## Arabic analyzer internals | ||
|
|
||
| The `arabic` analyzer is build using the following: |
There was a problem hiding this comment.
Global: please apply these changes to all files.
Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com>
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
Signed-off-by: AntonEliatra <anton.rubin@eliatra.com>
Signed-off-by: Anton Rubin <anton.rubin@eliatra.com>
natebower
reviewed
Nov 11, 2024
There was a problem hiding this comment.
@kolchfa-aws @AntonEliatra Please see my comments and changes and let me know if you have any questions. Thanks!
|
|
||
| ## Custom Armenian analyzer | ||
|
|
||
| You can create custom Armenian analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Armenian analyzer using the following command: | |
| You can create a custom Armenian analyzer using the following command: |
|
|
||
| ## Custom Basque analyzer | ||
|
|
||
| You can create custom Basque analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Basque analyzer using the following command: | |
| You can create a custom Basque analyzer using the following command: |
|
|
||
| ## Custom Bengali analyzer | ||
|
|
||
| You can create custom Bengali analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Bengali analyzer using the following command: | |
| You can create a custom Bengali analyzer using the following command: |
|
|
||
| ## Custom Brazilian analyzer | ||
|
|
||
| You can create custom Brazilian analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Brazilian analyzer using the following command: | |
| You can create a custom Brazilian analyzer using the following command: |
|
|
||
| ## Custom Bulgarian analyzer | ||
|
|
||
| You can create custom Bulgarian analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Bulgarian analyzer using the following command: | |
| You can create a custom Bulgarian analyzer using the following command: |
|
|
||
| - Tokenizer: `thai` | ||
|
|
||
| - Token Filters: |
There was a problem hiding this comment.
Suggested change
| - Token Filters: | |
| - Token filters: |
|
|
||
| ## Custom Thai analyzer | ||
|
|
||
| You can create custom Thai analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Thai analyzer using the following command: | |
| You can create a custom Thai analyzer using the following command: |
|
|
||
| - Tokenizer: `standard` | ||
|
|
||
| - Token Filters: |
There was a problem hiding this comment.
Suggested change
| - Token Filters: | |
| - Token filters: |
|
|
||
| ## Custom Turkish analyzer | ||
|
|
||
| You can create custom Turkish analyzer using the following command: |
There was a problem hiding this comment.
Suggested change
| You can create custom Turkish analyzer using the following command: | |
| You can create a custom Turkish analyzer using the following command: |
Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com>
Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com>
Signed-off-by: Fanit Kolchina <kolchfa@amazon.com>
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Nov 14, 2024
* adding arabic language analyzer Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * Add grandparent to arabic analyzer Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> * adding more details Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding armenian language analyzer Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding basque bengali and brazilian language analyzers Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding bulgarian catalan and cjk language analyzers Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding czech,danish,dutch,english,estonian,finnish,french and galician analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding german,greek,hindi,hungarian,indonesian,irish,italian,latvian,lithuanian,norwegian and persion laguage analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding portuguese,romanian,russian,sorani,spanish,swedish,thai and turkish language analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * Apply suggestions from code review Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com> * updating as per pr review Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * fixing broken link Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * Apply suggestions from code review Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com> * Update _analyzers/language-analyzers/index.md Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> * Add redirect to index page Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> --------- Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Co-authored-by: Fanit Kolchina <kolchfa@amazon.com> Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Co-authored-by: Nathan Bower <nbower@amazon.com> (cherry picked from commit c29761c) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
epugh
pushed a commit
to o19s/documentation-website
that referenced
this pull request
Nov 23, 2024
* adding arabic language analyzer Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * Add grandparent to arabic analyzer Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> * adding more details Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding armenian language analyzer Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding basque bengali and brazilian language analyzers Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding bulgarian catalan and cjk language analyzers Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding czech,danish,dutch,english,estonian,finnish,french and galician analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding german,greek,hindi,hungarian,indonesian,irish,italian,latvian,lithuanian,norwegian and persion laguage analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * adding portuguese,romanian,russian,sorani,spanish,swedish,thai and turkish language analyzer docs Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * Apply suggestions from code review Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com> * updating as per pr review Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * fixing broken link Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> * Apply suggestions from code review Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com> * Update _analyzers/language-analyzers/index.md Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> * Add redirect to index page Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> --------- Signed-off-by: Anton Rubin <anton.rubin@eliatra.com> Signed-off-by: Fanit Kolchina <kolchfa@amazon.com> Signed-off-by: AntonEliatra <anton.rubin@eliatra.com> Signed-off-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Co-authored-by: Fanit Kolchina <kolchfa@amazon.com> Co-authored-by: kolchfa-aws <105444904+kolchfa-aws@users.noreply.github.com> Co-authored-by: Nathan Bower <nbower@amazon.com> Signed-off-by: Eric Pugh <epugh@opensourceconnections.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
adding arabic language analyzer
Issues Resolved
Part of #1483 addressed in this PR.
Version
all
Checklist
For more information on following Developer Certificate of Origin and signing off your commits, please check here.