34 Commits

Author SHA1 Message Date
nathaliellenaa 87aebcd653 Added a support for search (search_after parameter) (#859)
* Added a sample that uses search_after parameter

Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>

* Moved search_after sample to samples/search folder, updated CHANGELOG and _sync sample, and added _async sample.

Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>

* Solved conflicts in CHANGELOG.md

Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>

---------

Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>
2024-12-02 17:14:01 -05:00
Daniel (dB.) Doubrovkine 090e11eee8 Preparing for next developer iteration, 2.8.1. (#861)
Signed-off-by: dblock <dblock@amazon.com>
2024-11-29 13:15:17 -08:00
Daniel (dB.) Doubrovkine 6c9d8f4350 Added async AWS sample. (#857)
Signed-off-by: dblock <dblock@amazon.com>
2024-11-28 08:06:50 -05:00
nathaliellenaa b9e48dc847 Fix AuthorizationException with AWSV4SignerAsyncAuth when the doc ID has special characters. (#848)
* Lifecycle integration tests.

Signed-off-by: dblock <dblock@amazon.com>

* Added a test that makes sure the slash is properly encoded.

Signed-off-by: dblock <dblock@amazon.com>

* Added more tests for signer and _make_path.

Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>

* Prevent AIOHttpConnection from encoding the url a second time.

Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
Signed-off-by: Nathalie Jonathan <nathhjo@amazon.com>
Co-authored-by: dblock <dblock@amazon.com>
2024-11-27 17:50:22 -05:00
Daniel (dB.) Doubrovkine 717122455b Preparing for next developer iteration, 2.7.2. (#807)
Signed-off-by: dblock <dblock@amazon.com>
2024-08-22 09:12:37 -07:00
Daniel (dB.) Doubrovkine b994dc4063 Preparing for next developer iteration, 2.7.1. (#802)
Signed-off-by: dblock <dblock@amazon.com>
2024-08-20 09:47:02 -07:00
Daniel (dB.) Doubrovkine dbc11371db Prepare for release, 2.7.0. (#799)
* Prepare for release, 2.7.0.

Signed-off-by: dblock <dblock@amazon.com>

* Remove references to Jenkins.

Signed-off-by: dblock <dblock@amazon.com>

* Update compatibility matrix.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2024-08-20 08:33:35 -07:00
Daniel (dB.) Doubrovkine 377a7f41d1 Finished guide for working with snapshots. (#796)
* Added guide for snapshot API.

Signed-off-by: dblock <dblock@amazon.com>

* Added instructions for running sample.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
Co-authored-by: roma2023 <romasaparhan19@gmail.com>
2024-08-15 07:52:20 -07:00
Daniel (dB.) Doubrovkine 55f9940d51 Remove HEAD-handling hack. (#794)
* remove HEAD -> GET workaround

Signed-off-by: dblock <dblock@amazon.com>

* Removed remaining HEAD-handling code.

Signed-off-by: dblock <dblock@amazon.com>

* Fixed remaining references to admin:admin.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
Co-authored-by: Vincent Castaneda <vincent.castaneda@sage.com>
2024-08-15 10:15:13 -04:00
Daniel (dB.) Doubrovkine 2d6ae74211 Updated dependencies, generated API. (#793)
* Updated dependencies.

Signed-off-by: dblock <dblock@amazon.com>

* Lock setuptools at 71.1.0.

Newer version seems to cause UserWarning: Unknown distribution option: 'test_suite'.

Signed-off-by: dblock <dblock@amazon.com>

* Updated opensearch-py APIs to reflect opensearch-api-specification@9d3bc34.

Signed-off-by: dblock <dblock@amazon.com>

* Do not test against flaky 2.0.

Signed-off-by: dblock <dblock@amazon.com>

* Reduce test matrix and add 2.16.

Signed-off-by: dblock <dblock@amazon.com>

* Fix missing spaces in generated descriptions.

Signed-off-by: dblock <dblock@amazon.com>

* Removed 2.2.1.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2024-08-14 15:25:01 -07:00
Sai Medhini Reddy Maryada 188b6561e7 Bump version to 2.6.0 (#752)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-05-24 09:16:19 -07:00
Sai Medhini Reddy Maryada ba715b9d3f Dropped support for python 3.6, 3.7 and added support for python 3.12 (#717)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-04-06 11:18:47 -04:00
Mark Cohen a80bab2ad5 Assignment from no return (#658)
* added unnecessary-dunder-call to pylintrc files; disabled for certain lines

in run_tests.py, exception thrown by 'git remote add origin' when the remote already exists will not exit

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updates to adhere to assignment-from-no-return lint

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* simplified get_value_filter in Facet to return None
added assert to test get_value_filter returning None

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added option to output HTML test coverage locally from run_tests.py

returning None from test_faceted_search.Facet.get_value_filter

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added unused-variable lints; replaced unused variables with _ or referenced them

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated CHANGELOG to point to the right PR

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-25 15:17:09 -08:00
Mark Cohen 0ddbf8cafa Pylint integration updates (#643)
* updated files with docstrings to pass pylint

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated samples to prepare for enabling missing-docstring linter; will continue to work on this before committing setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed missing-function-docstring from setup.cfg so the linter doesn't fail while work on docstrings continues

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* corrected unnecessary return docstring values

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* fixing failure in 'black' on reformatting

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated utils to pass missing-function-docstring tests

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated functions with missing docstrings or pylint ignore instructions; added a utility to automatically add these ignore instructions to most functions that should be self-describing; rolled back some automatically generated code mistakenly changed

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* * ignoring opensearchpy for pylint and then added it back to noxfile.py
* fixed some lints; created a feature flag for newer dynamic pylint so now lints can be fixed first in legacy code and then enabled by multiple people
* extracted a method for per-folder linting
* updated noxfile.lint_per_folder with type hints
* enabled unspecified-encoding in pylint
* added disable missing-function-docstring pragma to test_clients.py in test_async and test_server
* added more encodings to pass unspecified-encoding pylint tests
* updated changelog
Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated CHANGELOG.md entry
removed the feature flag for pylint lint_per_folder
fixed failures from mypy and pylint
removed pylint MESSAGE CONTROL config from setup.cfg after relocating to lint_per_folder method
Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed pylint ignore missing-function-docstring

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added pylint.extensions.docparams plugin

updated some docstrings to correct parameters

removed pylint from setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added four lints for opensearchpy/

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* adding await back to client.info() call

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated TODOs as requested

renamed test_opensearchpy.test_async.test_server.test_helpers.conftest.setup_ubq_tests to setup_update_by_query_tests

added
OpenSearch-main/rest-api-spec/src/main/resources/rest-api-spec/test/indices/stats/50_noop_update[0]
to skip tests list

run_tests.py catches a CalledProcessError when the git repo already exists and the command to add the origin fails in fetch_opensearch_repo()

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-19 13:36:05 -05:00
Mark Cohen 7b0b58d12b samples directory now passes the missing-function-docstring linter (#640)
* updated files with docstrings to pass pylint

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated samples to prepare for enabling missing-docstring linter; will continue to work on this before committing setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed missing-function-docstring from setup.cfg so the linter doesn't fail while work on docstrings continues

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* corrected unnecessary return docstring values

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* fixing failure in 'black' on reformatting

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2023-12-22 12:32:48 -08:00
Samuel Orji 6f26eb3e8e remove unnecessary utf-8 header in .py files (#615)
* remove unnecessary utf-8 header in .py files

Signed-off-by: samuel orji <awesomeorji@gmail.com>

* review feedback: add link to changelog

Signed-off-by: samuel orji <awesomeorji@gmail.com>

---------

Signed-off-by: samuel orji <awesomeorji@gmail.com>
2023-11-24 16:19:50 -05:00
DJ Carrillo 0cb345db6e Added a guide & sample for a custom logger client implementation. (#579)
* Added a guide & sample for a custom logger client implementation.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Black formatter

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

* Changes from PR review

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Fixed import formatting in sample code for gudie.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Fixed nox formatting of log collection sample module.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Added types to log_collection_sample.py

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Added type ignore to StramHandler class

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Added formatting change

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

* Added PR review changes.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Fixed typo in CHANGELOG.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Requested changes.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Requested changes again.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

Added link in USER_GUIDE.md.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>

---------

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>
2023-11-22 09:14:12 -05:00
Daniel (dB.) Doubrovkine 1801ada270 Added pylint, enforce naming. (#590)
* Added pylint.

Signed-off-by: dblock <dblock@amazon.com>

* Enforce pylint:invalid-name.

Signed-off-by: dblock <dblock@amazon.com>

* Updated the generated code header to prevent broken links.

Signed-off-by: dblock <dblock@amazon.com>

* Swapped order of messages.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-21 10:04:39 -08:00
Daniel (dB.) Doubrovkine c66e1e37be Fix: TypeError on calling parallel_bulk. (#601)
* Fix: TypeError on calling parallel_bulk.

Signed-off-by: dblock <dblock@amazon.com>

* Added a sample that uses a bulk function generator.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-17 10:18:42 -08:00
Daniel (dB.) Doubrovkine e68b9e762d Added client-level REST helpers. (#544)
* Added client-level REST helpers.

Signed-off-by: dblock <dblock@amazon.com>

* Move functions into an .http namespace.

Signed-off-by: dblock <dblock@amazon.com>

* Poetry update in samples.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: typo.

Signed-off-by: dblock <dblock@amazon.com>

* Clarified what to use in which older versions.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-13 12:52:13 -08:00
Daniel (dB.) Doubrovkine 56c96d7c4f Expanded type coverage to benchmarks, samples and tests. (#566)
* Renamed json samples to fix duplicate module name.

Signed-off-by: dblock <dblock@amazon.com>

* Enabled mypy on all source files.

Signed-off-by: dblock <dblock@amazon.com>

* Added missing types.

Signed-off-by: dblock <dblock@amazon.com>

* Added CHANGELOG.

Signed-off-by: dblock <dblock@amazon.com>

* Move type: ignore to fix untyped decorator makes function untyped.

Signed-off-by: dblock <dblock@amazon.com>

* Fix nox -rs lint-3.7.

Signed-off-by: dblock <dblock@amazon.com>

* Fixed incorrect import.

Signed-off-by: dblock <dblock@amazon.com>

* Fix broken test.

Signed-off-by: dblock <dblock@amazon.com>

* Fixed TestBulk::test_bulk_works_with_bytestring_body.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-09 10:51:20 -05:00
Daniel (dB.) Doubrovkine dcb79cc322 Merge .pyi type stubs inline (#563)
* Merged types into .py code.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: nox -rs generate.

Signed-off-by: dblock <dblock@amazon.com>

* Updated CHANGELOG.

Signed-off-by: dblock <dblock@amazon.com>

* Use lowest common python version for lint.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: don't typeshed.

Signed-off-by: dblock <dblock@amazon.com>

* Removed unneeded comment.

Signed-off-by: dblock <dblock@amazon.com>

* Simplify OPENSEARCH_URL.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: positional ignore_status used as chunk_size.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: parse version string.

Signed-off-by: dblock <dblock@amazon.com>

* Remove future annotations for Python 3.6.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: types in documentation.

Signed-off-by: dblock <dblock@amazon.com>

* Improve CHANGELOG text.

Signed-off-by: dblock <dblock@amazon.com>

* Re-added missing separator.

Signed-off-by: dblock <dblock@amazon.com>

* Remove duplicate licenses.

Signed-off-by: dblock <dblock@amazon.com>

* Get rid of Optional[Any].

Signed-off-by: dblock <dblock@amazon.com>

* Fix docs with AsyncOpenSearch.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: undo comment.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-06 10:08:19 -08:00
DJ Carrillo 0d8a23dd78 Applied document lifecycle guide & sample. (#559)
Applied pull number to CHNAGELOG.md

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>
2023-10-30 20:02:30 -07:00
Daniel (dB.) Doubrovkine bcfef113c4 Added samples, benchmarks and docs for nox format. (#556)
* Added samples for nox format.

Signed-off-by: dblock <dblock@amazon.com>

* Added space after #!/usr/bin/env python.

Signed-off-by: dblock <dblock@amazon.com>

* Added benchmarks and docs.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-10-26 19:55:50 -07:00
Daniel (dB.) Doubrovkine 0da60b2623 Added a utf-8 header to all .py files (#557)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-26 13:34:34 -04:00
Daniel (dB.) Doubrovkine a1f942b6f9 Added support for AWS Sigv4 for UrlLib3. (#547)
* WIP: Added support for AWS Sigv4 for UrlLib3.

Signed-off-by: dblock <dblock@amazon.com>

* Refactored common implementation.

Signed-off-by: dblock <dblock@amazon.com>

* Added sigv4 samples.

Signed-off-by: dblock <dblock@amazon.com>

* Updated CHANGELOG.

Signed-off-by: dblock <dblock@amazon.com>

* Add documentation.

Signed-off-by: dblock <dblock@amazon.com>

* Use the correct class in tests.

Signed-off-by: dblock <dblock@amazon.com>

* Renamed samples.

Signed-off-by: dblock <dblock@amazon.com>

* Split up requests and urllib3 unit tests.

Signed-off-by: dblock <dblock@amazon.com>

* Rename AWSV4Signer.

Signed-off-by: dblock <dblock@amazon.com>

* Clarified documentation of when to use Urllib3AWSV4SignerAuth vs. RequestHttpConnection.

Signed-off-by: dblock <dblock@amazon.com>

* Move fetch_url inside the signer class.

Signed-off-by: dblock <dblock@amazon.com>

* Added unit test for Urllib3AWSV4SignerAuth adding headers.

Signed-off-by: dblock <dblock@amazon.com>

* Added unit test for signing to include query string.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-10-23 19:46:19 -04:00
Daniel (dB.) Doubrovkine fa8f3a7ae0 Added a guide on making raw JSON REST requests. (#542)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-16 12:32:17 -07:00
DJ Carrillo d9a7050df4 Added advanced index actioins guide & sample code file. (#541)
Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>
2023-10-16 11:27:22 -04:00
DJ Carrillo 84ac172ddc Added new guide & sample module for using index templates. (#531)
Added index_template guide and sample



Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>
2023-10-11 10:11:35 -07:00
Raman Saparkhan 29c6445dcc [CCI][GUIDE] Minor fixes to poetry docs (#494)
* minor fixes to poetry docs

Signed-off-by: Raman Saparkhan <romasaparhan19@gmail.com>

* updated CHANGELOG.md

Signed-off-by: Raman Saparkhan <romasaparhan19@gmail.com>

* updated CHANGELOG.md

Signed-off-by: Raman Saparkhan <romasaparhan19@gmail.com>

* fixed CHANGELOG.md

Signed-off-by: Raman Saparkhan <romasaparhan19@gmail.com>

---------

Signed-off-by: Raman Saparkhan <romasaparhan19@gmail.com>
2023-09-15 03:07:52 -04:00
Sai Medhini Reddy Maryada caeaa13250 Updated Security Client APIs (#450)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-07-26 18:38:49 -04:00
Daniel (dB.) Doubrovkine 54a517ada9 Added bulk samples and explained error handling. (#448)
* Added bulk samples and explained error handling.

Signed-off-by: dblock <dblock@amazon.com>

* The client can serialize an array for you.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-07-25 19:17:28 -07:00
Daniel (dB.) Doubrovkine f54973e583 Added k-nn user guide and samples. (#449)
* Added k-nn user guide and samples.

Signed-off-by: dblock <dblock@amazon.com>

* Added async samples.

Signed-off-by: dblock <dblock@amazon.com>

* Renamed Lucene Filters with Efficient Filters.

Signed-off-by: dblock <dblock@amazon.com>

* Fixing TOC from Lucene filters to Efficient filters

Signed-off-by: Vacha Shah <vachshah@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
Signed-off-by: Vacha Shah <vachshah@amazon.com>
Co-authored-by: Vacha Shah <vachshah@amazon.com>
2023-07-25 19:04:13 -07:00
Daniel (dB.) Doubrovkine 58217d98ff Reorganize documentation and add samples. (#447)
Signed-off-by: dblock <dblock@amazon.com>
2023-07-24 10:23:51 -07:00