Commit Graph

111 Commits

Author SHA1 Message Date
Sai Medhini Reddy Maryada 1739a988d3 Removed deprecated numpy.float_ and update NumPy/Pandas imports (#762)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-06-17 15:19:13 -07:00
Sai Medhini Reddy Maryada 188b6561e7 Bump version to 2.6.0 (#752)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-05-24 09:16:19 -07:00
opensearch-trigger-bot[bot] ee21471c13 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-05-22) (#749)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-05-22 08:30:08 -07:00
opensearch-trigger-bot[bot] 5b40a85f9a Updated opensearch-py to reflect the latest OpenSearch API spec (2024-05-21) (#747)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-05-20 20:53:47 -07:00
opensearch-trigger-bot[bot] 72173c3fb0 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-05-15) (#742)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-05-15 09:55:45 -07:00
opensearch-trigger-bot[bot] 1bf403c0f2 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-05-10) (#741)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-05-10 10:44:19 -07:00
Sai Medhini Reddy Maryada 9a67bbfd16 fixed generator (#738)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-05-01 16:59:17 -04:00
opensearch-trigger-bot[bot] 303b6c6f64 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-04-24) (#734)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-04-23 22:35:59 -07:00
opensearch-trigger-bot[bot] 26a7b12756 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-04-23) (#732)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-04-23 00:02:15 -07:00
opensearch-trigger-bot[bot] d0aee06e41 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-04-20) (#727)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-04-22 08:52:16 -04:00
opensearch-trigger-bot[bot] 3082d92f7d Updated opensearch-py to reflect the latest OpenSearch API spec (2024-04-19) (#725)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-04-18 21:40:53 -07:00
Sai Medhini Reddy Maryada b47edf906e Code generated using native OpenAPI specification (#724)
* Code generated using native OpenAPI specification

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Code generated using native OpenAPI specification

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Code generated using native OpenAPI specification

Signed-off-by: saimedhi <saimedhi@amazon.com>

---------

Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-04-17 16:22:14 -07:00
Sai Medhini Reddy Maryada 58e9b1d66c Introduced service time metrics to OpenSearch-Py client. (#716)
* Introduced service time metrics to opensearch-py client

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Introduced service time metrics to opensearch-py client

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Introduced service time metrics to opensearch-py client

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Added service time metrics

Signed-off-by: saimedhi <saimedhi@amazon.com>

---------

Signed-off-by: saimedhi <saimedhi@amazon.com>
Signed-off-by: Sai Medhini Reddy Maryada <117196660+saimedhi@users.noreply.github.com>
2024-04-15 07:20:46 -04:00
Sai Medhini Reddy Maryada ba715b9d3f Dropped support for python 3.6, 3.7 and added support for python 3.12 (#717)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-04-06 11:18:47 -04:00
Sai Medhini Reddy Maryada f2265701a4 Bump version to 2.5.0 (#703)
* Bump version to 2.5.0

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Bump version to 2.5.0

Signed-off-by: saimedhi <saimedhi@amazon.com>

---------

Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-03-22 15:44:39 -07:00
opensearch-trigger-bot[bot] c770d88dc9 Updated opensearch-py to reflect the latest OpenSearch API spec (2024-03-22) (#702)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-03-22 16:40:18 -04:00
Sai Medhini Reddy Maryada 25db5d5c8a Modified generator to generate plugins (#700)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-03-22 07:53:28 -04:00
opensearch-trigger-bot[bot] 8b91bb4ddb Updated opensearch-py to reflect the latest OpenSearch API spec (2024-02-07) (#671)
Signed-off-by: GitHub <noreply@github.com>
Co-authored-by: saimedhi <saimedhi@users.noreply.github.com>
2024-02-08 11:41:26 -05:00
Mark Cohen a80bab2ad5 Assignment from no return (#658)
* added unnecessary-dunder-call to pylintrc files; disabled for certain lines

in run_tests.py, exception thrown by 'git remote add origin' when the remote already exists will not exit

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updates to adhere to assignment-from-no-return lint

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* simplified get_value_filter in Facet to return None
added assert to test get_value_filter returning None

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added option to output HTML test coverage locally from run_tests.py

returning None from test_faceted_search.Facet.get_value_filter

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added unused-variable lints; replaced unused variables with _ or referenced them

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated CHANGELOG to point to the right PR

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-25 15:17:09 -08:00
Sai Medhini Reddy Maryada 900ea94ec8 Incorporated API generation into CI workflow and fixed 'generate' nox session (#660)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-01-24 17:46:18 -05:00
Mark Cohen 6e58837993 added unnecessary-dunder-call to pylintrc files; disabled for certain lines (#655)
in run_tests.py, exception thrown by 'git remote add origin' when the remote already exists will not exit

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-22 09:12:57 -05:00
Mark Cohen 7c66e8cf3d Use .pylintrc files (#654)
* switched pylint to a .pylintrc based config

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added invalid-name pylint disable instruction because the framework requires camel case instead of snake case

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-19 16:17:32 -05:00
Mark Cohen 0ddbf8cafa Pylint integration updates (#643)
* updated files with docstrings to pass pylint

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated samples to prepare for enabling missing-docstring linter; will continue to work on this before committing setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed missing-function-docstring from setup.cfg so the linter doesn't fail while work on docstrings continues

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* corrected unnecessary return docstring values

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* fixing failure in 'black' on reformatting

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated utils to pass missing-function-docstring tests

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated functions with missing docstrings or pylint ignore instructions; added a utility to automatically add these ignore instructions to most functions that should be self-describing; rolled back some automatically generated code mistakenly changed

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* * ignoring opensearchpy for pylint and then added it back to noxfile.py
* fixed some lints; created a feature flag for newer dynamic pylint so now lints can be fixed first in legacy code and then enabled by multiple people
* extracted a method for per-folder linting
* updated noxfile.lint_per_folder with type hints
* enabled unspecified-encoding in pylint
* added disable missing-function-docstring pragma to test_clients.py in test_async and test_server
* added more encodings to pass unspecified-encoding pylint tests
* updated changelog
Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated CHANGELOG.md entry
removed the feature flag for pylint lint_per_folder
fixed failures from mypy and pylint
removed pylint MESSAGE CONTROL config from setup.cfg after relocating to lint_per_folder method
Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed pylint ignore missing-function-docstring

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added pylint.extensions.docparams plugin

updated some docstrings to correct parameters

removed pylint from setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added four lints for opensearchpy/

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* adding await back to client.info() call

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated TODOs as requested

renamed test_opensearchpy.test_async.test_server.test_helpers.conftest.setup_ubq_tests to setup_update_by_query_tests

added
OpenSearch-main/rest-api-spec/src/main/resources/rest-api-spec/test/indices/stats/50_noop_update[0]
to skip tests list

run_tests.py catches a CalledProcessError when the git repo already exists and the command to add the origin fails in fetch_opensearch_repo()

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-19 13:36:05 -05:00
Sai Medhini Reddy Maryada 2ab3a40307 Updated the get_policy API in the index_management plugin to allow the policy_id argument as optional (#633)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2024-01-10 23:08:41 -08:00
odelmarcelle 3eba72c320 Reusable async client (#639)
* set aiohttp.ClientSession to None after close()

Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* add test

Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* update changelog

Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* update changelog + format
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* update changelog
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* add tests using `with` and synchronous client
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* fix `urllib3.exceptions.ClosedPoolError` breaking synchronous client after `close`
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* update changelog
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* separate tests
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

* refactor pool factory as lambda
Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>

---------

Signed-off-by: odlmarce <delmarcelle.olivier@gmail.com>
2024-01-02 13:33:24 -05:00
DJ Carrillo db61b5943b Added fix for key error because of missing 'hits' key. (#616)
Updated CHANGELOG.md.



nox formatting applied.



Added new unit test for actions scan function.



Added type hints & nox formatting.



Added fix to async scan function & added matching unit tests for async.

Signed-off-by: Djcarrillo6 <djcarrillo6@yahoo.com>
2023-12-04 09:26:25 -05:00
Samuel Orji 6f26eb3e8e remove unnecessary utf-8 header in .py files (#615)
* remove unnecessary utf-8 header in .py files

Signed-off-by: samuel orji <awesomeorji@gmail.com>

* review feedback: add link to changelog

Signed-off-by: samuel orji <awesomeorji@gmail.com>

---------

Signed-off-by: samuel orji <awesomeorji@gmail.com>
2023-11-24 16:19:50 -05:00
Daniel (dB.) Doubrovkine 1801ada270 Added pylint, enforce naming. (#590)
* Added pylint.

Signed-off-by: dblock <dblock@amazon.com>

* Enforce pylint:invalid-name.

Signed-off-by: dblock <dblock@amazon.com>

* Updated the generated code header to prevent broken links.

Signed-off-by: dblock <dblock@amazon.com>

* Swapped order of messages.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-21 10:04:39 -08:00
Daniel (dB.) Doubrovkine cfd585b289 Preparing for next developer iteration, 2.4.3. (#606)
Signed-off-by: dblock <dblock@amazon.com>
2023-11-19 18:18:43 -05:00
Daniel (dB.) Doubrovkine 103bc89486 Fixes a suspicious setattr that should be taking an Any (#604)
* Fix invalid value type.

Signed-off-by: dblock <dblock@amazon.com>

* Workaround Incompatible types in assignment (expression has type float, variable has type Double)  [assignment]

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-17 16:54:54 -05:00
Daniel (dB.) Doubrovkine 7509a15ef3 Fix Amazon OpenSearch Serverless integration with LangChain. (#603)
Signed-off-by: dblock <dblock@amazon.com>
2023-11-17 16:09:19 -05:00
Daniel (dB.) Doubrovkine c66e1e37be Fix: TypeError on calling parallel_bulk. (#601)
* Fix: TypeError on calling parallel_bulk.

Signed-off-by: dblock <dblock@amazon.com>

* Added a sample that uses a bulk function generator.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-17 10:18:42 -08:00
Daniel (dB.) Doubrovkine 567ede3023 Preparing for next development iteration, 2.4.2. (#597)
Signed-off-by: dblock <dblock@amazon.com>
2023-11-15 22:53:40 -05:00
Daniel (dB.) Doubrovkine cec268e48d Fix for 592 (#594)
* Prepare for next developer iteration, 2.4.1.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: sync opensearchpy without iohttp.

Signed-off-by: dblock <dblock@amazon.com>

* Use nox to run tests.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-15 16:33:43 -08:00
Daniel (dB.) Doubrovkine 1da810c2eb Preparing for release, 2.4.0 (#581)
* Preparing for release, 2.4.0.

Signed-off-by: dblock <dblock@amazon.com>

* Added OpenSearch 2.11.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-14 14:15:54 -05:00
Daniel (dB.) Doubrovkine e68b9e762d Added client-level REST helpers. (#544)
* Added client-level REST helpers.

Signed-off-by: dblock <dblock@amazon.com>

* Move functions into an .http namespace.

Signed-off-by: dblock <dblock@amazon.com>

* Poetry update in samples.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: typo.

Signed-off-by: dblock <dblock@amazon.com>

* Clarified what to use in which older versions.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-13 12:52:13 -08:00
Daniel (dB.) Doubrovkine f02d6dee27 Avoid decoding request body unless it needs to be logged. (#571)
Signed-off-by: dblock <dblock@amazon.com>
Signed-off-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
2023-11-12 11:42:45 -08:00
Daniel (dB.) Doubrovkine f410e81d80 Fix: build and deploy docs. (#575)
* Fix: build and deploy docs.

Signed-off-by: dblock <dblock@amazon.com>

* Run nox -rs generate.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-11 14:28:43 -08:00
Daniel (dB.) Doubrovkine d8dc5474b7 Expanded nox -rs docs to generate docs. (#568)
Signed-off-by: dblock <dblock@amazon.com>
Signed-off-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
2023-11-09 23:21:35 -08:00
Daniel (dB.) Doubrovkine 58b83d8c06 Added Windows CI. (#569)
Signed-off-by: dblock <dblock@amazon.com>
2023-11-09 17:41:37 -08:00
Sandor Nemes 56606ed541 Set enable_cleanup_closed=True to drop TLS connections without a shutdown (#468)
* Set enable_cleanup_closed=True to drop TLS connections without a shutdown

AsyncOpenSearch seems to leak TLS connections due to a missing parameter in `aiohttp.TCPConnector`. This causes #172 and was also fixed "upstream" in this issue https://github.com/elastic/elasticsearch-py/issues/1910. 

Signed-off-by: Sandor Nemes <snemes@users.noreply.github.com>

* Update CHANGELOG.md

Signed-off-by: Sandor Nemes <snemes@users.noreply.github.com>

---------

Signed-off-by: Sandor Nemes <snemes@users.noreply.github.com>
Signed-off-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Co-authored-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
2023-11-09 18:52:10 -05:00
Daniel (dB.) Doubrovkine 56c96d7c4f Expanded type coverage to benchmarks, samples and tests. (#566)
* Renamed json samples to fix duplicate module name.

Signed-off-by: dblock <dblock@amazon.com>

* Enabled mypy on all source files.

Signed-off-by: dblock <dblock@amazon.com>

* Added missing types.

Signed-off-by: dblock <dblock@amazon.com>

* Added CHANGELOG.

Signed-off-by: dblock <dblock@amazon.com>

* Move type: ignore to fix untyped decorator makes function untyped.

Signed-off-by: dblock <dblock@amazon.com>

* Fix nox -rs lint-3.7.

Signed-off-by: dblock <dblock@amazon.com>

* Fixed incorrect import.

Signed-off-by: dblock <dblock@amazon.com>

* Fix broken test.

Signed-off-by: dblock <dblock@amazon.com>

* Fixed TestBulk::test_bulk_works_with_bytestring_body.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-09 10:51:20 -05:00
Daniel (dB.) Doubrovkine dcb79cc322 Merge .pyi type stubs inline (#563)
* Merged types into .py code.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: nox -rs generate.

Signed-off-by: dblock <dblock@amazon.com>

* Updated CHANGELOG.

Signed-off-by: dblock <dblock@amazon.com>

* Use lowest common python version for lint.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: don't typeshed.

Signed-off-by: dblock <dblock@amazon.com>

* Removed unneeded comment.

Signed-off-by: dblock <dblock@amazon.com>

* Simplify OPENSEARCH_URL.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: positional ignore_status used as chunk_size.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: parse version string.

Signed-off-by: dblock <dblock@amazon.com>

* Remove future annotations for Python 3.6.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: types in documentation.

Signed-off-by: dblock <dblock@amazon.com>

* Improve CHANGELOG text.

Signed-off-by: dblock <dblock@amazon.com>

* Re-added missing separator.

Signed-off-by: dblock <dblock@amazon.com>

* Remove duplicate licenses.

Signed-off-by: dblock <dblock@amazon.com>

* Get rid of Optional[Any].

Signed-off-by: dblock <dblock@amazon.com>

* Fix docs with AsyncOpenSearch.

Signed-off-by: dblock <dblock@amazon.com>

* Fix: undo comment.

Signed-off-by: dblock <dblock@amazon.com>

---------

Signed-off-by: dblock <dblock@amazon.com>
2023-11-06 10:08:19 -08:00
Daniel (dB.) Doubrovkine 0da60b2623 Added a utf-8 header to all .py files (#557)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-26 13:34:34 -04:00
Daniel (dB.) Doubrovkine 5c7fe9dbde Fix: don't hardcode client class name. (#555)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-26 09:30:23 -07:00
Daniel (dB.) Doubrovkine ebd50e0515 Override put_mapping definition to make index name optional. (#553)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-26 11:31:13 -04:00
Sai Medhini Reddy Maryada fe4b6d754c added remote store client (#552)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-10-26 10:59:07 -04:00
Sai Medhini Reddy Maryada 1190079f51 Generate opensearch-py client from API specs (#551)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-10-26 10:58:33 -04:00
Daniel (dB.) Doubrovkine 59072a67b8 Remove PY2. (#550)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-25 08:41:50 -04:00
Daniel (dB.) Doubrovkine 627e717534 Remove support for Python 2.x. (#548)
Signed-off-by: dblock <dblock@amazon.com>
2023-10-24 07:57:21 -07:00