Commit Graph
1544 Commits
Author SHA1 Message Date
Sai Medhini Reddy MaryadaandGitHub 2ab3a40307 Updated the get_policy API in the index_management plugin to allow the policy_id argument as optional (#633)
Signed-off-by: saimedhi <[email protected]>
2024-01-10 23:08:41 -08:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>dependabot[bot] <dependabot[bot]@users.noreply.github.com>
33c2060f6b Update pytest-asyncio requirement from <=0.23.2 to <=0.23.3 (#642)
* Update pytest-asyncio requirement from <=0.23.2 to <=0.23.3

Updates the requirements on [pytest-asyncio](https://github.com/pytest-dev/pytest-asyncio) to permit the latest version.
- [Release notes](https://github.com/pytest-dev/pytest-asyncio/releases)
- [Commits](https://github.com/pytest-dev/pytest-asyncio/compare/v0.1.1...v0.23.3)

---
updated-dependencies:
- dependency-name: pytest-asyncio
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
2024-01-08 11:37:45 -05:00
odelmarcelleandGitHub 3eba72c320 Reusable async client (#639)
* set aiohttp.ClientSession to None after close()

Signed-off-by: odlmarce <[email protected]>

* add test

Signed-off-by: odlmarce <[email protected]>

* update changelog

Signed-off-by: odlmarce <[email protected]>

* update changelog + format
Signed-off-by: odlmarce <[email protected]>

* update changelog
Signed-off-by: odlmarce <[email protected]>

* add tests using `with` and synchronous client
Signed-off-by: odlmarce <[email protected]>

* fix `urllib3.exceptions.ClosedPoolError` breaking synchronous client after `close`
Signed-off-by: odlmarce <[email protected]>

* update changelog
Signed-off-by: odlmarce <[email protected]>

* separate tests
Signed-off-by: odlmarce <[email protected]>

* refactor pool factory as lambda
Signed-off-by: odlmarce <[email protected]>

---------

Signed-off-by: odlmarce <[email protected]>
2024-01-02 13:33:24 -05:00
Mark CohenandGitHub 7b0b58d12b samples directory now passes the missing-function-docstring linter (#640)
* updated files with docstrings to pass pylint

Signed-off-by: Mark Cohen <[email protected]>

* updated samples to prepare for enabling missing-docstring linter; will continue to work on this before committing setup.cfg

Signed-off-by: Mark Cohen <[email protected]>

* removed missing-function-docstring from setup.cfg so the linter doesn't fail while work on docstrings continues

Signed-off-by: Mark Cohen <[email protected]>

* corrected unnecessary return docstring values

Signed-off-by: Mark Cohen <[email protected]>

* fixing failure in 'black' on reformatting

Signed-off-by: Mark Cohen <[email protected]>

---------

Signed-off-by: Mark Cohen <[email protected]>
2023-12-22 12:32:48 -08:00
Sai Medhini Reddy MaryadaandGitHub e323ab2435 Bumps urllib3 from >=1.26.18 to >=1.26.18, <2 (#632)
Signed-off-by: saimedhi <[email protected]>
2023-12-15 10:41:29 -05:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>dependabot[bot] <dependabot[bot]@users.noreply.github.com>
c4e53d444a Update pytest-asyncio requirement from <=0.21.1 to <=0.23.2 (#625)
* Update pytest-asyncio requirement from <=0.21.1 to <=0.23.2

Updates the requirements on [pytest-asyncio](https://github.com/pytest-dev/pytest-asyncio) to permit the latest version.
- [Release notes](https://github.com/pytest-dev/pytest-asyncio/releases)
- [Commits](https://github.com/pytest-dev/pytest-asyncio/compare/v0.1.1...v0.23.2)

---
updated-dependencies:
- dependency-name: pytest-asyncio
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
2023-12-11 16:50:46 -05:00
DJ CarrilloandGitHub db61b5943b Added fix for key error because of missing 'hits' key. (#616)
Updated CHANGELOG.md.



nox formatting applied.



Added new unit test for actions scan function.



Added type hints & nox formatting.



Added fix to async scan function & added matching unit tests for async.

Signed-off-by: Djcarrillo6 <[email protected]>
2023-12-04 09:26:25 -05:00
Daniel (dB.) DoubrovkineandGitHub 44f916ca52 Add OpenSearch 2.11.1 integration tests. (#584)
* Add OpenSearch 2.11.1 integration tests.

Signed-off-by: dblock <[email protected]>

* Exclude flaky integration tests with OpenSearch 2.0.1.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-12-01 09:35:58 -08:00
James AddisonandGitHub 0837c5b916 Remove unnecessary utf-8 header in license_headers.py (follow-up to #615) (#617)
* License tools: remove utf-8 coding declaration from license_headers.py check/fix script; since #615 it is no longer used in the library's codebase

UTF-8 is the default encoding used to read source code files for Python3 - see https://docs.python.org/3/howto/unicode.html#unicode-literals-in-python-source-code

Signed-off-by: James Addison <[email protected]>

* Cleanup: remove utf-8 coding declaration from the license_headers.py script itself

Signed-off-by: James Addison <[email protected]>

* Update CHANGELOG.md

Signed-off-by: James Addison <[email protected]>

---------

Signed-off-by: James Addison <[email protected]>
2023-11-28 14:00:31 -05:00
Samuel OrjiandGitHub 6f26eb3e8e remove unnecessary utf-8 header in .py files (#615)
* remove unnecessary utf-8 header in .py files

Signed-off-by: samuel orji <[email protected]>

* review feedback: add link to changelog

Signed-off-by: samuel orji <[email protected]>

---------

Signed-off-by: samuel orji <[email protected]>
2023-11-24 16:19:50 -05:00
Zelin HaoandGitHub 5b28423f71 Update the GHA release workflow with trusted publisher enabled (#614)
* Add GitHub action for opensearch-py release

Signed-off-by: Zelin Hao <[email protected]>

* Generate GitHub release at the end

Signed-off-by: Zelin Hao <[email protected]>

* Update CHANGELOG

Signed-off-by: Zelin Hao <[email protected]>

* Update CHANGELOG

Signed-off-by: Zelin Hao <[email protected]>

---------

Signed-off-by: Zelin Hao <[email protected]>
2023-11-22 20:49:47 -05:00
DJ CarrilloandGitHub 0cb345db6e Added a guide & sample for a custom logger client implementation. (#579)
* Added a guide & sample for a custom logger client implementation.

Signed-off-by: Djcarrillo6 <[email protected]>

Black formatter

Signed-off-by: Djcarrillo6 <[email protected]>

* Changes from PR review

Signed-off-by: Djcarrillo6 <[email protected]>

Fixed import formatting in sample code for gudie.

Signed-off-by: Djcarrillo6 <[email protected]>

Fixed nox formatting of log collection sample module.

Signed-off-by: Djcarrillo6 <[email protected]>

Added types to log_collection_sample.py

Signed-off-by: Djcarrillo6 <[email protected]>

Added type ignore to StramHandler class

Signed-off-by: Djcarrillo6 <[email protected]>

Added formatting change

Signed-off-by: Djcarrillo6 <[email protected]>

* Added PR review changes.

Signed-off-by: Djcarrillo6 <[email protected]>

Fixed typo in CHANGELOG.

Signed-off-by: Djcarrillo6 <[email protected]>

Requested changes.

Signed-off-by: Djcarrillo6 <[email protected]>

Requested changes again.

Signed-off-by: Djcarrillo6 <[email protected]>

Added link in USER_GUIDE.md.

Signed-off-by: Djcarrillo6 <[email protected]>

---------

Signed-off-by: Djcarrillo6 <[email protected]>
2023-11-22 09:14:12 -05:00
Daniel (dB.) DoubrovkineandGitHub e92eac2c82 Enabled pylint:pointless-statement. (#611)
Signed-off-by: dblock <[email protected]>
2023-11-21 12:55:24 -08:00
Daniel (dB.) DoubrovkineandGitHub 1801ada270 Added pylint, enforce naming. (#590)
* Added pylint.

Signed-off-by: dblock <[email protected]>

* Enforce pylint:invalid-name.

Signed-off-by: dblock <[email protected]>

* Updated the generated code header to prevent broken links.

Signed-off-by: dblock <[email protected]>

* Swapped order of messages.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-21 10:04:39 -08:00
Daniel (dB.) DoubrovkineandGitHub cfd585b289 Preparing for next developer iteration, 2.4.3. (#606)
Signed-off-by: dblock <[email protected]>
2023-11-19 18:18:43 -05:00
Daniel (dB.) DoubrovkineandGitHub 103bc89486 Fixes a suspicious setattr that should be taking an Any (#604)
* Fix invalid value type.

Signed-off-by: dblock <[email protected]>

* Workaround Incompatible types in assignment (expression has type float, variable has type Double)  [assignment]

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-17 16:54:54 -05:00
Daniel (dB.) DoubrovkineandGitHub 7509a15ef3 Fix Amazon OpenSearch Serverless integration with LangChain. (#603)
Signed-off-by: dblock <[email protected]>
2023-11-17 16:09:19 -05:00
Daniel (dB.) DoubrovkineandGitHub c66e1e37be Fix: TypeError on calling parallel_bulk. (#601)
* Fix: TypeError on calling parallel_bulk.

Signed-off-by: dblock <[email protected]>

* Added a sample that uses a bulk function generator.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-17 10:18:42 -08:00
Daniel (dB.) DoubrovkineandGitHub 567ede3023 Preparing for next development iteration, 2.4.2. (#597)
Signed-off-by: dblock <[email protected]>
2023-11-15 22:53:40 -05:00
Daniel (dB.) DoubrovkineandGitHub cec268e48d Fix for 592 (#594)
* Prepare for next developer iteration, 2.4.1.

Signed-off-by: dblock <[email protected]>

* Fix: sync opensearchpy without iohttp.

Signed-off-by: dblock <[email protected]>

* Use nox to run tests.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-15 16:33:43 -08:00
Daniel (dB.) DoubrovkineandGitHub 4874437fb5 Fix: version number in filename for distribution. (#588)
Signed-off-by: dblock <[email protected]>
2023-11-15 15:03:06 -05:00
Daniel (dB.) DoubrovkineandGitHub a0e8bd729d Add 2.11.0 to the test matrix. (#587)
Signed-off-by: dblock <[email protected]>
2023-11-15 12:31:32 -05:00
Daniel (dB.) DoubrovkineandGitHub 435803439c Remove 2.11. (#583)
Signed-off-by: dblock <[email protected]>
2023-11-14 22:53:02 -05:00
Daniel (dB.) DoubrovkineandGitHub 1da810c2eb Preparing for release, 2.4.0 (#581)
* Preparing for release, 2.4.0.

Signed-off-by: dblock <[email protected]>

* Added OpenSearch 2.11.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-14 14:15:54 -05:00
Daniel (dB.) DoubrovkineandGitHub e68b9e762d Added client-level REST helpers. (#544)
* Added client-level REST helpers.

Signed-off-by: dblock <[email protected]>

* Move functions into an .http namespace.

Signed-off-by: dblock <[email protected]>

* Poetry update in samples.

Signed-off-by: dblock <[email protected]>

* Fix: typo.

Signed-off-by: dblock <[email protected]>

* Clarified what to use in which older versions.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-13 12:52:13 -08:00
dependabot[bot]GitHubdependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>dependabot[bot] <dependabot[bot]@users.noreply.github.com>
da436cbbe8 Update coverage requirement from <7.0.0 to <8.0.0 (#578)
* Update coverage requirement from <7.0.0 to <8.0.0

Updates the requirements on [coverage](https://github.com/nedbat/coveragepy) to permit the latest version.
- [Release notes](https://github.com/nedbat/coveragepy/releases)
- [Changelog](https://github.com/nedbat/coveragepy/blob/master/CHANGES.rst)
- [Commits](https://github.com/nedbat/coveragepy/compare/coverage-3.0b1...7.3.2)

---
updated-dependencies:
- dependency-name: coverage
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <[email protected]>

* Update changelog

Signed-off-by: dependabot[bot] <[email protected]>

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
2023-11-13 08:56:06 -05:00
Daniel (dB.) DoubrovkineandGitHub f02d6dee27 Avoid decoding request body unless it needs to be logged. (#571)
Signed-off-by: dblock <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
2023-11-12 11:42:45 -08:00
DJ CarrilloandGitHub f74b30d433 Fixed typo in CHANGELOG from merged PR #576 (#577)
Signed-off-by: Djcarrillo6 <[email protected]>
2023-11-12 11:39:07 -08:00
Daniel (dB.) DoubrovkineandGitHub e079c00b48 Remove support for local client in testing. (#573)
Signed-off-by: dblock <[email protected]>
2023-11-12 08:35:06 -08:00
DJ CarrilloandGitHub 7878364cf0 Removed EOL Python 3.6. Bumped urllib3 to 1.26.18 to patch sec vulnerability. (#576)
Updated change log.

Signed-off-by: Djcarrillo6 <[email protected]>
2023-11-12 10:22:54 -05:00
Daniel (dB.) DoubrovkineandGitHub f410e81d80 Fix: build and deploy docs. (#575)
* Fix: build and deploy docs.

Signed-off-by: dblock <[email protected]>

* Run nox -rs generate.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-11 14:28:43 -08:00
Daniel (dB.) DoubrovkineandGitHub f1d02376e4 Fix: assert deprecation. (#572)
Signed-off-by: dblock <[email protected]>
2023-11-10 10:26:10 -08:00
Daniel (dB.) DoubrovkineandGitHub 55d0e0d7ba Fix asyncio warnings/markers. (#574)
* Fix asyncio warnings/markers.

Signed-off-by: dblock <[email protected]>

* Allow some flexibility in codecov.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-10 10:20:26 -08:00
Daniel (dB.) DoubrovkineandGitHub d8dc5474b7 Expanded nox -rs docs to generate docs. (#568)
Signed-off-by: dblock <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
2023-11-09 23:21:35 -08:00
Daniel (dB.) DoubrovkineandGitHub 58b83d8c06 Added Windows CI. (#569)
Signed-off-by: dblock <[email protected]>
2023-11-09 17:41:37 -08:00
56606ed541 Set enable_cleanup_closed=True to drop TLS connections without a shutdown (#468)
* Set enable_cleanup_closed=True to drop TLS connections without a shutdown

AsyncOpenSearch seems to leak TLS connections due to a missing parameter in `aiohttp.TCPConnector`. This causes #172 and was also fixed "upstream" in this issue https://github.com/elastic/elasticsearch-py/issues/1910. 

Signed-off-by: Sandor Nemes <[email protected]>

* Update CHANGELOG.md

Signed-off-by: Sandor Nemes <[email protected]>

---------

Signed-off-by: Sandor Nemes <[email protected]>
Signed-off-by: Daniel (dB.) Doubrovkine <[email protected]>
Co-authored-by: Daniel (dB.) Doubrovkine <[email protected]>
2023-11-09 18:52:10 -05:00
Daniel (dB.) DoubrovkineandGitHub 56c96d7c4f Expanded type coverage to benchmarks, samples and tests. (#566)
* Renamed json samples to fix duplicate module name.

Signed-off-by: dblock <[email protected]>

* Enabled mypy on all source files.

Signed-off-by: dblock <[email protected]>

* Added missing types.

Signed-off-by: dblock <[email protected]>

* Added CHANGELOG.

Signed-off-by: dblock <[email protected]>

* Move type: ignore to fix untyped decorator makes function untyped.

Signed-off-by: dblock <[email protected]>

* Fix nox -rs lint-3.7.

Signed-off-by: dblock <[email protected]>

* Fixed incorrect import.

Signed-off-by: dblock <[email protected]>

* Fix broken test.

Signed-off-by: dblock <[email protected]>

* Fixed TestBulk::test_bulk_works_with_bytestring_body.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-09 10:51:20 -05:00
Daniel (dB.) DoubrovkineandGitHub dcb79cc322 Merge .pyi type stubs inline (#563)
* Merged types into .py code.

Signed-off-by: dblock <[email protected]>

* Fix: nox -rs generate.

Signed-off-by: dblock <[email protected]>

* Updated CHANGELOG.

Signed-off-by: dblock <[email protected]>

* Use lowest common python version for lint.

Signed-off-by: dblock <[email protected]>

* Fix: don't typeshed.

Signed-off-by: dblock <[email protected]>

* Removed unneeded comment.

Signed-off-by: dblock <[email protected]>

* Simplify OPENSEARCH_URL.

Signed-off-by: dblock <[email protected]>

* Fix: positional ignore_status used as chunk_size.

Signed-off-by: dblock <[email protected]>

* Fix: parse version string.

Signed-off-by: dblock <[email protected]>

* Remove future annotations for Python 3.6.

Signed-off-by: dblock <[email protected]>

* Fix: types in documentation.

Signed-off-by: dblock <[email protected]>

* Improve CHANGELOG text.

Signed-off-by: dblock <[email protected]>

* Re-added missing separator.

Signed-off-by: dblock <[email protected]>

* Remove duplicate licenses.

Signed-off-by: dblock <[email protected]>

* Get rid of Optional[Any].

Signed-off-by: dblock <[email protected]>

* Fix docs with AsyncOpenSearch.

Signed-off-by: dblock <[email protected]>

* Fix: undo comment.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-11-06 10:08:19 -08:00
DJ CarrilloandGitHub 0d8a23dd78 Applied document lifecycle guide & sample. (#559)
Applied pull number to CHNAGELOG.md

Signed-off-by: Djcarrillo6 <[email protected]>
2023-10-30 20:02:30 -07:00
Daniel (dB.) DoubrovkineandGitHub bcfef113c4 Added samples, benchmarks and docs for nox format. (#556)
* Added samples for nox format.

Signed-off-by: dblock <[email protected]>

* Added space after #!/usr/bin/env python.

Signed-off-by: dblock <[email protected]>

* Added benchmarks and docs.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-10-26 19:55:50 -07:00
Daniel (dB.) DoubrovkineandGitHub 0da60b2623 Added a utf-8 header to all .py files (#557)
Signed-off-by: dblock <[email protected]>
2023-10-26 13:34:34 -04:00
Daniel (dB.) DoubrovkineandGitHub 5c7fe9dbde Fix: don't hardcode client class name. (#555)
Signed-off-by: dblock <[email protected]>
2023-10-26 09:30:23 -07:00
Daniel (dB.) DoubrovkineandGitHub 17794bab75 Add a nox session for client generator. (#554)
Signed-off-by: dblock <[email protected]>
2023-10-26 08:55:25 -07:00
Daniel (dB.) DoubrovkineandGitHub ebd50e0515 Override put_mapping definition to make index name optional. (#553)
Signed-off-by: dblock <[email protected]>
2023-10-26 11:31:13 -04:00
Sai Medhini Reddy MaryadaandGitHub fe4b6d754c added remote store client (#552)
Signed-off-by: saimedhi <[email protected]>
2023-10-26 10:59:07 -04:00
Sai Medhini Reddy MaryadaandGitHub 1190079f51 Generate opensearch-py client from API specs (#551)
Signed-off-by: saimedhi <[email protected]>
2023-10-26 10:58:33 -04:00
Daniel (dB.) DoubrovkineandGitHub 59072a67b8 Remove PY2. (#550)
Signed-off-by: dblock <[email protected]>
2023-10-25 08:41:50 -04:00
Daniel (dB.) DoubrovkineandGitHub 627e717534 Remove support for Python 2.x. (#548)
Signed-off-by: dblock <[email protected]>
2023-10-24 07:57:21 -07:00
Daniel (dB.) DoubrovkineandGitHub a1f942b6f9 Added support for AWS Sigv4 for UrlLib3. (#547)
* WIP: Added support for AWS Sigv4 for UrlLib3.

Signed-off-by: dblock <[email protected]>

* Refactored common implementation.

Signed-off-by: dblock <[email protected]>

* Added sigv4 samples.

Signed-off-by: dblock <[email protected]>

* Updated CHANGELOG.

Signed-off-by: dblock <[email protected]>

* Add documentation.

Signed-off-by: dblock <[email protected]>

* Use the correct class in tests.

Signed-off-by: dblock <[email protected]>

* Renamed samples.

Signed-off-by: dblock <[email protected]>

* Split up requests and urllib3 unit tests.

Signed-off-by: dblock <[email protected]>

* Rename AWSV4Signer.

Signed-off-by: dblock <[email protected]>

* Clarified documentation of when to use Urllib3AWSV4SignerAuth vs. RequestHttpConnection.

Signed-off-by: dblock <[email protected]>

* Move fetch_url inside the signer class.

Signed-off-by: dblock <[email protected]>

* Added unit test for Urllib3AWSV4SignerAuth adding headers.

Signed-off-by: dblock <[email protected]>

* Added unit test for signing to include query string.

Signed-off-by: dblock <[email protected]>

---------

Signed-off-by: dblock <[email protected]>
2023-10-23 19:46:19 -04:00
Daniel (dB.) DoubrovkineandGitHub fa8f3a7ae0 Added a guide on making raw JSON REST requests. (#542)
Signed-off-by: dblock <[email protected]>
2023-10-16 12:32:17 -07:00