1650 Commits

Author SHA1 Message Date
Sayali Gaikawad 2003156d9e Update jenkins file to use new docker image (#431)
Signed-off-by: Sayali Gaikawad <gaiksaya@amazon.com>
2023-07-07 14:01:25 -07:00
Dan Jones 12ebe82cba Fix string/tuple/no auth on AsyncHttpConnection class (#424)
* Fix string/tuple/no auth on AsyncHttpConnection class. Fixes #283

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Update for PR comments. Add tests.

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Moving tests to its own file.

Also had to install asynctest into the dev-requirements to get access to the context managers necessary to mock out aiohttp.

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Update CHANGELOG

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Linter fixes. Add license text to new file.

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Move AsyncContextManagerMock to utils package for future re-use

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Lint

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Refactor async tests - remove asynctest package

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Switch out to using aiounittest for async testing prior to py3.8

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Use RequestContextManager from opensearchpy._asycn._extra_imports

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Simplify test somewhat, move to `test_async` since all other async tests are ignored on runners <3.6

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

* Lint

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>

---------

Signed-off-by: dannosaur <461956+dannosaur@users.noreply.github.com>
Signed-off-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Co-authored-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
2023-07-06 18:01:52 -04:00
Raman Saparkhan a4b41fbbbc Added Docker Installation Details into DEVELOPER_GUIDE.md (#427)
Signed-off-by: Raman Saparkhan <romasaparhan19@gmail.com>
2023-07-05 12:49:31 -04:00
florianvazelle 2e8d5ce1a5 Index State Management support (#398)
* feat(plugins): add index management client plugin

Signed-off-by: florian <florian@harfanglab.fr>

* chore(CHANGELOG): added entry for ISM api support in changelog

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): use assertEqual to compare call parameters

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): edit policy to support older versions of opensearch

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): ignore plugin tests when opensearch is unreleased

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): move plugin tests into separate files

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): fix import of OpenSearchTestCase

Signed-off-by: florian <florian@harfanglab.fr>

* chore(USER_GUIDE): add a index management plugin part

Signed-off-by: florian <florian@harfanglab.fr>

---------

Signed-off-by: florian <florian@harfanglab.fr>
2023-06-28 16:56:00 -04:00
Sai Medhini Reddy Maryada bc6a50b0b9 Enhanced existing API generator to use OpenSearch OpenAPI spec (#412)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-06-27 11:56:55 -07:00
florianvazelle c60c259d96 Security plugin support (#399)
* feat(plugins): add security client plugin

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): skip security plugin tests when disabled

Signed-off-by: florian <florian@harfanglab.fr>

* fix(security): remove non-ASCII character

Signed-off-by: florian <florian@harfanglab.fr>

* chore(CHANGELOG): added entry for security api support in changelog

Signed-off-by: florian <florian@harfanglab.fr>

* test(plugins): add asynchronous tests version

Signed-off-by: florian <florian@harfanglab.fr>

* test: remove some warnings

Signed-off-by: florian <florian@harfanglab.fr>

* chore(USER_GUIDE): add a security plugin part

Signed-off-by: florian <florian@harfanglab.fr>

* test(security): Split out security plugin tests in its own file

Signed-off-by: florian <florian@harfanglab.fr>

* chore: apply reviews

Signed-off-by: florian <florian@harfanglab.fr>

---------

Signed-off-by: florian <florian@harfanglab.fr>
2023-06-27 11:01:40 -04:00
C. Quentin db972e615b feat: Add a collapse method to opensearchpy.helpers.search.Search (#409)
Signed-off-by: Quentin Coumes <coumes.quentin@gmail.com>
Signed-off-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
Co-authored-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
2023-06-26 19:19:15 -04:00
Sai Medhini Reddy Maryada e5789c7b52 Enhanced the Yaml test runner to utilize the rest-api-spec YAML tests from OpenSearch repo as the input source (#414)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-06-26 19:07:06 -04:00
Sai Medhini Reddy Maryada be57a4d604 Removed tests against Python 2.7 in github workflows (#421)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-06-21 10:42:12 -07:00
Sai Medhini Reddy Maryada f1b5706ebd Added 'allow_redirects' parameter in perform_request function for RequestsHttpConnection (#401)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-06-13 15:15:00 -04:00
dependabot[bot] 237ce9daf6 Update sphinx requirement from <6.3 to <7.1 (#379)
* Update sphinx requirement from <6.3 to <7.1

Updates the requirements on [sphinx](https://github.com/sphinx-doc/sphinx) to permit the latest version.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/master/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v0.1.61611...v7.0.0)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update changelog

Signed-off-by: dependabot[bot] <support@github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
2023-06-06 13:18:00 -04:00
florianvazelle dafc966e4e ci(integration): use matrix value for opensearch version (#400)
Signed-off-by: florian <florian@harfanglab.fr>
2023-05-31 10:06:03 -04:00
Daniel (dB.) Doubrovkine b4c000a7ab Cleaned up the developer guide. (#388)
Signed-off-by: dblock <dblock@amazon.com>
2023-05-30 13:40:05 -04:00
Charles Greer fe3b5a8922 [#387] Do not escape the "timeout" parameter. (#394)
* [#387] Do not escape the "timeout" parameter.

When the "timeout" parameter is escaped and turned into
a string, it does not pass validation checks.
This PR ensures that timeout is passed through as-is,
just like "request_timeout".
There's no explicit test for this parameter, but I included
it on some existing tests just to ensure that the code
is exercised.  Without the fix in place, one of the tests as modified will not pass.

Signed-off-by: Charles Greer <cgreer@lexmachina.com>

* Unit test for timeout parameter

Revert original test modifications.

Signed-off-by: Charles Greer <cgreer@lexmachina.com>

* Extend test and linter

Signed-off-by: Charles Greer <cgreer@lexmachina.com>

---------

Signed-off-by: Charles Greer <cgreer@lexmachina.com>
2023-05-23 18:12:29 -04:00
Sai Medhini Reddy Maryada 0395798d2b Fixed flaky CI tests by replacing httpbin with a simple http_server (#395)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-05-23 18:07:47 -04:00
Sai Medhini Reddy Maryada 3fcddc98c7 Updated Compatibility Matrix with the latest Client and OpenSearch Versions (#381)
Signed-off-by: saimedhi <saimedhi@amazon.com>
Signed-off-by: Sai Medhini Reddy Maryada <117196660+saimedhi@users.noreply.github.com>
2023-05-17 15:05:43 -07:00
Daniel (dB.) Doubrovkine cef6e1b911 Added MacOS to GitHub CI. (#390)
Signed-off-by: dblock <dblock@amazon.com>
2023-05-15 14:48:05 -07:00
gg-kialo 707373e369 Include parsed error info in TransportError in async connections (#226)
Passing the Content-Type to `_raise_errors` will cause the json body to
be parsed and included in the `TransportError`.

This matches the behaviour of the sync client.

Fixes #225

Signed-off-by: Gordon Govan <gg@kialo.com>
2023-05-09 15:16:03 -04:00
Sai Medhini Reddy Maryada 2abb8c4317 Updated pyi file for point in time API (#378)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-04-28 13:11:37 -04:00
dependabot[bot] 83be2cd0e7 Update sphinx requirement from <1.7 to <6.3 (#374)
* Update sphinx requirement from <1.7 to <6.3

Updates the requirements on [sphinx](https://github.com/sphinx-doc/sphinx) to permit the latest version.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/master/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/0.1.61611...v6.2.0)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update changelog

Signed-off-by: dependabot[bot] <support@github.com>

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot[bot] <dependabot[bot]@users.noreply.github.com>
2023-04-24 10:34:10 -07:00
Alexei Karikov 12b274884c [CCI] Create index lifecycle guide (#362)
* Create index lifecycle guide

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>

* Add changelog entry

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>

* Replace ignore param and add short corrections

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>

* reset spaces

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>

* Correct indents

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>

---------

Signed-off-by: Alexei Karikov <karikov.alist.ru@gmail.com>
2023-04-24 10:33:51 -07:00
jonathan drysdale-anderson 5fa4e8c9a6 [Guide] Search Added (#356)
* Create search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Update search.md

Signed-off-by: jonathan <jonadrys@gmail.com>

* Updated ChangeLog

Signed-off-by: jonathan <jonadrys@gmail.com>

---------

Signed-off-by: jonathan <jonadrys@gmail.com>
2023-04-20 19:57:00 -07:00
Daniyar Auezkhan 03b72c3c92 fix: added codecov to ci and made linter happy :) (#335)
Signed-off-by: bl1nkker <nurovich14@gmail.com>
2023-04-03 18:20:21 -07:00
Sai Medhini Reddy Maryada 23611ebda4 Upgrading pytest-asyncio to latest version - 0.21.0 (#339)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-03-28 11:14:33 -07:00
Sai Medhini Reddy Maryada df3a39f1a0 Updated user_guide for async client (#340)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-03-28 13:21:07 -04:00
Sai Medhini Reddy Maryada 51eb6e5cca Updated user_guide for async client (#338)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-03-24 07:55:31 -04:00
jayzfbn a495a20417 fix async example (#330)
Signed-off-by: Jay Zarfoss <jzarfoss@farmersbusinessnetwork.com>
2023-03-20 16:30:48 -04:00
Sai Medhini Reddy Maryada 2b9aee73a5 Added async support for helpers that are merged from opensearch-dsl-py (#329)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-03-17 12:03:46 -07:00
Yury-Fridlyand 409c883013 Update ci workflows (#318)
* Update CI workflows to include more Python and OpenSearch versions and run faster.

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>

* Fix CI workflows.

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>

* Add `OPENSEARCH_VERSION` variable.

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>

* Set `OPENSEARCH_VERSION` to constant.

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>

* CHANGELOG.md

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>

* Add 2.6.0 version to test matrix.

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>

---------

Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>
Co-authored-by: Daniel (dB.) Doubrovkine <dblock@amazon.com>
2023-03-13 13:27:56 -07:00
Harsha Vamsi Kalluri 06f7dd44f8 Fixes changelog links (#319)
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
2023-03-11 11:51:20 -05:00
aiudirog f1f73e7ff2 Fixed utils/build-dists.py which was broken by 49ae7c7 (#316)
* Fixed utils/build-dists.py which was broken by 49ae7c7
Previously the async helpers imported AsyncOpenSearch and therefore failed to import anytime it did

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

* Refactor async helpers try block to a simple if statement

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

* Remove newline to pass black

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

---------

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>
2023-03-08 17:34:43 -08:00
Sayali Gaikawad 4f66eb8ab9 Add 2PR approval to release workflow (#306)
* Add 2PR approval to release workflow

Signed-off-by: Sayali Gaikawad <gaiksaya@amazon.com>

* Update .github/workflows/release-drafter.yml

Signed-off-by: Sayali Gaikawad <gaiksaya@amazon.com>

Co-authored-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

---------

Signed-off-by: Sayali Gaikawad <gaiksaya@amazon.com>
Co-authored-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
2023-03-08 12:33:39 -08:00
aiudirog 49ae7c76e0 Fix async helpers import cycle (#311)
* Import async helpers through public interface in tests

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

* Removed unused import of AsyncOpenSearch in async helpers that was causing an import cycle (fixes #310)

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

* Update CHANGELOG.md

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

* Change 2.2.1 in the changelog to Unreleased

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

* Separated changelog entries for 2.2.0 from 2.1.1

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>

---------

Signed-off-by: Roger Aiudi <aiudirog@gmail.com>
2023-03-08 15:05:06 -05:00
Sai Medhini Reddy Maryada 05326ba547 Added upgrading.md file and updated it for opensearch-py 2.2.0 release (#293)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-02-21 15:34:47 -08:00
Vacha Shah 754dcc7339 Removing low-level and high-level client terminology (#298)
Signed-off-by: Vacha Shah <vachshah@amazon.com>
2023-02-21 15:06:39 -08:00
Sai Medhini Reddy Maryada b26e2f37c1 Fixed CVE - issue 86 mentioned in opensearch-dsl-py repo (#295)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-02-16 15:10:03 -08:00
Sai Medhini Reddy Maryada c58375aa7b Merging opensearch-dsl-py to opensearch-py (#287)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-02-14 15:03:56 -08:00
Sai Medhini Reddy Maryada 93636399ec Removed 'out/opensearchpy' folder which was produced while generating pyi files for plugins (#288)
Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-02-14 11:09:14 -08:00
Daniel (dB.) Doubrovkine 3d1dd7bbce Created untriaged issue workflow. (#290)
Signed-off-by: dblock <dblock@amazon.com>
2023-02-14 11:08:38 -08:00
Theo Nam Truong 58aa041db3 Fixed Sigv4 Signing for Managed Service (#279)
Fixed SigV4 Signing for Async Requests with QueryStrings

Signed-off-by: Theo Truong <theotr@amazon.com>

Signed-off-by: Theo Truong <theotr@amazon.com>
2023-01-23 18:38:31 -08:00
Harsha Vamsi Kalluri 4059251c13 Bump version to 2.1.0 (#277)
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
2023-01-20 14:58:31 -08:00
Sai Medhini Reddy Maryada 176c78c58e Updated CI tests to make them work locally (#275)
Signed-off-by: saimedhi <saimedhi@amazon.com>

Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-01-19 15:20:19 -08:00
Sai Medhini Reddy Maryada 7d83a69494 Adding explicit parameters for AIOHttpConnection and AsyncTransport (#276)
Signed-off-by: saimedhi <saimedhi@amazon.com>

Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-01-19 15:15:35 -08:00
Harsha Vamsi Kalluri 5c1c890f69 Abstract away service name (#268)
* Abstract away service name

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Compuute x-amz-content-256 header

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix async signing

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Adds types-six to dependencies

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Optionally remove Content-Length

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix dict typo

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Remove requirement for x-amz-content-sha256 header

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Remove deletion of content-length

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Fix capitalization

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

* Adding unit tests

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
2023-01-18 18:06:59 -05:00
Thomas Farr c73e46381e Ensure Dependabot PR workflow retriggers on label change (#269)
Solves a race condition when PR is created but not yet labeled.

Signed-off-by: Thomas Farr <tsfarr@amazon.com>

Signed-off-by: Thomas Farr <tsfarr@amazon.com>
2023-01-17 08:47:03 -08:00
Sai Medhini Reddy Maryada 054d669139 Removed patch versions in integration tests for OpenSearch 1.0.0 - 2.3.0 to reduce Github Action jobs (#262)
Signed-off-by: saimedhi <saimedhi@amazon.com>

Signed-off-by: saimedhi <saimedhi@amazon.com>
2023-01-08 12:10:37 -05:00
Daniel (dB.) Doubrovkine c3df325418 Updated MAINTAINERS.md to match recommended opensearch-project format. (#261)
Signed-off-by: dblock <dblock@amazon.com>

Signed-off-by: dblock <dblock@amazon.com>
2023-01-06 10:04:15 -08:00
Sai Medhini Reddy Maryada b4bfde0e0b Added new OpenSearch versions and updated compatibility matrix (#257)
* Added new OpenSearch versions and updated compatibility matrix

Signed-off-by: saimedhi <saimedhi@amazon.com>

* Compatibility with OpenSearch 2.1.0 - 2.4.1

Signed-off-by: saimedhi <saimedhi@amazon.com>

Signed-off-by: saimedhi <saimedhi@amazon.com>
Co-authored-by: Daniel (dB.) Doubrovkine <dblock@dblock.org>
2023-01-05 15:46:52 -08:00
Minh Le 9f84873c01 fix faulty example (#256)
single-quoted string spanning multiple lines leads to grammatical error

Signed-off-by: Minh Le <m.le@elsevier.com>

Signed-off-by: Minh Le <m.le@elsevier.com>
2023-01-03 12:29:49 -08:00
Harsha Vamsi Kalluri e6951d9824 Updating changelog to include released changes. Adding skip-changelog tag (#249)
Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>

Signed-off-by: Harsha Vamsi Kalluri <harshavamsi096@gmail.com>
2023-01-03 12:24:25 -08:00