Commit Graph
99 Commits
Author SHA1 Message Date
Seth Michael LarsonandGitHub a728aaa491 [7.x] Sort imports with isort and regenerate APIs 2021-01-13 14:21:04 -06:00
fe5367382b [7.x] Move client meta header logic to Transport
Co-authored-by: Seth Michael Larson <[email protected]>
2020-12-17 15:25:08 -06:00
b894e359df [7.x] Add the 'X-Elastic-Client-Meta' header
Co-authored-by: Seth Michael Larson <[email protected]>
2020-12-14 17:50:14 -06:00
bbb72cd932 [7.x] Allow '_shards.skipped' to be absent on scroll responses
Co-authored-by: Seth Michael Larson <[email protected]>
2020-11-20 16:41:58 -06:00
Seth Michael LarsonandSeth Michael Larson cde2a53468 [7.x] Switch to MutableMapping for headers/params 2020-09-28 15:49:14 -05:00
Seth Michael LarsonandSeth Michael Larson 6daa14315a [7.x] Add typing metadata and manual types to package 2020-09-28 15:49:14 -05:00
ff378f6b0d [7.x] Add optimistic concurrency and update+_source options to bulk
Co-authored-by: Seth Michael Larson <[email protected]>
2020-09-28 09:17:16 -05:00
40aeeffdf4 [7.x] Fix typo in ScanError
Co-authored-by: Nathan Meisels <[email protected]>
2020-09-14 17:19:56 -05:00
Seth Michael LarsonandSeth Michael Larson 680ab85275 [7.x] Add async helpers 2020-08-20 09:11:33 -05:00
Seth Michael LarsonandGitHub b13c7c6217 [7.x] Switch to long Apache-2.0 license header 2020-07-02 13:15:25 -05:00
Seth Michael LarsonandSeth Michael Larson eaff4af910 [7.x] Switch to Pytest as default runner 2020-05-19 14:18:53 -05:00
Seth Michael LarsonandSeth Michael Larson 8e1798cf31 Apply license header changes and API gen 2020-04-23 14:10:49 -05:00
Seth Michael LarsonandGitHub 9c39f37547 Release 7.7.0a1 2020-04-01 09:16:38 -05:00
Seth Michael LarsonandGitHub 7f07f1f728 [7.x] Surface deprecation warnings from Elasticsearch 2020-03-31 14:44:20 -05:00
Seth Michael LarsonandSeth Michael Larson 210fae23d0 Run Black+Flake8 on project 2020-03-09 13:54:47 -05:00
Seth Michael LarsonandGitHub 024abcfa39 Unskip API tests, add xpack no_xpack default_shards features 2020-02-28 11:36:03 -06:00
Seth Michael LarsonandGitHub 2c7ea70201 Migrate CI to Jenkins on 7.x branch (#1114) 2020-02-27 10:13:49 -06:00
Thomas Thiebaud 321561f4c3 Support both deprecated and new bulk parameters
Fixes #1020
2019-11-21 17:41:21 +01:00
Honza Král fc78c992ef Take skipped shards as successful in scan helper 2019-10-04 11:46:48 +02:00
John Young 916a744baf Pass scroll and scroll_id in the request body instead of as query params 2019-06-20 11:26:46 -04:00
Nick LangandGitHub 8e92b857bc Update ES client API's for some missing 7 features (#949)
* Update cat.py to have correct query params

* Add missing api remote_info and missing params

* a couple apis have had added query params

* Add Split api and add missing query params

* Adding processor_grok api

* Adding missing apis:
* update by query rethrottle
* scripts painless execute
* scripts painless context
* rank eval

* delete by query rethrottle

* add missing query params

* Add missing xpack apis

* Update helpers to account for 7.x scroll api
2019-05-10 16:41:50 -06:00
Nick LangandGitHub 206f5e2754 Black (#948) 2019-05-10 09:16:33 -06:00
Christopher LeeandNick Lang fda9d3429c BlockingPool must fit thread_count (#894)
queue_size must be greater than or equal to thread_count, or else the main thread can hang trying to acquire a lock to write sentinel values to the queue during teardown.
2019-04-26 11:57:11 -06:00
SlamandNick Lang 2181611a00 Scan refactor (#924)
* Adds scan test for exception & data yielded

* Adds scan test for fast route & initial search error

* Refactores scan implementation; better scroll test

* Adds tests clear_scroll & logger
2019-04-05 09:31:43 -06:00
Nick LangandGitHub 1afceba69b update to ES 7 (#911)
* update to ES 7

* more updates to make tests run

* update the test matrix

* remove python 3.3

* update xpack apis

* relative imports
2019-03-29 09:25:23 -06:00
Asher MancinelliandNick Lang 85573db275 Restructuring helpers dir (#886)
* PEP8 formatting & package structuring

* adding internal function imports into helpers init

* changed absolute paths for mock

* removed debugging print statements

* resolving @fxdgear 's comment
2019-01-14 11:27:02 -08:00
Nick LangandGitHub f3f7266c1f better logic to handling unicode and chunking. (#870)
Chunking was looking at the length of a string but not accounting for the
byte length. closes #716
2018-11-26 10:58:47 -07:00
ItayandNick Lang de8413fdbd typo fix in helpers (#854) 2018-10-11 03:05:11 -06:00
MillyandNick Lang cd871244e0 TransportError not raised in helpers.streaming_bulk() with max_retries. (#775)
* Add test to raise `TransportError` in `helpers.streaming_bulk()` with `max_retries`.

* Re-raise `TransportError` if the last retry fails.
2018-04-24 11:35:54 -06:00
Nick LangandGitHub 9721e4bc92 Nick/query params bulk helper (#774)
* cleanup doc strings closes #766

* adding *args to bulk helpers so values such as timeout can be passed in. Closes #773
2018-04-20 13:11:37 -06:00
umeandNick Lang 4e95fe320d Support renamed routing bulk parameter (#735) 2018-03-04 15:13:52 -08:00
Mike Sukmanowsky 197ad82e18 Use proper retry_on_conflict for helpers.expand_action
As per
https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html#bulk-update,
retry_on_conflict should not be preceeded by an underscore.
2018-02-13 12:06:29 -05:00
konradkonradandGitHub 9b288a1e92 docstring typo fixes
cheers
2017-11-16 17:07:57 +01:00
Honza Král 4e6a05f614 Added scroll_kwargs to scan helper 2017-11-10 21:43:16 +01:00
Honza Král 92763522a9 Check successful shards instead of failed
Fixes #660, thanks @juke1
2017-11-09 20:35:53 +01:00
Honza Král 8f73594cac Tests for retry logic in streaming_bulk 2017-07-22 13:40:22 -04:00
Honza Král ba8772a66f When retrying we get deserialized data
This is just a hotfix until a better solution with proper tests come
along
2017-07-22 13:13:53 -04:00
Honza Král 2c0f6d8c04 refactor the helpers a bit for more consistent errors
Now every error (either returned by streaming_bulk or collected by bulk)
contains the original data as well
2017-07-20 13:53:23 -04:00
Honza Král a16679b2cf draft of docs for backoff helper 2017-07-18 18:08:00 -04:00
Honza Král b31b5ddae6 Merged backoff into streaming_bulk 2017-07-18 17:44:43 -04:00
Honza Král 66c380420f Forgot to assign data 2017-07-18 16:20:36 -04:00
Honza Král 957fcad34b Do not serialize the data in bulk_data
This can lead to multiple serializations when retrying with backoff
helper
2017-07-18 16:15:08 -04:00
Honza Král accb19ab90 Action must be a dict, not serialized string 2017-07-18 15:45:43 -04:00
Honza Král f9f4f0c61a have _chunk_actions always return data and actions 2017-07-18 14:18:09 -04:00
Honza Král c8231cad0e Initial implementation of a backoff bulk helper 2017-07-18 14:02:02 -04:00
Honza Král 620afc667f Set a limit on the internal queue of the parallel_bulk helper
Fixes #547
Solution taken from https://bugs.python.org/msg90067
2017-07-12 23:48:58 +02:00
Honza Král 5c658fcfb8 Allow pipeline as a parameter in bulk actions
Fixes #564
2017-04-17 22:12:41 +02:00
Honza Král c2fc5aa18c Be more explicit with stats_only behavior 2016-12-15 10:21:38 +11:00
Honza Král 5fe3b4baf8 Scan bug that caused the scan to be sorted 2016-11-02 19:29:41 +01:00
Honza Král aa3a7431ff Add note about reindex API to the reindex helper 2016-10-17 14:01:52 +02:00