actions/opensearch-pyd
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity
756 Commits 3 Branches 0 Tags
1e2770fb5d121dbcdcd9caf63dcf7d7847f4390a
Commit Graph
38 Commits
Author SHA1 Message Date
Honza Král 1e2770fb5d Change default size for scan to 1000 
Fixes #408
 2016-06-03 15:07:09 -07:00
Honza Král 1ce17950e0 Make sure scan helper cleans up after itself 
Closes #389
 2016-05-17 15:14:27 +02:00
Honza Král 6e94bf76ad 5.0 compatibility 2016-03-22 21:04:07 +01:00
Honza Král 8342e0efb1 map already returns an iterator, no need to wrap it in iter 
Thanks to andreip for pointing it out!
 2016-01-15 14:15:53 +01:00
Honza Král 99c284d015 Fixing more typos. Thanks density! 
ref #333
 2016-01-12 11:33:03 +01:00
Honza Král 0f4fa3c97f Fixing typo in max_chunk_bytes 
Fixes #333 Thanks kengruven
 2016-01-07 20:35:27 +01:00
Honza Král b62d950bb8 Make sure we always close the pool when doing parallel_bulk 2015-12-27 21:10:55 +01:00
Honza Král 5e97002f28 Fix documentation for the query param of the scan helper 
Thanks apandita for the report!
 2015-10-23 15:21:28 +02:00
Dmitry SadovnychyiandHonza Král 2d04178215 Move import statement into a function 
To fix a bug on App Engine where multiprocessing is not allowed.
Closes #282
 2015-10-19 15:20:39 +02:00
Honza Král 22943e7e47 Move bulk helpers' docs outside of streaming_bulk's docstring 2015-10-11 23:45:09 +02:00
Honza Král 9d415fadef Adding tests for indexing strings via bulk helpers 2015-10-11 05:00:14 +02:00
Honza Král acde15e742 we use our own compat module, not six 2015-10-10 18:57:21 +02:00
Honza Král 92c1757ad1 Allow people to just pass raw json strings to bulk helpers 
This should allow for significant speedups when indexing json documents
from a file
 2015-10-10 18:40:18 +02:00
Honza Král 5d4640d4c2 Move parallel_bulk helper into helpers/__init__ 2015-10-10 18:35:50 +02:00
Honza Král ccef253001 Merge branch 'parallel' 2015-10-07 18:28:33 +02:00
Sujay MansinghandHonza Král e3d25e8fe3 [#256] Fix exception message 
* Typo: Scrol -> Scroll
* We need to format the string with the args ourselves (ScanError won't
  do it).
  Otherwise the args in the ScanError won't be substituted.
 2015-10-07 17:53:39 +02:00
Honza Král 2208387e0b Extract the processing of individual bulk request to a separate method 2015-10-06 02:10:42 +02:00
Honza Král 3400179153 Allos the size of the bulk request to be defined in bytes 
Fixes #199
 2015-09-30 21:06:24 +02:00
Honza Král 928fc000d1 Serialize the data in bulk helper 2015-09-30 19:25:17 +02:00
Honza Král 9e4d0dd25d Move the bulk body construction into _chunk_actions 2015-09-30 19:16:21 +02:00
Honza Král a177375c25 Don't keep the data twice in bulk helper 2015-09-30 19:03:49 +02:00
Honza Král 0ad6b94d1e Extract chunking from streaming_bulk 2015-09-30 18:23:42 +02:00
Jason Veatch 80ccb181cd Removed "optionally", it might be confusing. 2015-09-09 16:06:03 -04:00
Jason Veatch 09efa15813 Clarified _op_type options in streaming_bulk docstring. 2015-09-09 15:02:09 -04:00
Honza Král fdeb3d1131 Make sure reindex preserves _parent, _routing and _timestamp 
Fixes #140
 2015-06-20 00:27:08 +02:00
Honza Král eee5701dd0 Allow stats_only parameter to bulk from reindex to be overridden 
Fixes #218
 2015-04-19 17:28:20 +02:00
Honza Král 79ca075ab0 More sane defaults for helpers 
Also make sure errors while scrolling will not be ignored
Fixes #194
 2015-02-18 18:28:55 +01:00
Honza Král 756298a360 Added documentation explaining scan and ordering 
Thanks drorata for the initial patch and issue
 2015-02-12 10:58:20 +01:00
Honza Král f065817e89 Add option to pass kwargs to scan and bulk in reindex helper 2015-01-30 00:04:04 +01:00
Honza Král 93d287d99c Added tests for raise_on_exception 2015-01-24 18:41:43 +01:00
Honza Král 320e17dce8 Added raise_on_exception param to streaming_bulk 
This means that we can now handle also TransportErrors that might occur
durig the bulk processing and report those items in the failed request
as failed instead of just propagating the exception.

Fixes #166
 2015-01-24 18:41:35 +01:00
Honza Král 32f23b6748 Add some docs for scan mentioning passing extra args to search 
Fixes #186 Thanks jpshelley!
 2015-01-16 23:33:38 +01:00
syllogismosandHonza Král 87bba04d4d Update reindex helper function to introduce a new query argument. 
you can specify an extra `query` argument, so that you could reindex only the docs that belong to a specific query.
 2015-01-16 16:34:45 +01:00
Honza Král 9b5d2c062e Add an option to use scan helper without search_type=scan, use with caution 
Fixes #160
 2014-12-15 15:15:03 +01:00
Yuri Khrustalev 36967e5307 make scan helper deal with empty response, refs #142 2014-10-22 14:41:41 +04:00
Honza Král e68786bc8a Clearer message regardings alternate bulk operations. 
Fixes #107, thanks jwarzech!
 2014-08-02 14:31:47 +02:00
speedplaneandHonza Král d987546230 Add relative imports so 1.0 and 0.9x can co-exist. 2014-06-06 17:32:19 +02:00
Honza Král 28f9171235 Make helpers into a package 2014-04-23 00:49:25 +02:00