Honza Král
5d4640d4c2
Move parallel_bulk helper into helpers/__init__
2015-10-10 18:35:50 +02:00
Honza Král
ccef253001
Merge branch 'parallel'
2015-10-07 18:28:33 +02:00
Sujay Mansingh and Honza Král
e3d25e8fe3
[ #256 ] Fix exception message
...
* Typo: Scrol -> Scroll
* We need to format the string with the args ourselves (ScanError won't
do it).
Otherwise the args in the ScanError won't be substituted.
2015-10-07 17:53:39 +02:00
Honza Král
2ba03d261a
greatly simplify parallel_bulk by using Pool.imap
2015-10-06 02:11:22 +02:00
Honza Král
2208387e0b
Extract the processing of individual bulk request to a separate method
2015-10-06 02:10:42 +02:00
Honza Král
a0e1bf61aa
Experimental helper for doing bulk requests in parallel
2015-10-01 01:25:29 +02:00
Honza Král
3400179153
Allos the size of the bulk request to be defined in bytes
...
Fixes #199
2015-09-30 21:06:24 +02:00
Honza Král
928fc000d1
Serialize the data in bulk helper
2015-09-30 19:25:17 +02:00
Honza Král
9e4d0dd25d
Move the bulk body construction into _chunk_actions
2015-09-30 19:16:21 +02:00
Honza Král
a177375c25
Don't keep the data twice in bulk helper
2015-09-30 19:03:49 +02:00
Honza Král
0ad6b94d1e
Extract chunking from streaming_bulk
2015-09-30 18:23:42 +02:00
Jason Veatch
80ccb181cd
Removed "optionally", it might be confusing.
2015-09-09 16:06:03 -04:00
Jason Veatch
09efa15813
Clarified _op_type options in streaming_bulk docstring.
2015-09-09 15:02:09 -04:00
Honza Král
fdeb3d1131
Make sure reindex preserves _parent, _routing and _timestamp
...
Fixes #140
2015-06-20 00:27:08 +02:00
Honza Král
47afab73ad
Fix new skipping logic in yaml tests
2015-04-22 21:50:19 +02:00
Honza Král
eee5701dd0
Allow stats_only parameter to bulk from reindex to be overridden
...
Fixes #218
2015-04-19 17:28:20 +02:00
Honza Král
79ca075ab0
More sane defaults for helpers
...
Also make sure errors while scrolling will not be ignored
Fixes #194
2015-02-18 18:28:55 +01:00
Honza Král
756298a360
Added documentation explaining scan and ordering
...
Thanks drorata for the initial patch and issue
2015-02-12 10:58:20 +01:00
Honza Král
f065817e89
Add option to pass kwargs to scan and bulk in reindex helper
2015-01-30 00:04:04 +01:00
Honza Král
93d287d99c
Added tests for raise_on_exception
2015-01-24 18:41:43 +01:00
Honza Král
320e17dce8
Added raise_on_exception param to streaming_bulk
...
This means that we can now handle also TransportErrors that might occur
durig the bulk processing and report those items in the failed request
as failed instead of just propagating the exception.
Fixes #166
2015-01-24 18:41:35 +01:00
Honza Král
32f23b6748
Add some docs for scan mentioning passing extra args to search
...
Fixes #186 Thanks jpshelley!
2015-01-16 23:33:38 +01:00
syllogismos and Honza Král
87bba04d4d
Update reindex helper function to introduce a new query argument.
...
you can specify an extra `query` argument, so that you could reindex only the docs that belong to a specific query.
2015-01-16 16:34:45 +01:00
Honza Král
9b5d2c062e
Add an option to use scan helper without search_type=scan, use with caution
...
Fixes #160
2014-12-15 15:15:03 +01:00
Yuri Khrustalev
36967e5307
make scan helper deal with empty response, refs #142
2014-10-22 14:41:41 +04:00
Honza Král
e68786bc8a
Clearer message regardings alternate bulk operations.
...
Fixes #107 , thanks jwarzech!
2014-08-02 14:31:47 +02:00
speedplane and Honza Král
d987546230
Add relative imports so 1.0 and 0.9x can co-exist.
2014-06-06 17:32:19 +02:00
Honza Král
b1d36926c1
Allow get_test_client to not wait for es cluster startup
2014-05-20 15:05:40 +02:00
Honza Král
71176d5595
Provide helpers for running tests against elasticsearch
2014-04-23 01:12:03 +02:00
Honza Král
28f9171235
Make helpers into a package
2014-04-23 00:49:25 +02:00
Honza Král