Files
opensearch-pyd/samples/document_lifecycle/document_lifecycle_sample.py
T
Mark Cohen 0ddbf8cafa Pylint integration updates (#643)
* updated files with docstrings to pass pylint

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated samples to prepare for enabling missing-docstring linter; will continue to work on this before committing setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed missing-function-docstring from setup.cfg so the linter doesn't fail while work on docstrings continues

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* corrected unnecessary return docstring values

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* fixing failure in 'black' on reformatting

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated utils to pass missing-function-docstring tests

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated functions with missing docstrings or pylint ignore instructions; added a utility to automatically add these ignore instructions to most functions that should be self-describing; rolled back some automatically generated code mistakenly changed

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* * ignoring opensearchpy for pylint and then added it back to noxfile.py
* fixed some lints; created a feature flag for newer dynamic pylint so now lints can be fixed first in legacy code and then enabled by multiple people
* extracted a method for per-folder linting
* updated noxfile.lint_per_folder with type hints
* enabled unspecified-encoding in pylint
* added disable missing-function-docstring pragma to test_clients.py in test_async and test_server
* added more encodings to pass unspecified-encoding pylint tests
* updated changelog
Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated CHANGELOG.md entry
removed the feature flag for pylint lint_per_folder
fixed failures from mypy and pylint
removed pylint MESSAGE CONTROL config from setup.cfg after relocating to lint_per_folder method
Signed-off-by: Mark Cohen <markcoh@amazon.com>

* removed pylint ignore missing-function-docstring

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added pylint.extensions.docparams plugin

updated some docstrings to correct parameters

removed pylint from setup.cfg

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* added four lints for opensearchpy/

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* adding await back to client.info() call

Signed-off-by: Mark Cohen <markcoh@amazon.com>

* updated TODOs as requested

renamed test_opensearchpy.test_async.test_server.test_helpers.conftest.setup_ubq_tests to setup_update_by_query_tests

added
OpenSearch-main/rest-api-spec/src/main/resources/rest-api-spec/test/indices/stats/50_noop_update[0]
to skip tests list

run_tests.py catches a CalledProcessError when the git repo already exists and the command to add the origin fails in fetch_opensearch_repo()

Signed-off-by: Mark Cohen <markcoh@amazon.com>

---------

Signed-off-by: Mark Cohen <markcoh@amazon.com>
2024-01-19 13:36:05 -05:00

109 lines
2.9 KiB
Python

#!/usr/bin/env python
# SPDX-License-Identifier: Apache-2.0
#
# The OpenSearch Contributors require contributions made to
# this file be licensed under the Apache-2.0 license or a
# compatible open source license.
#
# Modifications Copyright OpenSearch Contributors. See
# GitHub history for details.
from opensearchpy import OpenSearch
# For cleaner output, comment in the two lines below to disable warnings and informational messages
# import urllib3
# urllib3.disable_warnings()
def main() -> None:
"""
provides samples for different ways to handle documents
including indexing, searching, updating, and deleting
"""
# Connect to OpenSearch
client = OpenSearch(
hosts=["https://localhost:9200"],
use_ssl=True,
verify_certs=False,
http_auth=("admin", "admin"),
)
# Create an index
index = "movies"
if not client.indices.exists(index=index):
client.indices.create(index=index)
# Create documents
client.index(
index=index, id=1, body={"title": "Beauty and the Beast", "year": 1991}
)
client.index(
index=index,
id=2,
body={"title": "Beauty and the Beast - Live Action", "year": 2017},
)
# Index a document
client.index(index=index, id=2, body={"title": "The Lion King", "year": 1994})
# Create a document with auto-generated ID
result = client.index(index=index, body={"title": "The Lion King 2", "year": 1998})
print(result)
# Get a document
result = client.get(index=index, id=1)["_source"]
print(result)
# Get a document with _source includes
result = client.get(index=index, id=1, _source_includes=["title"])["_source"]
print(result)
# Get a document with _source excludes
result = client.get(index=index, id=1, _source_excludes=["title"])["_source"]
print(result)
# Get multiple documents
result = client.mget(index=index, body={"docs": [{"_id": 1}, {"_id": 2}]})["docs"]
print(result)
# Check if a document exists
result = client.exists(index=index, id=1)
print(result)
# Update a document
client.update(index=index, id=1, body={"doc": {"year": 1995}})
# Update a document using script
client.update(
index=index, id=1, body={"script": {"source": "ctx._source.year += 5"}}
)
# Update multiple documents by query
client.update_by_query(
index=index,
body={
"script": {"source": "ctx._source.year -= 1"},
"query": {"range": {"year": {"gt": 2023}}},
},
)
# Delete a document
client.delete(index=index, id=1)
# Delete a document with ignore 404
client.delete(index=index, id=1, ignore=404)
# Delete multiple documents by query
client.delete_by_query(
index=index, body={"query": {"range": {"year": {"gt": 2023}}}}
)
# Delete the index
client.indices.delete(index=index)
print("Deleted index!")
if __name__ == "__main__":
main()