Update examples/python-loganalysis/readme.md

Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>
This commit is contained in:
Matt Williams 2023-11-14 10:31:22 -08:00 committed by GitHub
parent 64b7e0c218
commit f4edc302a8
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23

View file

@ -45,4 +45,4 @@ for line in response.iter_lines():
There is a lot more that can be done here. This is a simple way to detect errors, looking for the word error. Perhaps it would be interesting to find anomalous activity in the logs. It could be interesting to create embeddings for each line and compare them, looking for similar lines. Or look into applying Levenshtein Distance algorithms to find similar lines to help identify the anomalous lines.
Also try different models and different prompts to analyze the data. You could consider adding RAG to this to help understand newer log formats.
Also try different models and different prompts to analyze the data. You could consider adding retrieval augmented generation (RAG) to this to help understand newer log formats.