Introduce Retry logic for LLM clients

[denis-domanskii]

Real world agent usage is facing multiple provider connectivity issues: timeouts, rate limits (especially during parallel agents execution), network and backend issues. To make agents more resilient, retry logic possibility should be added. This change introduces an LLM clients decorator supporting configurable retry logic.

Issue: https://youtrack.jetbrains.com/issue/KG-235/Introduce-Retry-logic-for-LLM-clients

---

Type of the change

• New feature
• Bug fix
• Documentation fix
• Tests improvement
• Refactoring

Checklist for all pull requests

• The pull request has a description of the proposed change
• I read the Contributing Guidelines before opening the pull request
• The pull request uses develop as the base branch
• Tests for the changes have been added
• All new and existing tests passed

Additional steps for pull requests adding a new feature

• An issue describing the proposed change exists
• The pull request includes a link to the issue
• The change was discussed and approved in the issue
• Docs have been added / updated

[github-actions]

Qodana for JVM

441 new problems were found

Inspection name	Severity	Problems
Check Kotlin and Java source code coverage	🔶 Warning	433
Vulnerable imported dependency	🔶 Warning	4
Missing KDoc for public API declaration	🔶 Warning	3
String concatenation that can be converted to string template	◽️ Notice	1

@@ Code coverage @@
+ 66% total lines covered
9261 lines analyzed, 6203 lines covered
# Calculated according to the filters of your coverage tool

☁️ View the detailed Qodana report

Contact Qodana team

Contact us at [email protected]

• Or via our issue tracker: https://jb.gg/qodana-issue
• Or share your feedback: https://jb.gg/qodana-discussions

[aozherelyeva]

Thank you!