[v24.3.x] Added property to control enablement of `__consumer_offsets` cache

[vbotbuildovich]

Backport #26522 to branch v24.3.x. This issue was created as a placeholder because the original PR's commit(s) could not be automatically cherry-picked.
Here are the commands to execute:

git checkout v24.3.x
git checkout -b manual-backport-26522-v24.3.x-584
git cherry-pick -x d402ebdddf e3995b1260 094ddcb295

git push origin manual-backport-26522-v24.3.x-584
gh pr create \
  --title "[v24.3.x] Added property to control enablement of `__consumer_offsets` cache" \
  --base "v24.3.x" \
  --label "kind/backport" \
  --head "manual-backport-26522-v24.3.x-584" \
  --draft \
  --repo "redpanda-data/redpanda" \
  --milestone "v24.3.x-next" \
  --body "Backport of PR https://github.com/redpanda-data/redpanda/pull/26522 "

JIRA Link: [CORE-12515](https://redpandadata.atlassian.net/browse/CORE-12515)

[CORE-12515]: https://redpandadata.atlassian.net/browse/CORE-12515?atlOrigin=eyJpIjoiNWRkNTljNzYxNjVmNDY3MDlhMDU5Y2ZhYzA5YTRkZjUiLCJwIjoiZ2l0aHViLWNvbS1KU1cifQ