WIP: Real dataset location

[wendigo]

Description

Additional context and related issues

Release notes

( ) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

## Section
* Fix some things. ({issue}`issuenumber`)

[dolfinus]

For JDBC-based connectors this is fine, but there are other connectors with different connection url format. Hive uses thrift://..., Kafka uses list of host:port of brokers, Loki uses http://. In most cases these can be represented in string form, but formats are different for each connector. Also, Google Sheets don't have connection URL at all, so nothing to parse.

To handle these connection URLs differently, there should be at least TableInfo.connectorName field. TableInfo.catalog field contains catalog name, not connector name.

[wendigo]

We can add a connector name to TableInfo. The location should be connector agnostic while being part of TableInfo (SPI implementations shouldn't leak there) so Optional<String> would need to do

[dolfinus]

Sounds reasonable.

One more thing though - TableInfo.location can make users think that this represents something like CREATE TABLE iceberg.mytable (...) LOCATION 's3://bucket/warehouse/mytable'. So I suggest using connectionURL/connectorAddress naming instead.

[wendigo]

@dolfinus that wouldn't make sense in the context of the lake connectors where you want s3://bucket/table/location

[dolfinus]

I mean that these should be separated options. Table location for lake connectors is one of table properties called location, and Catalog connector URL is a different thing which should not be named TableInfo.location.

[chenjian2664]

@dolfinus I was expecting the location to be within the table’s domain. I don't understand why we need to involve the catalog perspective

[dolfinus]

@chenjian2664 Have you checked the issue #25555?

[Praveen2112]

Shouldn't we have a SPI specific API in ConnectorMetadata which would resolve location based on ConnectorTableHandle ?