Use Iceberg in Spark, Procedures return error

[fruitsalad11]

Query engine

No response

Question

Below is version info

This is my conf set

error msg:

At the same time, DDL statements can be executed normally.

[RussellSpitzer]

You have a few issues

Root cause - The Extensions aren't being loaded

There are a few things I see that could be the cause

1. I don't see any evidence of how you are actually putting these jars on the classpath.
   This is usually done with spark packages or spark jars, (this may be the most important issue)

2. You should only be including the iceberg-spark-runtime jar
   Don't include other Iceberg jars. Those are just gonna cause classpath issues with shading

3. You should be using only one version of Scala amongst your dependencies
   Some are using 2.12 some are on 2.13. Use the version of the Spark environment. Once you have the classpath right this should break until you match versions.

4. You are using a very old version of Iceberg (1.5) we are currently on 1.10