New Python client and Jupyter extension

[sergiimk]

Description

Related to: #553

Changes:

• Notebook / Spark / Livy container management was significantly improved
• Flight SQL protocol now fully support authentication (anonymous accounts and bearer token)
• The kamu notebook command uses new image based on latest Jupyter and new kamu-client-python library
• The kamu notebook now uses DataFusion engine by default but can be started with --engine spark
• The kamu sql server command interface changed to use --engine datafusion/spark, removing the --flight-sql flag
• All example notebooks were converted to new Python client
• Examples in example/flightsql/python were updated to new auth and showcasing kamu Python library

Test plan: https://github.com/kamu-data/kamu-testing/pull/1

Checklist before requesting a review

• Unit and integration tests added
• Compatibility:
  • kamu notebook command behavior changed ❌
  • kamu sql server command behavior changed ❌
  • Network APIs: ✅
  • Workspace layout and metadata: ✅
  • Configuration: ✅
  • Container images: ❌
    • New Jupyter image already released
    • Jupyter demo env will need to be updated after the release
• Observability:
  • Tracing / metrics: ✅
  • Alerts: ✅
• Documentation:
  • Changelog: ✅
  • Public documentation: ❌ Update to FlightSQL and Python client changes kamu-docs#29
• Downstream effects:
  • kamu-contrib: Update notebooks to new python client kamu-contrib#27
  • kamu-node: ❌ Upgrade FlightSQL infra kamu-node#176
  • kamu-web-ui: ✅
  • release-queue