SAP2Databricks

Cloud Data Fusion

FeatureDetails
Environmenthttps://cloud.google.com/data-fusion only
Environment selectgcp
Run optionsSaaS
Pricing / 100 sourceshttps://cloud.google.com/data-fusion/pricing
BW data extraction support✅ (via ODP)
Database layer extraction✅ (via SLT)
Application layer extraction✅
Independent of SAP SLT☑️
Free of additional costs✅ (it’s SaaS)
Real-time support✅ (via SLT)
Extractors support✅
Installation needed❌ (fully SaaS)

Cloud Data Fusion Ingestion

OData

  • the Open Data Protocol (OData) enables data access and manipulation via HTTP requests
  • does not require any transport file or additional configuration in the SAP system
  • plugin supports full loads only based on entity sets or service documents
  • does not depend on SLT
  • performance may be worse compared to the ODP plugin.
  • may not support real-time data ingestion as it depends on the frequency of API calls
  • read docs

ODP

  • uses the Operational Data Provisioning (ODP) protocol developed by SAP.
  • full and incremental loads support both full and incremental loads based on delta queues or change pointers.
  • very flexible - supports various ODP contexts such as ABAP CDS views, BW extractors, HANA views, etc.
  • SAP Remote Function Module (RFM) needs to be installed on each SAP Server where data gets extracted (may need additional authorization)
  • read docs

SLT Replication

  • the SLT Replication plugin lets you replicate your data continuously and in real-time from SAP sources into BigQuery.
  • reads data from Cloud Storage that has been pushed by the SLT.
  • requires setup of the SLT Replication Server which may incur additional costs and complexity.
  • read docs

← Return to Data Ingestion