Data Reconciliation
We developed an Excel-driven reconciliation solution with adapters for various databases.
Why do we prefer Excel/ODBC to pyspark? In many enterprises, Databricks is not allowed to access SAP directly due to security reasons. That’s why our engineers and analysts use Excel installed on company machines to bypass this limitation.
Both tables (in SAP and in Databricks) have 194 rows in total (Count(*) AS ROWCOUNT
):
Attaching Reconciliation Reporting results to tickets
Screenshot can be easily attached to a Pull Request or Jira ticket as proof of a successful reconciliation work