How to integrate Oracle and Kafka

by

There is currently just one tool which is open source and has minimal impact on the database. This is OpenLogReplicator.

  • license is GPL – it is fully open source

  • it has very low impact on the source database – it requires no licensing options and just turning on supplemental logging on the source (like all other replication tools)

  • it is written completely in C++ – so it has very low latency and high throughput

  • it works completely in memory

  • it supports all Oracle database versions since 11.2.0.1 (11.2, 12.1, 12.2, 18, 19)

It reads binary format of Oracle Redo logs and sends them to Kafka. It can work on the database host, but you can also configure it to read the redo logs using sshfs from another host – with minimal load of the database.

disclaimer #1: I am the author of this solution

disclaimer #2: to other StackOverflow users: please do not delete this answer. This question has a lot of duplicates. But this is the first question and other duplicates should be redirected here and marked as duplicates. Not the other way. I have deleted all other answers from other questions and just leaving this answer as the primary answer.

More Related Contents:

  1. Calculate difference between 2 date / times in Oracle SQL
  2. Can you SELECT everything, but 1 or 2 fields, without writer’s cramp?
  3. List of foreign keys and the tables they reference in Oracle DB
  4. How to generate entire DDL of an Oracle schema (scriptable)?
  5. hibernate oracle sequence produces large gap
  6. How to get records randomly from the oracle database?
  7. Oracle PL/SQL – Raise User-Defined Exception With Custom SQLERRM
  8. Auto Increment for Oracle
  9. Oracle Search all tables all columns for string [duplicate]
  10. Get resultset from oracle stored procedure
  11. Deploying and Configuring ODP.NET to work without installation with Entity Framework
  12. Add a auto increment primary key to existing table in oracle [duplicate]
  13. ways to avoid global temp tables in oracle
  14. Spring Batch ORA-08177: can’t serialize access for this transaction when running single job, SERIALIZED isolation level
  15. How to generate an entity-relationship (ER) diagram using Oracle SQL Developer
  16. String to date in Oracle with milliseconds
  17. Error while trying to retrieve text for error ORA-01804
  18. Create Pivot view in SQL from a SQL table
  19. Does Oracle support full text search?
  20. Oracle.ManagedDataAccess.EntityFramework – ORA-01918: user ‘dbo’ does not exist
  21. Why doesn’t PL/SQL respect privileges granted by Roles?
  22. ORA-00054: resource busy and acquire with NOWAIT specified or timeout expired
  23. Can We use threading in PL/SQL?
  24. Speed up to_sql() when writing Pandas DataFrame to Oracle database using SqlAlchemy and cx_Oracle
  25. What is the algorithm used by the ORA_HASH function?
  26. oracle “table or view does not exist” from inside stored procedure
  27. passing in table name as plsql parameter
  28. How to use parameters in a ‘where value in…’ clause?
  29. How to generate a version 4 (random) UUID on Oracle?
  30. Find out the history of SQL queries

Leave a Comment