Apache NiFi is already used in many companies to automatically transfer data between different systems. It originally comes from the big data area and is often used to load a "big data lake".
But it doesn't always have to be big data environments. Apache NiFi can also be useful for smaller use cases. This is why the open source tool is playing an important role in more and more companies. This is mainly due to the large number of connection options. All common database systems, as argentina telegram screening well as the usual big data services, but also cloud services can be connected. No in-depth programming knowledge is required for this and the web UI enables the creation of a so-called data flow using drag and drop. In this blog we want to show how this can be used to create joins across a wide variety of database systems and other data sources.
Often, not all of the required data is available directly in one database, but is distributed across different systems. Nevertheless, in certain cases, you may want to combine and evaluate such heterogeneously distributed data. If the data records are divided into several tables in a database, they can be combined using a join query. This is a long-known function and probably nothing new for most readers.
The related records are usually identified and combined using a key (primary and foreign key) or "keys". These keys (PK & FK) must be the same for all tables to be queried. Only then will logically related records be returned. The same principle is used in Apache NiFi's lookup processor.