On the planet of information engineering, different ETL (Remove, Transform, Tons) architecture styles play essential roles in taking care of different information processing needs. Understanding these styles is crucial to building efficient, scalable, and reliable information pipes. This blog site covers three major ETL styles: Medallion Style, Lambda Design, and Kappa Design. Each of these styles uses one-of-a-kind advantages and is tailored to certain use cases.
Medallion Style
Review
The Medallion Style is a layered technique for information lakes, with 3 primary elements:
- Bronze Layer: Ingests raw information from various resources and stores it in its initial format within a data lake.
- Silver Layer: Cleans, enhances, and changes the raw information to enhance top quality and usability.
- Gold Layer: Accumulations and fine-tunes the data for particular business applications and reporting.
Layers
Bronze Layer:
Ingests raw information from sources like point-of-sale systems, on-line deals, IoT devices, etc.
- Shops the information in its initial layout within a data lake, allowing for the storage of big quantities of diverse information types without instant improvement.
Silver Layer:
- Focuses on cleaning and improving the raw information from the Bronze Layer.