Unified Namespace Data Integrity
MongoDB aids manufacturers by unifying operational data, enhancing production efficiency, enabling real-time insights, and optimizing processes.
Use cases: App-Driven Analytics, IoT, Single View
Industries: Manufacturing & Mobility
Products: Atlas Database, Atlas Charts, Change Streams, MongoDB Time Series
Partners: Cedalo (Mosquitto), Kafka Connector
Solution Overview
Manufacturing is experiencing a profound transformation through the integration of real-time data and centralized data management tools like the Unified Namespace (UNS) model. Modern factories generate vast amounts of data from various systems like enterprise resource planning (ERP), manufacturing execution system (MES), and shop floor machines. As manufacturers move towards connected and automated systems, unifying these data sources is crucial. Deloitte reports that smart factory initiatives can boost productivity by up to 12% and improve equipment effectiveness by up to 20%. Achieving these gains requires an effective data management strategy, one that leverages UNS models supported by robust solutions like MongoDB.
The unified approach facilitates real-time data visibility and seamless integration, helping to optimize processes and enhance operational efficiency. By breaking down traditional hierarchical data flows, manufacturers can leverage both historical and real-time insights for strategic planning and continuous improvements.
An effective UNS system proactively integrates and contextualizes data, taking steps to achieve organizational objectives without needing constant human intervention. Rather than merely reporting isolated data points, a UNS using MongoDB can autonomously unify and analyze data from diverse manufacturing systems, uncover critical insights, and facilitate informed decision-making.
In this solution, we develop a comprehensive Unified Namespace framework using MongoDB’s capabilities for flexible data modeling, real-time processing, and scalability.
The setup ingests various operational data types, analyzes streams for actionable insights, stores the information in MongoDB, and provides strategic recommendations based on comprehensive analytics with data from different sources and types.
Reference Architectures
Figure 1. Leafy factory UNS architecture
In the Leafy Factory demo, SQL data from a simulated MES is efficiently ingested into MongoDB, encompassing key production planning, monitoring, and quality metrics. This data, captured in MongoDB's flexible, document-based JSON format, ensures that MES information remains organized and readily accessible for real-time analysis and reporting. Similarly, SQL-based ERP data—such as work orders, material tracking, and cost breakdowns—is seamlessly integrated using a combination of Kafka change streams and the MongoDB Sink connector. The SQL data is ingested into Kafka topics through the Debezium connector, with SQL functioning as a Kafka producer. This data is then consumed, transformed, and inserted into MongoDB via the MongoDB Sink connector, establishing a seamless data flow between SQL, Kafka, and MongoDB. This process ensures that ERP data remains continuously synchronized in MongoDB, highlighting its reliability as a live source of crucial business information.
Simultaneously, simulated MQTT data streams deliver real-time shop floor data into the database, including machine status, quality outputs, and sensor readings like temperature and vibration. MongoDB's robust support for real-time ingestion allows this data to be immediately available, facilitating up-to-date machine monitoring and quicker response times.
Change streams are pivotal, enabling real-time data updates across systems. For instance, when a work order is updated in the ERP system, this change is instantly reflected downstream in MES and shop floor views, showcasing MongoDB's capability for bi-directional data flows and live synchronization within a unified data model.
Additionally, the demo highlights the importance of data contextualization and enrichment. As data enters the UNS, MongoDB enriches it with metadata such as machine ID, operator name, and location following the ISA95 structure. This enriched model supports fine-grained analysis and filtering, essential for generating actionable, cross-functional insights across manufacturing, operations, and business teams.
The Leafy Factory demo validates MongoDB's technical strengths—including real-time processing, flexible data modeling, and scalable architecture—and demonstrates how these capabilities coalesce to support a robust, dynamic, and future-ready Unified Namespace for smart manufacturing.
Building the Solution
This manufacturing data management solution is built using a combination of core technologies that work in unison to create a sophisticated framework, allowing seamless data processing and integration across diverse manufacturing systems. For complete implementation details, including code samples, configuration files, and tutorial videos, visit the GitHub repository.
Prerequisites
Python (3.12 or higher)
Node.js (14 or higher)
MongoDB Atlas Cluster (8.0.4 or higher)
Apache Kafka (Minimum version 3.9.0)
Java JDK (Minimum version 23)
PostgreSQL (15.10 or higher)
Data Ingestion with MQTT Broker
The solution begins by employing Cedalo's Mosquitto MQTT Broker to handle real-time data streams from shop floor machines. This broker efficiently gathers data, such as machine status and sensor readings (including temperature and vibration), ensuring seamless and immediate data transfer. The architecture remains broker-agnostic, capable of integrating with various other MQTT providers as needed.
SQL Data Integration via Kafka Connector
Concurrent with MQTT data reception, SQL data from ERP and MES systems is ingested using Kafka. The Debezium connector captures SQL-based data—such as work orders, material tracking, and cost breakdowns—and streams it into Kafka topics. MongoDB's Kafka Connector then processes this data, transforming and inserting it into MongoDB Atlas, which facilitates efficient synchronization between SQL systems and MongoDB. This integration ensures that ERP data remains continuously updated, serving as a reliable source of live business-critical information.
Database Management with MongoDB Atlas
MongoDB Atlas acts as the central repository, leveraging its flexible schema capabilities to accommodate diverse data structures, from raw machine sensor data to structured ERP records. By storing data in a document-oriented format, manufacturers can effortlessly adapt to changes, such as incorporating new sensors or modifying machine attributes. Atlas not only simplifies data management but also supports real-time ingestion across multiple sources.
{ "result": { "factory": { "location": "qro_fact_1", "timestamp": "2025-04-12 02:59:41.569745", "production_lines": [ { "production_line_id": 2, "machines": [ { "_id": 3, "machine_id": 3, "details": { "machine_status": "Available", "last_maintenance": "2024-10-31 14:25:00", "operator": "Grace Conway", "avg_temperature": 70.48, "avg_vibration": 0.59, "temp_values": 70, "vib_values": 0.01 }, "work_orders": [ { "id_work": 111, "jobs": [ { "id_job": 62 } ] }, { "id_work": 105, "jobs": [ { "id_job": 58 } ] }, { "id_work": 104, "jobs": [ { "id_job": 57 } ] }, { "id_work": 100, "jobs": [ { "id_job": 55 } ] }, { "id_work": 99, "jobs": [ { "id_job": 52 } ] } ] } ] } ] } } }
Real-Time Analysis with Time Series Collections
MongoDB Atlas utilizes Time Series collections to manage and analyze streaming data efficiently. This capability allows manufacturers to store time-stamped data, perform complex queries, and gain insights into manufacturing processes over time. Time Series collections enable businesses to monitor operations continuously, spot patterns, and react promptly to any changes, fostering proactive decision-making and optimizing resource utilization.
Visualization and Analytics with Atlas Charts
Atlas Charts plays a crucial role in visualizing the integrated data, providing intuitive graphical representations of production metrics, quality analysis, and machine statuses. Manufacturers can leverage these dynamic charts to gain comprehensive insights at a glance, facilitating informed decision-making across teams and departments. Atlas Charts transform data into actionable insights, enabling stakeholders to track performance and identify opportunities for optimization effectively.
Key Learnings
Implementing a Unified Namespace as the foundation of manufacturing data management brings several strategic benefits, with MongoDB at its core facilitating improved operational efficiency and insights.
Figure 2. The automation pyramid versus a Unified Namespace
Adaptability to Operational Changes: The success of a UNS hinges on its ability to effortlessly integrate new data sources and scale with expanding production lines. MongoDB's flexible document-oriented model is particularly adept at accommodating these shifts without requiring exhaustive architectural overhauls, allowing manufacturers to maintain a dynamic data ecosystem.
Centralized Data Layer for Advanced Applications: While the UNS itself doesn't perform applications like predictive maintenance directly, it provides the essential infrastructure for such initiatives. By centralizing both real-time and historical data, manufacturers can easily implement IoT-based solutions, enhance maintenance schedules, and optimize costs. This approach translates to reduced downtime and improved resource utilization.
Cross-Functional Insight Generation: Leveraging MongoDB's powerful analytics capabilities allows manufacturing teams to gain comprehensive insights. By integrating diverse datasets, such as MES metrics and ERP outputs, the UNS facilitates correlations that drive improvements in quality control and operational planning.
Ensured Data Availability and Reliability: With high availability being critical for a centralized data hub, MongoDB employs features like replica sets to ensure the system remains operational without interruption. This prevents potential disruptions in the manufacturing data ecosystem and supports reliable long-term operational strategies.
Technologies and Products Used
MongoDB Developer Data Platform
Partner Technologies
Authors
Raphael Schor, MongoDB
Romina Carranza, MongoDB
Giovanni Rodriguez, MongoDB