Developer Reference

Technical stacks

PIPES API

This is the core of the PIPES server, defining the schema for all types of metadata related to project activities and exposing REST APIs for PIPES operations. The PIPES API is built using the FastAPI web framework, providing a RESTful API with JWT-based authentication via the authentication header.

The data storage used behind is document-based No-SQL database.

• Uses MongoDB for local development and Amazon DocumentDB (with MongoDB compatibility) in production to store metadata. ODM (Object Document Mapper): Built with Beanie, an asynchronous ODM for MongoDB.

PIPES Web

The web interface is a ReactJS-based application that serves as the primary user interface. Key libraries are used here:

• amazon-cognito-identity-js – Handles authentication with Amazon Cognito.
• reactflow – Enables interactive graph flow creation based on modeling integration.

The web UI interacts with the PIPES API for PIPES project operations.

PIPES CLI

The CLI is a command-line interface built with Python Click, a widely used framework for CLI applications.

• It provides an efficient way to interact with PIPES API server via restful API calls.
• Enables metadata configuration and project management directly from the terminal console.

At this stage, the PIPES CLI is the primary tool to interact with PIPES API for data ingestion.

GitHub repositories

This project has open-sourced three GitHub repositories, all distributed under the BSD 3-Clause license.

• PIPES API: https://github.com/nrel-pipes/pipes-api

• PIPES Web: https://github.com/nrel-pipes/pipes-web

• PIPES CLI: https://github.com/nrel-pipes/nrel-pipes

We welcome feedback and contributions! Feel free to suggest improvements, report issues, or submit pull requests. 🚀