> For the complete documentation index, see [llms.txt](https://www.csvpath.org/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://www.csvpath.org/readme.md).

# CSV, Excel and JSONL Ingestion

Stop writing custom import and validation scripts. CsvPath Framework automates CSV and Excel ingestion and data quality checks. Open source. Python.

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FMIV0dqreHnvlTQhGqMYx%2FScreenshot%202026-09-19%20at%201.33.20%E2%80%AFAM.png?alt=media&amp;token=6e1dff92-6467-43b0-a9a7-af24538ce5cc" alt="CsvPath Framework enables Data Contracts for Edge Data Governance of JSON, XML, and tabular data coming from external partners in files, API calls, or streaming messages. " width="563"><figcaption></figcaption></figure>

#### CsvPath Framework registers, versions, validates, upgrades, and stages CSV, JSON, XML, Excel, JSONL and data frames from data partners *before* your pipelines break.&#x20;

If your MFT or REST API drives external data directly into the data lake or database the damage is already done.&#x20;

[CsvPath Framework](https://github.com/csvpath/csvpath) is the open source way to shift-left data quality. Enforce clear data contracts at the edge with **less manual effort, fewer ingestion failures, and more agile development** using consistent data preboarding tools [you can try in minutes](/getting-started/quickstart.md). &#x20;

Support for data contracts and schemas written in **ODCS**, **XSD**, **JSON Schema**, and **CsvPath Validation Language**. Or use **XPath** or **JSONPath** for rules-based validation. All validation options are embedded in the preboarding workflow of a simple, efficient, open, and standards-based data firewall.&#x20;

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FenNshk0Hh2pjTL2xtAej%2FScreenshot%202025-03-09%20at%206.45.40%E2%80%AFPM.png?alt=media&amp;token=1169d82b-ce59-4f6a-9d38-d91b0bee2235" alt="" width="375"><figcaption><p>Your data lake deserves a data publisher it can trust!</p></figcaption></figure>

<h2 align="center">Get FlightPath Data, the open frontend</h2>

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2F4EaKgKH0UKdpVY0XEEGI%2Fflightpath-logo-1-sm.png?alt=media&amp;token=9786cf7f-b3d4-466c-b708-a4d3948bace9" alt=""><figcaption></figcaption></figure>

[**FlightPath Data** is a powerful frontend to CsvPath Framework](https://www.flightpathdata.com/). Go beyond CsvPath Framework's built-in CLI. Get up and running faster with a purpose-built data contracts, data preboarding development, and data operations console. FlightPath Data gives you all the help and examples you need move quickly.&#x20;

FlightPath Data is bundled with **FlightPath Server**, the no-code/low-code automation REST API connecting your existing infrastructure to robust edge data governance.&#x20;

Available as a *free* download from the [Microsoft Store](https://apps.microsoft.com/detail/9p9pbpkz4jdf?hl=en-US\&gl=US) and the [Apple MacOS Store](https://apps.apple.com/us/app/flightpath-data/id6745823097).

<h3 align="center">The Architecture For Efficient Edge Data Ingestion</h3>

**CsvPath Framework** implements the [**Collect, Store, Validate Publish architectural pattern.** ](https://static1.squarespace.com/static/66df9d47982d0d40e1574327/t/6771fe6f63bbf5361725ad05/1735523953587/The+Collect+Store+Validate+Pattern+-+Atesta+Analytics.pdf) External data ingestion goes faster, is more cost-efficient, and more effective with a Data Preboarding stage.&#x20;

CsvPath Framework was built to fill the blindspot between the edge and downstream data systems with a simple path to provably correct data. More than observational governance, the Framework enforces data contracts as an edge data firewall. It accepts and/or remediates data when possible, it halts the line when necessary.

The Data Preboarding blindspot is a big deal. Think about it. If even 1 in 30 companies depends existentially on CSV, JSON, XML, or Excel files or JSON streaming data from external data partners, ***poor edge Data Preboarding is a trillion-dollar problem.***&#x20;

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2Fj1rhr8AHakntfl8fJ4kT%2Fgovern.png?alt=media&amp;token=37f684da-fe9f-4edf-abfa-eff3d544751e" alt="A data flow diagram showing the position of CsvPath Framework acting as an Edge Data Governance Gateway managing data flow to protect core enterprise data systems"><figcaption></figcaption></figure>

Why roll your own data preboarding tool chain? CsvPath Framework is a purpose-built off-the-shelf solution you can rollout now.

<h3 align="center">Powerful Validation For Batch Files and Real-time Data</h3>

CSV, Excel, NDJSON, and JSONL validation has never been as sophisticated as JSON Schema and XSD — until now. **CsvPath Validation Language** is simple, easy to integrate, and flexible enough to handle the unexpected. Inspired by Schematron, XPath, and SQL, CsvPath Validation Language brings powerful data validation to tabular and JSON Lines structured data.&#x20;

CsvPath Framework supports four schema languages: ODCS, JSON Schema, XSD, and CsvPath Validation Language. Working together they are unstoppable. [Start here](/getting-started/data-contracts-and-validation.md).

Running CsvPath Framework and FlightPath Data can help you build your organization's confidence that your data governance doesn't turn a blind eye to its most unruly data.&#x20;

<h3 align="center">Integrated With Your Existing Tools</h3>

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FzlYFVV4xbiaKZb6uc0TR%2Fintegration_logos.png?alt=media&amp;token=86d6e931-f247-412d-b870-2192f6c4e22b" alt="Logos of the many popular DataOps tools that are integrated with CsvPath Framework: aws s3, azure, slack, Excel, opentelemetry, sftp, ckan, pandas, openlineage, and more" width="563"><figcaption><p>CsvPath has many built-in integrations. Suggest more!</p></figcaption></figure>

[ODCS](/topics/how-tos/validating-with-odcs.md), [JSON Schema](https://json-schema.org/) / [Parquet](/topics/how-tos/parquet.md) / [Sqlite](/topics/how-tos/sqlite.md) / [S3](/topics/how-tos/storage-backends/aws-s3.md) / [OpenLineage](/getting-started/observability-integrations/openlineage.md) / [OpenTelemetry](/getting-started/observability-integrations/opentelemetry.md) / [Slack](/topics/how-tos/slack.md) / [Postgres](/topics/how-tos/postgres-and-mysql.md) / [MySQL](/topics/how-tos/postgres-and-mysql.md) / [Azure](/topics/how-tos/storage-backends/azure.md) / [Pandas](https://pandas.pydata.org/) / [Google Cloud Storage](/topics/how-tos/storage-backends/google-cloud-storage.md) / [Webhooks](/topics/how-tos/webhooks.md) / [JSONPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/jsonpath.md) / [XSD](https://en.wikipedia.org/wiki/XML_Schema_\(W3C\)) / [XPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/xpath.md) / [Airflow](/topics/how-tos/airflow.md) / [CKAN](https://ckan.org/) and more.

<h3 align="center">Give CsvPath Framework a Try</h3>

* [Getting Started](/getting-started/quickstart.md)
* [How-tos](/topics/how-tos.md)
* [DataOps Integrations](/getting-started/observability-integrations.md)
* [The FlightPath Examples](/topics/how-tos/validating-csv-and-excel/the-flightpath-data-examples.md)

{% hint style="success" %}
For more background on preboarding and the CsvPath and FlightPath architecture [check out the CsvPath blog](https://blog.csvpath.org/).&#x20;
{% endhint %}

{% file src="/files/mT8DDvqSrnXqfODHeaRF" %}

{% embed url="<https://github.com/csvpath/csvpath>" %}