# CSV, Excel and JSONL Ingestion

      

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FRIv0YEi1VT4LHsrCAtRr%2Flogo-wordmark-200dpi-428x105.png?alt=media&#x26;token=628c0b3c-32f0-460c-a304-508d3864b2b4" alt="Logo for the CsvPath Framework" width="321"><figcaption></figcaption></figure>

<h2 align="center">Automate CSV, Excel, and JSONL Data Preboarding </h2>

<h3 align="center">End Manual File-by-file Validation!</h3>

#### CsvPath Framework registers, versions, validates, upgrades, and stages CSV, Excel, and JSONL files from data partners before they break your pipelines.

[CsvPath Framework](https://github.com/csvpath/csvpath) is open source data quality. Shift-left. Control data entering the enterprise with **less manual effort, fewer ingestion failures, and more agile development** using consistent data preboarding [you can try in minutes](https://www.csvpath.org/getting-started).  &#x20;

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FenNshk0Hh2pjTL2xtAej%2FScreenshot%202025-03-09%20at%206.45.40%E2%80%AFPM.png?alt=media&#x26;token=1169d82b-ce59-4f6a-9d38-d91b0bee2235" alt="" width="375"><figcaption><p>Your data lake deserves a data publisher it can trust!</p></figcaption></figure>

### Introducing FlightPath Data, the frontend to CsvPath Framework

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2F4EaKgKH0UKdpVY0XEEGI%2Fflightpath-logo-1-sm.png?alt=media&#x26;token=9786cf7f-b3d4-466c-b708-a4d3948bace9" alt=""><figcaption></figcaption></figure>

[**FlightPath Data** is a powerful new frontend to CsvPath Framework](https://www.flightpathdata.com/). Go beyond CsvPath Framework's built-in CLI. Get up and running faster with a purpose-built preboarding development and operations console. FlightPath Data gives you all the help and examples you need move quickly.&#x20;

FlightPath Data is bundled with **FlightPath Server**, the automation REST API connecting your existing infrastructure to data preboarding.&#x20;

Available as a *free* download from the [Microsoft Store](https://apps.microsoft.com/detail/9p9pbpkz4jdf?hl=en-US\&gl=US) and the [Apple MacOS Store](https://apps.apple.com/us/app/flightpath-data/id6745823097).

### The Architecture For Efficient Data File Feed Ingestion

**CsvPath Framework** implements the [**Collect, Store, Validate Publish architectural pattern.** ](https://static1.squarespace.com/static/66df9d47982d0d40e1574327/t/6771fe6f63bbf5361725ad05/1735523953587/The+Collect+Store+Validate+Pattern+-+Atesta+Analytics.pdf) Ingestion goes faster, is more cost-efficient, and more effective with a preboarding stage.&#x20;

CsvPath Framework was built to fill the blindspot between MFT (managed file transfer) and the data lake with a simple path to provably correct data.

This data preboarding blindspot is a big deal. Think about it. If even 1 in 30 companies depends heavily on CSV or Excel data, the *lack of **delimited file preboarding is a trillion-dollar problem***.&#x20;

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2F4ZPwvK3V1mvCptJLcrnD%2Fdata-flow.png?alt=media&#x26;token=e9d67078-0cb8-43d2-a5f9-b5cd0ad1b72a" alt="A data flow diagram showing how CSV, Excel and other tabular data come into the organization through a preboarding process that acts as a Trusted Publisher to the data lake and applications."><figcaption></figcaption></figure>

Why roll your own preboarding? CsvPath Framework is a purpose-built solution you can rollout now.

### Powerful CSV and Excel Validation

CSV and Excel validation is core to the Framework. **CsvPath Validation Language** is simple, easy to integrate, and flexible enough to handle the unexpected. Inspired by Schematron, XPath, and SQL, CsvPath Validation Language brings powerful data validation to less structured data. [Start here](https://www.csvpath.org/topics/higher-level-topics/validation/schemas-or-rules).

Together CsvPath Framework and FlightPath Data can help you build leadership's confidence that your data governance doesn't turn a blind eye to your most unruly data.&#x20;

### Integrated With Your Existing Tools

<figure><img src="https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2FzlYFVV4xbiaKZb6uc0TR%2Fintegration_logos.png?alt=media&#x26;token=86d6e931-f247-412d-b870-2192f6c4e22b" alt="Logos of the many popular DataOps tools that are integrated with CsvPath Framework: aws s3, azure, slack, Excel, opentelemetry, sftp, ckan, pandas, openlineage, and more" width="563"><figcaption><p>CsvPath has a bunch of built-in integrations. Suggest more!</p></figcaption></figure>

[Parquet](https://www.csvpath.org/topics/how-tos/parquet) / [Sqlite](https://www.csvpath.org/topics/how-tos/sqlite) / [S3](https://www.csvpath.org/topics/how-tos/storage-backends/aws-s3) / [OpenLineage](https://www.csvpath.org/getting-started/dataops-integrations/openlineage) / [OpenTelemetry](https://www.csvpath.org/getting-started/dataops-integrations/opentelemetry) / [Slack](https://www.csvpath.org/topics/how-tos/slack) / [Postgres](https://www.csvpath.org/topics/how-tos/postgres-and-mysql) / [MySQL](https://www.csvpath.org/topics/how-tos/postgres-and-mysql) / [Azure](https://www.csvpath.org/topics/how-tos/storage-backends/azure) / [Google Cloud Storage](https://www.csvpath.org/topics/how-tos/storage-backends/google-cloud-storage) / [Webhooks](https://www.csvpath.org/topics/how-tos/webhooks) / [JSONPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/jsonpath.md) / [XPath](https://github.com/csvpath/csvpath/blob/main/docs/func_gen/xpath.md) / [Airflow](https://www.csvpath.org/topics/how-tos/airflow) and more.

### Give CsvPath Framework a Try

* [Getting Started](https://www.csvpath.org/getting-started)
* [How-tos](https://www.csvpath.org/topics/how-tos)
* [DataOps Integrations](https://www.csvpath.org/getting-started/dataops-integrations)
* [The FlightPath Examples](https://www.csvpath.org/getting-started/the-flightpath-data-examples)

{% hint style="success" %}
For more background on preboarding and the CsvPath and FlightPath architecture [check out the CsvPath blog](https://blog.csvpath.org/).&#x20;
{% endhint %}

{% file src="<https://2402701329-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F6wzqgDHj9mZbFxabiEbc%2Fuploads%2Fv5A894jerZ8gZeiwtErK%2FCsvPath%20-%20Data%20Onboarding%20Simplified.pdf?alt=media&token=3f272f16-ff77-415c-b1ab-b1be10f8da20>" %}

{% embed url="<https://github.com/csvpath/csvpath>" %}