JSONL Resources

Curated collection of tools, libraries, and community resources

Official Resources

JSONLines.org

Official JSON Lines format specification and documentation

NDJSON GitHub Organization

Community-driven NDJSON tools and specifications

Recommended Books

Fundamentals of Data Engineering

Learn how to plan and build data systems to serve your needs

Designing Data-Intensive Applications

The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

Data Pipelines Pocket Reference

Moving and Processing Data for Analytics

AI Engineering Foundation Models

Building Applications with Foundation Models

Libraries & Parsers

Python

jsonlines

Popular Python library for reading and writing JSONL files

ndjson

Lightweight NDJSON parser with streaming support

JavaScript / Node.js

ldjson-stream

Streaming Line Delimited JSON parser for Node.js

ndjson (npm)

Newline delimited JSON for Node.js streams

Go

encoding/json

Built-in Go JSON encoder with JSONL support via bufio.Scanner

ndjson-go

Go package for reading and writing NDJSON

Ruby

fluent-plugin-jsonl

Fluentd plugin for JSONL format

JSON (stdlib)

Built-in Ruby JSON with line-by-line parsing

Java

Jackson

High-performance JSON processor with streaming support

Gson

Google JSON library with streaming API

Rust

serde_json

Fast JSON serialization with streaming support

BufReader

Use with serde_json for line-by-line JSONL parsing

Command Line Tools

jq

Lightweight and flexible command-line JSON processor with JSONL support

fx

Interactive terminal JSON viewer with JSONL support

xsv

Fast CSV toolkit that can convert to/from JSONL

Miller (mlr)

Like awk/sed/cut for name-indexed data such as CSV and JSONL

AI & Machine Learning

OpenAI Fine-Tuning

Uses JSONL format for training data in GPT model fine-tuning

Hugging Face Datasets

ML datasets library with native JSONL support

TensorFlow Datasets

Collection of datasets with JSONL export capabilities

Data Processing & Big Data

Apache Spark

Big data processing with native JSONL support

Pandas

Python data analysis with read_json(lines=True)

Apache Arrow

In-memory columnar format with JSONL conversion

DuckDB

In-process SQL with native NDJSON/JSONL support

Community & Learning

Stack Overflow

Questions tagged with 'jsonl' and 'ndjson'

r/dataengineering

Reddit community for data engineering discussions

GitHub Topics: JSONL

Discover open source projects using JSONL