SQL - JSON Functions in SQL
Most modern relational databases support native JSON data types that validate and optimize JSON storage. PostgreSQL, MySQL 8.0+, SQL Server 2016+, and Oracle 12c+ all provide JSON capabilities with…
Read more →Json
Spark SQL - JSON Functions
• Spark SQL provides over 20 specialized JSON functions for parsing, extracting, and manipulating JSON data directly within DataFrames without requiring external libraries or UDFs
Read more →Spark Scala - Read JSON File
JSON remains the lingua franca of data interchange. APIs return it, logging systems emit it, and configuration files use it. When you’re building data pipelines with Apache Spark, you’ll inevitably…
Read more →Serialization: JSON, Protocol Buffers, MessagePack
Serialization converts in-memory data structures into a format that can be transmitted over a network or stored on disk. Deserialization reverses the process. Every time you make an API call, write…
Read more →Scala - JSON Parsing (circe/play-json)
Add these dependencies to your build.sbt:
R - Read JSON File (jsonlite)
The jsonlite package is the de facto standard for JSON operations in R. Install it once and load it for each session:
Python - Read/Write JSON Files
• Python’s json module provides load()/loads() for reading and dump()/dumps() for writing JSON data with built-in type conversion between Python objects and JSON format
PySpark - Write DataFrame to JSON File
Writing a PySpark DataFrame to JSON requires the DataFrameWriter API. The simplest approach uses the write.json() method with a target path.
PySpark: Working with Nested JSON
If you’ve worked with data from REST APIs, MongoDB exports, or event logging systems, you’ve encountered deeply nested JSON. A single record might contain arrays of objects, objects within objects,…
Read more →PySpark - Read JSON File into DataFrame
Reading JSON files into a PySpark DataFrame starts with the spark.read.json() method. This approach automatically infers the schema from the JSON structure.
PySpark - Read Multiline JSON
PySpark’s JSON reader expects newline-delimited JSON (NDJSON) by default. Each line must contain a complete, valid JSON object:
Read more →PySpark - Read Nested JSON File
PySpark’s spark.read.json() method automatically infers schema from JSON files, including nested structures. Start with a simple nested JSON file:
PySpark - Convert DataFrame to JSON
PySpark DataFrames are the backbone of distributed data processing, but eventually you need to export that data for consumption by other systems. JSON remains one of the most universal data…
Read more →PostgreSQL jsonb: JSON Document Storage in SQL
PostgreSQL’s JSONB data type bridges the gap between rigid relational schemas and flexible document storage. Unlike the text-based JSON type, JSONB stores data in a binary format that supports…
Read more →Pandas - Write DataFrame to JSON (to_json)
The to_json() method converts a pandas DataFrame to a JSON string or file. The simplest usage writes the entire DataFrame with default settings.
Pandas - Read JSON File (read_json)
• Pandas read_json() handles multiple JSON structures including records, split, index, columns, and values orientations, with automatic type inference and nested data flattening capabilities
Linux jq: Command-Line JSON Processing
If you’re working with JSON data on the command line—and as a modern developer, you almost certainly are—jq is non-negotiable. This lightweight processor transforms JSON manipulation from a tedious…
Read more →How to Use JSON Functions in PostgreSQL
PostgreSQL introduced JSON support in version 9.2 and added the superior JSONB type in 9.4. While both types store JSON data, JSONB stores data in a decomposed binary format that eliminates…
Read more →How to Read JSON Files in Pandas
JSON has become the lingua franca of web APIs and configuration files. It’s human-readable, flexible, and ubiquitous. But flexibility comes at a cost—JSON’s nested, hierarchical structure doesn’t map…
Read more →How to Read JSON Files in Polars
Polars has become the go-to DataFrame library for performance-conscious Python developers. While pandas remains ubiquitous, Polars consistently benchmarks 5-20x faster for most operations, and JSON…
Read more →How to Read JSON Files in PySpark
JSON has become the lingua franca of data interchange. Whether you’re processing API responses, application logs, configuration dumps, or event streams, you’ll inevitably encounter JSON files that…
Read more →Go encoding/json: JSON Marshaling and Unmarshaling
Go’s encoding/json package provides robust functionality for converting Go data structures to JSON (marshaling) and JSON back to Go structures (unmarshaling). This bidirectional conversion is…