DEV Community

Mike Houngbadji
Mike Houngbadji

Posted on • Edited on

Apache Spark SQL: CTAS USING CSV with specific delimiter

#sql #spark #database #tips

To use CTAS (Create table as Select) in Apache Spark with a specific delimiter using the OPTION syntax:

CREATE TABLE sample_table
USING CSV
OPTIONS ('delimiter'='|')
AS
SELECT ....
Enter fullscreen mode Exit fullscreen mode

SparkSQL Documentation

PS:
I wrote this to also help myself retrieve the solution faster.

Top comments (0)

Read next

leandroveiga profile image

Master Advanced LINQ in C#: Writing Ultra-Efficient Queries for Massive Datasets

Leandro Veiga -

chintanonweb profile image

Code Review Assistant using Open Source AI Challenge with pgai and Ollama

chintanonweb -

visdom_04_88f1c6e8a47fe74 profile image

LLaVA-o1: Transforming How We Think with Visual Language Models (VLMs)

VISDOM 04 -

kuhiepmr profile image

Rust Fullstack - Ollama: RepStar

kuhiepmr -